org.apache.spark.sql.columnar

Interface NullableColumnBuilder

All Superinterfaces:

ColumnBuilder

All Known Implementing Classes:

BinaryColumnBuilder, BooleanColumnBuilder, ByteColumnBuilder, ComplexColumnBuilder, DateColumnBuilder, DoubleColumnBuilder, FloatColumnBuilder, GenericColumnBuilder, IntColumnBuilder, LongColumnBuilder, NativeColumnBuilder, ShortColumnBuilder, StringColumnBuilder, TimestampColumnBuilder

public interface NullableColumnBuilder
extends ColumnBuilder

A stackable trait used for building byte buffer for a column containing null values. Memory layout of the final byte buffer is:

    .----------------------- Column type ID (4 bytes)
    |   .------------------- Null count N (4 bytes)
    |   |   .--------------- Null positions (4 x N bytes, empty if null count is zero)
    |   |   |     .--------- Non-null elements
    V   V   V     V
   +---+---+-----+---------+
   |   |   | ... | ... ... |
   +---+---+-----+---------+
 

Method Summary

Methods

Modifier and Type	Method and Description
void	appendFrom(org.apache.spark.sql.Row row, int ordinal) Appends row(ordinal) to the column builder.
java.nio.ByteBuffer	build() Returns the final columnar byte buffer.
java.nio.ByteBuffer	buildNonNulls()
void	initialize(int initialSize, String columnName, boolean useCompression) Initializes with an approximate lower bound on the expected number of elements in this column.
int	nullCount()
java.nio.ByteBuffer	nulls()
int	pos()

Methods inherited from interface org.apache.spark.sql.columnar.ColumnBuilder

columnStats

Method Detail

nulls

java.nio.ByteBuffer nulls()

nullCount

int nullCount()

pos

int pos()

initialize

void initialize(int initialSize,
              String columnName,
              boolean useCompression)

Description copied from interface: ColumnBuilder

Initializes with an approximate lower bound on the expected number of elements in this column.

Specified by:

initialize in interface ColumnBuilder

appendFrom

void appendFrom(org.apache.spark.sql.Row row,
              int ordinal)

Description copied from interface: ColumnBuilder

Appends row(ordinal) to the column builder.

Specified by:

appendFrom in interface ColumnBuilder

build

java.nio.ByteBuffer build()

Description copied from interface: ColumnBuilder

Returns the final columnar byte buffer.

Specified by:

build in interface ColumnBuilder

buildNonNulls

java.nio.ByteBuffer buildNonNulls()