parquet.column.values.rle

Class RunLengthBitPackingHybridValuesReader

java.lang.Object

parquet.column.values.ValuesReader

parquet.column.values.rle.RunLengthBitPackingHybridValuesReader

public class RunLengthBitPackingHybridValuesReader
extends ValuesReader

This ValuesReader does all the reading in initFromPage(int, byte[], int) and stores the values in an in memory buffer, which is less than ideal.

Author:

Alex Levenson

Constructor Summary

Constructors

Constructor and Description
RunLengthBitPackingHybridValuesReader(int bitWidth)

Method Summary

Methods

Modifier and Type	Method and Description
int	getNextOffset() Called to return offset of the next section
void	initFromPage(int valueCountL, byte[] page, int offset) Called to initialize the column reader from a part of a page.
boolean	readBoolean()
int	readInteger()
void	skip() Skips the next value in the page

Methods inherited from class parquet.column.values.ValuesReader

readBytes, readDouble, readFloat, readLong, readValueDictionaryId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RunLengthBitPackingHybridValuesReader

public RunLengthBitPackingHybridValuesReader(int bitWidth)

Method Detail

initFromPage

public void initFromPage(int valueCountL,
                byte[] page,
                int offset)
                  throws IOException

Description copied from class: ValuesReader

Called to initialize the column reader from a part of a page. The underlying implementation knows how much data to read, so a length is not provided. Each page may contain several sections:

• repetition levels column
• definition levels column
• data column

This function is called with 'offset' pointing to the beginning of one of these sections, and should return the offset to the section following it.

Specified by:

initFromPage in class ValuesReader

Parameters:

valueCountL - count of values in this page

page - the array to read from containing the page data (repetition levels, definition levels, data)

offset - where to start reading from in the page

Throws:

IOException

getNextOffset

public int getNextOffset()

Description copied from class: ValuesReader

Called to return offset of the next section

Overrides:

getNextOffset in class ValuesReader

Returns:

offset of the next section

readInteger

public int readInteger()

Overrides:

readInteger in class ValuesReader

Returns:

the next integer from the page

readBoolean

public boolean readBoolean()

Overrides:

readBoolean in class ValuesReader

Returns:

the next boolean from the page

skip

public void skip()

Description copied from class: ValuesReader

Skips the next value in the page

Specified by:

skip in class ValuesReader