parquet.column.values.deltalengthbytearray

Class DeltaLengthByteArrayValuesWriter

java.lang.Object

parquet.column.values.ValuesWriter

parquet.column.values.deltalengthbytearray.DeltaLengthByteArrayValuesWriter

public class DeltaLengthByteArrayValuesWriter
extends ValuesWriter

Write lengths of byte-arrays using delta encoding, followed by concatenated byte-arrays

   delta-length-byte-array : length* byte-array*
    
 

Author:

Aniket Mokashi

Constructor Summary

Constructors

Constructor and Description
DeltaLengthByteArrayValuesWriter(int initialSize)

Method Summary

Methods

Modifier and Type	Method and Description
long	getAllocatedSize()
long	getBufferedSize() used to decide if we want to work to the next page
BytesInput	getBytes()
Encoding	getEncoding() called after getBytes() and before reset()
String	memUsageString(String prefix)
void	reset() called after getBytes() to reset the current buffer and start writing the next page
void	writeBytes(Binary v)

Methods inherited from class parquet.column.values.ValuesWriter

createDictionaryPage, resetDictionary, writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DeltaLengthByteArrayValuesWriter

public DeltaLengthByteArrayValuesWriter(int initialSize)

Method Detail

writeBytes

public void writeBytes(Binary v)

Overrides:

writeBytes in class ValuesWriter

getBufferedSize

public long getBufferedSize()

Description copied from class: ValuesWriter

used to decide if we want to work to the next page

Specified by:

getBufferedSize in class ValuesWriter

Returns:

the size of the currently buffered data (in bytes)

getBytes

public BytesInput getBytes()

Specified by:

getBytes in class ValuesWriter

Returns:

the bytes buffered so far to write to the current page

getEncoding

public Encoding getEncoding()

Description copied from class: ValuesWriter

called after getBytes() and before reset()

Specified by:

getEncoding in class ValuesWriter

Returns:

the encoding that was used to encode the bytes

reset

public void reset()

Description copied from class: ValuesWriter

called after getBytes() to reset the current buffer and start writing the next page

Specified by:

reset in class ValuesWriter

getAllocatedSize

public long getAllocatedSize()

Specified by:

getAllocatedSize in class ValuesWriter

Returns:

the allocated size of the buffer ( > {@link #getBufferedMemorySize()() )

memUsageString

public String memUsageString(String prefix)

Specified by:

memUsageString in class ValuesWriter