parquet.column.values.dictionary

Class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

java.lang.Object

parquet.column.values.ValuesWriter

parquet.column.values.dictionary.DictionaryValuesWriter

parquet.column.values.dictionary.DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

Direct Known Subclasses:

DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter

Enclosing class:

DictionaryValuesWriter

public static class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter
extends DictionaryValuesWriter

Nested Class Summary

Nested classes/interfaces inherited from class parquet.column.values.dictionary.DictionaryValuesWriter

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter, DictionaryValuesWriter.PlainDoubleDictionaryValuesWriter, DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter, DictionaryValuesWriter.PlainFloatDictionaryValuesWriter, DictionaryValuesWriter.PlainIntegerDictionaryValuesWriter, DictionaryValuesWriter.PlainLongDictionaryValuesWriter

Field Summary

Fields

Modifier and Type	Field and Description
protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary>	binaryDictionaryContent

Fields inherited from class parquet.column.values.dictionary.DictionaryValuesWriter

dictionaryByteSize, dictionaryTooBig, encodedValues, firstPage, lastUsedDictionaryByteSize, lastUsedDictionarySize, maxDictionaryByteSize, plainValuesWriter, rawDataByteSize

Constructor Summary

Constructors

Modifier	Constructor and Description
	DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize, int initialSize)
protected	DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize, int initialSize, int length) Constructor only used by subclasses for fixed-length byte arrays.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	clearDictionaryContent() clear/free the underlying dictionary content
protected static Binary	copy(Binary binary)
DictionaryPage	createDictionaryPage()
protected void	fallBackDictionaryEncodedData()
int	getDictionarySize()
void	writeBytes(Binary v)

Methods inherited from class parquet.column.values.dictionary.DictionaryValuesWriter

checkAndFallbackIfNeeded, getAllocatedSize, getBufferedSize, getBytes, getEncoding, memUsageString, reset, resetDictionary

Methods inherited from class parquet.column.values.ValuesWriter

writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

binaryDictionaryContent

protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary> binaryDictionaryContent

Constructor Detail

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

public DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize,
                                                        int initialSize)

Parameters:

maxDictionaryByteSize -

initialSize -

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

protected DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize,
                                                        int initialSize,
                                                        int length)

Constructor only used by subclasses for fixed-length byte arrays.

Method Detail

writeBytes

public void writeBytes(Binary v)

Overrides:

writeBytes in class ValuesWriter

createDictionaryPage

public DictionaryPage createDictionaryPage()

Overrides:

createDictionaryPage in class ValuesWriter

Returns:

the dictionary page or null if not dictionary based

getDictionarySize

public int getDictionarySize()

Specified by:

getDictionarySize in class DictionaryValuesWriter

Returns:

size in items

clearDictionaryContent

protected void clearDictionaryContent()

Description copied from class: DictionaryValuesWriter

clear/free the underlying dictionary content

Specified by:

clearDictionaryContent in class DictionaryValuesWriter

fallBackDictionaryEncodedData

protected void fallBackDictionaryEncodedData()

Specified by:

fallBackDictionaryEncodedData in class DictionaryValuesWriter

copy

protected static Binary copy(Binary binary)