B E F G M N O P R S W
All Classes All Packages

B

BeamParquetInputFile(SeekableByteChannel) - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BeamParquetInputFile

BlockTracker(OffsetRange, long, long) - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BlockTracker

E

expand(PBegin) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

expand(PBegin) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

expand(PCollection<FileIO.ReadableFile>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

expand(PCollection<FileIO.ReadableFile>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

F

flush() - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

from(String) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

from(String) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Like ParquetIO.Read.from(ValueProvider).

from(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

from(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Reads from the given filename or filepattern.

G

getLength() - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BeamParquetInputFile

getProgress() - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BlockTracker

M

makeProgress() - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BlockTracker

N

newStream() - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles.BeamParquetInputFile

O

open(WritableByteChannel) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

org.apache.beam.sdk.io.parquet - package org.apache.beam.sdk.io.parquet

Transforms for reading and writing from Parquet.

P

ParquetIO - Class in org.apache.beam.sdk.io.parquet

IO to read and write Parquet files.

ParquetIO.Parse<T> - Class in org.apache.beam.sdk.io.parquet

Implementation of ParquetIO.parseGenericRecords(SerializableFunction).

ParquetIO.ParseFiles<T> - Class in org.apache.beam.sdk.io.parquet

Implementation of ParquetIO.parseFilesGenericRecords(SerializableFunction).

ParquetIO.Read - Class in org.apache.beam.sdk.io.parquet

Implementation of ParquetIO.read(Schema).

ParquetIO.ReadFiles - Class in org.apache.beam.sdk.io.parquet

Implementation of ParquetIO.readFiles(Schema).

ParquetIO.ReadFiles.BeamParquetInputFile - Class in org.apache.beam.sdk.io.parquet

ParquetIO.ReadFiles.BlockTracker - Class in org.apache.beam.sdk.io.parquet

ParquetIO.Sink - Class in org.apache.beam.sdk.io.parquet

Implementation of ParquetIO.sink(org.apache.avro.Schema).

Parse() - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

ParseFiles() - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

parseFilesGenericRecords(SerializableFunction<GenericRecord, T>) - Static method in class org.apache.beam.sdk.io.parquet.ParquetIO

Reads GenericRecord from Parquet files and converts to user defined type using provided parseFn.

parseGenericRecords(SerializableFunction<GenericRecord, T>) - Static method in class org.apache.beam.sdk.io.parquet.ParquetIO

Reads GenericRecord from a Parquet file (or multiple Parquet files matching the pattern) and converts to user defined type using provided parseFn.

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

R

read(Schema) - Static method in class org.apache.beam.sdk.io.parquet.ParquetIO

Reads GenericRecord from a Parquet file (or multiple Parquet files matching the pattern).

Read() - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.Read

readFiles(Schema) - Static method in class org.apache.beam.sdk.io.parquet.ParquetIO

Like ParquetIO.read(Schema), but reads each file in a PCollection of FileIO.ReadableFile, which allows more flexible usage.

ReadFiles() - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

S

sink(Schema) - Static method in class org.apache.beam.sdk.io.parquet.ParquetIO

Creates a ParquetIO.Sink that, for use with FileIO.write().

Sink() - Constructor for class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

W

withAvroDataModel(GenericData) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Define the Avro data model; see AvroParquetReader.Builder.withDataModel(GenericData).

withAvroDataModel(GenericData) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

Define the Avro data model; see AvroParquetReader.Builder.withDataModel(GenericData).

withAvroDataModel(GenericData) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Define the Avro data model; see AvroParquetWriter.Builder.withDataModel(GenericData).

withBeamSchemas(boolean) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

withBeamSchemas(boolean) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

withBloomFilterEnabled(boolean) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Enable or disable bloom filters.

withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

Specify the output coder to use for output of the ParseFn.

withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

Specify the output coder to use for output of the ParseFn.

withCompressionCodec(CompressionCodecName) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specifies compression codec.

withConfiguration(Map<String, String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

Specify Hadoop configuration for ParquetReader.

withConfiguration(Map<String, String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

Specify Hadoop configuration for ParquetReader.

withConfiguration(Map<String, String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Specify Hadoop configuration for ParquetReader.

withConfiguration(Map<String, String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

Specify Hadoop configuration for ParquetReader.

withConfiguration(Map<String, String>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify Hadoop configuration for ParquetWriter.

withConfiguration(Configuration) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Parse

Specify Hadoop configuration for ParquetReader.

withConfiguration(Configuration) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ParseFiles

Specify Hadoop configuration for ParquetReader.

withConfiguration(Configuration) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Specify Hadoop configuration for ParquetReader.

withConfiguration(Configuration) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

Specify Hadoop configuration for ParquetReader.

withConfiguration(Configuration) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify Hadoop configuration for ParquetWriter.

withDictionaryEncoding(boolean) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Enable or disable dictionary encoding.

withMaxRowCountForPageSizeCheck(int) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify the maximum number of rows to buffer before a page size check is forced.

withMaxRowCountForPageSizeCheck(ValueProvider<Integer>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Like withMaxRowCountForPageSizeCheck(int), but accepts a ValueProvider so the value can be supplied at runtime (required for classic Dataflow templates).

withMinRowCountForPageSizeCheck(int) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify the minimum number of rows to write before a page size check is performed.

withMinRowCountForPageSizeCheck(ValueProvider<Integer>) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Like withMinRowCountForPageSizeCheck(int), but accepts a ValueProvider so the value can be supplied at runtime (required for classic Dataflow templates).

withPageSize(int) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify the page size for the Parquet writer.

withProjection(Schema, Schema) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Read

Enable the reading with projection.

withProjection(Schema, Schema) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.ReadFiles

withRowGroupSize(int) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

Specify row-group size; if not set or zero, a default is used by the underlying writer.

write(GenericRecord) - Method in class org.apache.beam.sdk.io.parquet.ParquetIO.Sink

B E F G M N O P R S W
All Classes All Packages