Package co.cask.cdap.data.stream

This package contains classes for management and manipulation of stream files.

See: Description

Interface Summary

Interface	Description
StreamCoordinatorClient	This class responsible for process coordination needed between stream writers and consumers.
StreamFileWriterFactory
StreamInputSplitFactory<T>	Factory for creating stream input splits.
StreamLeaderListener	Defines a behavior that is triggered when a Stream handler becomes leader of a Stream, or a collection of streams.
TimestampCloseable	A Closeable that also provides timestamp when the actual close operation happened.

Class Summary

Class	Description
AbstractStreamCoordinatorClient	Base implementation for StreamCoordinatorClient.
CoordinatorStreamProperties	This class carries stream properties used for coordination purpose.
DistributedStreamCoordinatorClient	A StreamCoordinatorClient uses ZooKeeper to implementation coordination needed for stream.
InMemoryStreamCoordinatorClient	In memory implementation for StreamCoordinatorClient.
LiveStreamFileReader	A LiveFileReader that gives infinite stream event.
MultiLiveStreamFileReader	A FileReader that combines multiple event stream into single event stream.
PositionStreamEvent	A StreamEvent which also carries the file position where this event starts.
StreamAdminModules	Guice modules to have access to a StreamAdmin implementation.
StreamDataFileConstants	Class to hold constants used in Stream data file.
StreamDataFileConstants.Property	Sets of constants related to accessing Stream data file properties.
StreamDataFileConstants.Property.Key	Constants for property keys
StreamDataFileConstants.Property.Value	Constants for property values
StreamDataFileReader	Class for reading data file written by StreamDataFileWriter.
StreamDataFileWriter	File format Stream event file:
StreamEventOffset	This class is a StreamEvent that also carries the corresponding StreamFileOffset that mark the beginning offset of this stream event.
StreamFileJanitor	Performs deletion of unused stream files.
StreamFileOffset	Represents offset information for single stream file.
StreamInputFormat<K,V>	Stream mapreduce input format.
StreamInputFormatProvider	A InputFormatProvider to provide InputFormat to read from stream.
StreamInputSplit	Represents a mapreduce InputSplit for stream.
StreamInputSplitFinder<T>	Finds input splits for a stream given several stream configuration settings and the location of the stream.
StreamInputSplitFinder.Builder	Builder for creating a split finder.
StreamPropertyListener	Listener for changes in stream properties.
StreamServiceManager	CDAP Stream Service management in distributed mode.
StreamTailer	Command line tool for tailing stream.
StreamUtils	Collection of helper methods.
StreamViewHttpHandler	Handler that implements view APIs.
TimePartitionedStreamFileWriter	Stream file path format: Each file has path pattern
TimePartitionedStreamFileWriter.TimePartition	Uses timestamp to represent partition information.
TimeRangeReadFilter	A ReadFilter for accepting events that are within a given time range.

Enum Summary

Enum	Description
StreamFileType	An enum to distinguish different file types in stream data file.

Package co.cask.cdap.data.stream Description

This package contains classes for management and manipulation of stream files. Configurations:

 stream.base.dir - The directory root for all stream files, relative to the HDFS namespace.
   stream.default.partition.duration - The default duration of a stream partition in milliseconds.
   stream.default.index.interval - Default time interval in milliseconds for emitting new index entry in stream file.