| Package | Description |
|---|---|
| co.cask.cdap.data.stream |
This package contains classes for management and manipulation of stream files.
|
| co.cask.cdap.data2.transaction.stream |
This package contains transaction stream consumer classes for maintaining stateful consumption of stream entries.
|
| co.cask.cdap.data2.transaction.stream.hbase |
This package contains class for stream consumer implementation that uses HBase as state store.
|
| co.cask.cdap.data2.transaction.stream.leveldb |
This package contains class for stream consumer implementation that uses LevelDB as state store.
|
| Modifier and Type | Method and Description |
|---|---|
static StreamFileOffset |
StreamUtils.decodeOffset(StreamConfig config,
DataInput in)
Decode a
StreamFileOffset encoded by the StreamUtils.encodeOffset(DataOutput, StreamFileOffset)
method. |
StreamFileOffset |
StreamEventOffset.getOffset() |
| Modifier and Type | Method and Description |
|---|---|
Iterable<StreamFileOffset> |
MultiLiveStreamFileReader.getPosition() |
protected FileReader<PositionStreamEvent,StreamFileOffset> |
LiveStreamFileReader.renewReader() |
| Modifier and Type | Method and Description |
|---|---|
static void |
StreamUtils.encodeOffset(DataOutput out,
StreamFileOffset offset)
Encode a
StreamFileOffset instance. |
| Constructor and Description |
|---|
LiveStreamFileReader(StreamConfig streamConfig,
StreamFileOffset beginOffset)
Construct a reader with
Constants.Stream.NEW_FILE_CHECK_INTERVAL
as the max interval to check for new file. |
LiveStreamFileReader(StreamConfig streamConfig,
StreamFileOffset beginOffset,
long maxFileCheckInterval)
Creates a new file reader.
|
StreamEventOffset(co.cask.cdap.api.flow.flowlet.StreamEvent event,
StreamFileOffset offset) |
StreamFileOffset(StreamFileOffset other)
Clones from another
StreamFileOffset. |
StreamFileOffset(StreamFileOffset other,
long offset)
Clones from another
StreamFileOffset but with a different offset value. |
| Constructor and Description |
|---|
MultiLiveStreamFileReader(StreamConfig streamConfig,
Iterable<? extends StreamFileOffset> offsets) |
| Modifier and Type | Method and Description |
|---|---|
Iterable<StreamFileOffset> |
StreamConsumerState.getState() |
| Modifier and Type | Method and Description |
|---|---|
protected abstract StreamConsumer |
AbstractStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter)
Creates a
StreamConsumer. |
protected void |
AbstractStreamFileConsumerFactory.getFileOffsets(Location partitionLocation,
Collection<? super StreamFileOffset> fileOffsets,
int generation) |
void |
StreamConsumerState.setState(Iterable<StreamFileOffset> state) |
| Constructor and Description |
|---|
AbstractStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore consumerStateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter) |
StreamConsumerState(long groupId,
int instanceId,
Iterable<StreamFileOffset> state) |
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
HBaseStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
HBaseStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
HBaseTableUtil tableUtil,
org.apache.hadoop.hbase.client.HTable hTable,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
AbstractRowKeyDistributor keyDistributor)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
LevelDBStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
LevelDBStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
LevelDBTableCore tableCore,
Object dbLock) |
Copyright © 2016 Cask Data, Inc. Licensed under the Apache License, Version 2.0.