| Package | Description |
|---|---|
| co.cask.cdap.data.file |
This package contains classes for interacting with data files.
|
| co.cask.cdap.data.stream |
This package contains classes for management and manipulation of stream files.
|
| co.cask.cdap.data2.transaction.stream |
This package contains transaction stream consumer classes for maintaining stateful consumption of stream entries.
|
| co.cask.cdap.data2.transaction.stream.hbase |
This package contains class for stream consumer implementation that uses HBase as state store.
|
| co.cask.cdap.data2.transaction.stream.leveldb |
This package contains class for stream consumer implementation that uses LevelDB as state store.
|
| Modifier and Type | Class and Description |
|---|---|
class |
LiveFileReader<T,P>
A
FileReader that provides continuous event stream that never end. |
| Modifier and Type | Method and Description |
|---|---|
protected abstract FileReader<T,P> |
LiveFileReader.renewReader() |
| Modifier and Type | Class and Description |
|---|---|
class |
LiveStreamFileReader
A
LiveFileReader that gives infinite stream event. |
class |
MultiLiveStreamFileReader
A
FileReader that combines multiple event stream into single event stream. |
class |
StreamDataFileReader
Class for reading data file written by
StreamDataFileWriter. |
| Modifier and Type | Method and Description |
|---|---|
protected FileReader<PositionStreamEvent,StreamFileOffset> |
LiveStreamFileReader.renewReader() |
| Modifier and Type | Method and Description |
|---|---|
protected abstract StreamConsumer |
AbstractStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter)
Creates a
StreamConsumer. |
| Constructor and Description |
|---|
AbstractStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore consumerStateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter) |
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
HBaseStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
HBaseStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
HBaseTableUtil tableUtil,
org.apache.hadoop.hbase.client.HTable hTable,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
AbstractRowKeyDistributor keyDistributor)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
LevelDBStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
LevelDBStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
LevelDBTableCore tableCore,
Object dbLock) |
Copyright © 2016 Cask Data, Inc. Licensed under the Apache License, Version 2.0.