| Package | Description |
|---|---|
| co.cask.cdap.data.file |
This package contains classes for interacting with data files.
|
| co.cask.cdap.data.file.filter | |
| co.cask.cdap.data.stream |
This package contains classes for management and manipulation of stream files.
|
| co.cask.cdap.data2.transaction.stream |
This package contains transaction stream consumer classes for maintaining stateful consumption of stream entries.
|
| co.cask.cdap.data2.transaction.stream.hbase |
This package contains class for stream consumer implementation that uses HBase as state store.
|
| co.cask.cdap.data2.transaction.stream.leveldb |
This package contains class for stream consumer implementation that uses LevelDB as state store.
|
| Modifier and Type | Field and Description |
|---|---|
static ReadFilter |
ReadFilter.ALWAYS_ACCEPT
Always accept what it sees.
|
static ReadFilter |
ReadFilter.ALWAYS_REJECT_OFFSET
Always reject offset.
|
| Modifier and Type | Method and Description |
|---|---|
static ReadFilter |
ReadFilters.and(ReadFilter... filters) |
| Modifier and Type | Method and Description |
|---|---|
static ReadFilter |
ReadFilters.and(ReadFilter... filters) |
int |
FileReader.read(Collection<? super T> events,
int maxEvents,
long timeout,
TimeUnit unit,
ReadFilter readFilter)
Reads as much data as possible that passes the given filter until maxEvents.
|
int |
LiveFileReader.read(Collection<? super T> events,
int maxEvents,
long timeout,
TimeUnit unit,
ReadFilter readFilter) |
| Modifier and Type | Class and Description |
|---|---|
class |
AndReadFilter
AND multiple @{link ReadFilter}s.
|
class |
TTLReadFilter
ReadFilter for filtering expired stream events according to TTL and current time. |
| Constructor and Description |
|---|
AndReadFilter(ReadFilter... filters) |
| Modifier and Type | Class and Description |
|---|---|
class |
TimeRangeReadFilter
A
ReadFilter for accepting events that are within a given time range. |
| Modifier and Type | Method and Description |
|---|---|
int |
StreamDataFileReader.read(Collection<? super PositionStreamEvent> events,
int maxEvents,
long timeout,
TimeUnit unit,
ReadFilter readFilter) |
int |
MultiLiveStreamFileReader.read(Collection<? super StreamEventOffset> events,
int maxEvents,
long timeout,
TimeUnit unit,
ReadFilter readFilter) |
| Modifier and Type | Method and Description |
|---|---|
protected abstract StreamConsumer |
AbstractStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter)
Creates a
StreamConsumer. |
| Constructor and Description |
|---|
AbstractStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore consumerStateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter) |
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
HBaseStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
HBaseStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
HBaseTableUtil tableUtil,
org.apache.hadoop.hbase.client.HTable hTable,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
AbstractRowKeyDistributor keyDistributor)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
LevelDBStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
LevelDBStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
LevelDBTableCore tableCore,
Object dbLock) |
Copyright © 2016 Cask Data, Inc. Licensed under the Apache License, Version 2.0.