| Package | Description |
|---|---|
| co.cask.cdap.data2.queue |
API definition for queue for the txds2 system.
|
| co.cask.cdap.data2.transaction.queue |
Transaction aware queue implementation.
|
| co.cask.cdap.data2.transaction.queue.hbase |
This package contains an HBase implementation of queues.
|
| co.cask.cdap.data2.transaction.queue.inmemory |
This package contains in memory implementation of queues.
|
| co.cask.cdap.data2.transaction.queue.leveldb |
This package contains levelDB implementation of queues.
|
| co.cask.cdap.data2.transaction.stream |
This package contains transaction stream consumer classes for maintaining stateful consumption of stream entries.
|
| co.cask.cdap.data2.transaction.stream.hbase |
This package contains class for stream consumer implementation that uses HBase as state store.
|
| co.cask.cdap.data2.transaction.stream.inmemory | |
| co.cask.cdap.data2.transaction.stream.leveldb |
This package contains class for stream consumer implementation that uses LevelDB as state store.
|
| Modifier and Type | Method and Description |
|---|---|
ConsumerConfig |
QueueConsumer.getConfig()
Returns the configuration of this consumer.
|
ConsumerConfig |
ForwardingQueueConsumer.getConfig() |
| Modifier and Type | Method and Description |
|---|---|
QueueConsumer |
QueueClientFactory.createConsumer(QueueName queueName,
ConsumerConfig consumerConfig,
int numGroups) |
| Modifier and Type | Method and Description |
|---|---|
ConsumerConfig |
AbstractQueueConsumer.getConfig() |
| Modifier and Type | Method and Description |
|---|---|
static QueueEntryRow.CanConsume |
QueueEntryRow.canConsume(ConsumerConfig consumerConfig,
co.cask.tephra.Transaction transaction,
long enqueueWritePointer,
int counter,
byte[] metaValue,
byte[] stateValue)
Looks at specific queue entry and determines if consumer with given consumer config and current transaction
can consume this entry.
|
| Constructor and Description |
|---|
AbstractQueueConsumer(CConfiguration cConf,
ConsumerConfig consumerConfig,
QueueName queueName) |
AbstractQueueConsumer(CConfiguration cConf,
ConsumerConfig consumerConfig,
QueueName queueName,
byte[] startRow) |
| Modifier and Type | Method and Description |
|---|---|
ConsumerConfig |
HBaseConsumerState.getConsumerConfig() |
static ConsumerConfig |
DequeueScanAttributes.getConsumerConfig(org.apache.hadoop.hbase.client.Scan scan) |
static ConsumerConfig |
DequeueScanAttributes.readConsumerConfig(DataInput dataInput) |
| Modifier and Type | Method and Description |
|---|---|
static Map<String,byte[]> |
DequeueScanAttributes.addAttribute(ConsumerConfig consumerConfig,
Map<String,byte[]> attributes) |
QueueConsumer |
HBaseQueueClientFactory.createConsumer(QueueName queueName,
ConsumerConfig consumerConfig,
int numGroups) |
QueueScanner |
SaltedHBaseQueueStrategy.createScanner(ConsumerConfig consumerConfig,
org.apache.hadoop.hbase.client.HTable hTable,
org.apache.hadoop.hbase.client.Scan scan,
int numRows) |
QueueScanner |
ShardedHBaseQueueStrategy.createScanner(ConsumerConfig consumerConfig,
org.apache.hadoop.hbase.client.HTable hTable,
org.apache.hadoop.hbase.client.Scan scan,
int numRows) |
QueueScanner |
HBaseQueueStrategy.createScanner(ConsumerConfig consumerConfig,
org.apache.hadoop.hbase.client.HTable hTable,
org.apache.hadoop.hbase.client.Scan scan,
int numRows)
Creates a
QueueScanner from the given Scan on the HBase table. |
byte[] |
SaltedHBaseQueueStrategy.getActualRowKey(ConsumerConfig consumerConfig,
byte[] originalRowKey) |
byte[] |
ShardedHBaseQueueStrategy.getActualRowKey(ConsumerConfig consumerConfig,
byte[] originalRowKey) |
byte[] |
HBaseQueueStrategy.getActualRowKey(ConsumerConfig consumerConfig,
byte[] originalRowKey)
Creates the actual row key used for accessing the HBase table from the given queue entry row key.
|
static void |
DequeueScanAttributes.write(DataOutput dataOutput,
ConsumerConfig consumerConfig) |
| Modifier and Type | Method and Description |
|---|---|
ConsumerConfig |
InMemoryQueueConsumer.getConfig() |
| Modifier and Type | Method and Description |
|---|---|
void |
InMemoryQueue.ack(List<InMemoryQueue.Key> dequeuedKeys,
ConsumerConfig config) |
QueueConsumer |
InMemoryQueueClientFactory.createConsumer(QueueName queueName,
ConsumerConfig consumerConfig,
int numGroups) |
ImmutablePair<List<InMemoryQueue.Key>,List<byte[]>> |
InMemoryQueue.dequeue(co.cask.tephra.Transaction tx,
ConsumerConfig config,
InMemoryQueue.ConsumerState consumerState,
int maxBatchSize) |
void |
InMemoryQueue.undoDequeue(List<InMemoryQueue.Key> dequeuedKeys,
ConsumerConfig config) |
| Constructor and Description |
|---|
InMemoryQueueConsumer(QueueName queueName,
ConsumerConfig config,
int numGroups,
InMemoryQueueService queueService) |
| Modifier and Type | Method and Description |
|---|---|
QueueConsumer |
LevelDBQueueClientFactory.createConsumer(QueueName queueName,
ConsumerConfig consumerConfig,
int numGroups) |
QueueConsumer |
LevelDBAndInMemoryQueueClientFactory.createConsumer(QueueName queueName,
ConsumerConfig consumerConfig,
int numGroups) |
| Modifier and Type | Method and Description |
|---|---|
ConsumerConfig |
StreamConsumer.getConsumerConfig() |
ConsumerConfig |
ForwardingStreamConsumer.getConsumerConfig() |
ConsumerConfig |
QueueToStreamConsumer.getConsumerConfig() |
ConsumerConfig |
AbstractStreamFileConsumer.getConsumerConfig() |
| Modifier and Type | Method and Description |
|---|---|
StreamConsumer |
StreamConsumerFactory.create(Id.Stream streamId,
String namespace,
ConsumerConfig consumerConfig)
Creates a
StreamConsumer. |
StreamConsumer |
AbstractStreamFileConsumerFactory.create(Id.Stream streamId,
String namespace,
ConsumerConfig consumerConfig) |
protected abstract StreamConsumer |
AbstractStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter)
Creates a
StreamConsumer. |
| Constructor and Description |
|---|
AbstractStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore consumerStateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter) |
QueueToStreamConsumer(Id.Stream streamId,
ConsumerConfig consumerConfig,
QueueConsumer consumer) |
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
HBaseStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
HBaseStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
HBaseTableUtil tableUtil,
org.apache.hadoop.hbase.client.HTable hTable,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
AbstractRowKeyDistributor keyDistributor)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
StreamConsumer |
InMemoryStreamConsumerFactory.create(Id.Stream streamId,
String namespace,
ConsumerConfig consumerConfig) |
| Modifier and Type | Method and Description |
|---|---|
protected StreamConsumer |
LevelDBStreamFileConsumerFactory.create(TableId tableId,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
ReadFilter extraFilter) |
| Constructor and Description |
|---|
LevelDBStreamFileConsumer(CConfiguration cConf,
StreamConfig streamConfig,
ConsumerConfig consumerConfig,
FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
StreamConsumerStateStore stateStore,
StreamConsumerState beginConsumerState,
ReadFilter extraFilter,
LevelDBTableCore tableCore,
Object dbLock) |
Copyright © 2016 Cask Data, Inc. Licensed under the Apache License, Version 2.0.