co.cask.cdap.data2.transaction.stream.hbase

Class HBaseStreamFileConsumer

java.lang.Object

co.cask.cdap.data2.transaction.stream.AbstractStreamFileConsumer

co.cask.cdap.data2.transaction.stream.hbase.HBaseStreamFileConsumer

All Implemented Interfaces:

StreamConsumer, co.cask.tephra.TransactionAware, Closeable, AutoCloseable

@NotThreadSafe
public final class HBaseStreamFileConsumer
extends AbstractStreamFileConsumer

A StreamConsumer that uses HTable to store consuming states.

Nested Class Summary

Nested classes/interfaces inherited from class co.cask.cdap.data2.transaction.stream.AbstractStreamFileConsumer

AbstractStreamFileConsumer.StateScanner

Field Summary

Fields inherited from class co.cask.cdap.data2.transaction.stream.AbstractStreamFileConsumer

MAX_SCAN_ROWS, stateColumnName

Constructor Summary

Constructors

Constructor and Description
HBaseStreamFileConsumer(CConfiguration cConf, StreamConfig streamConfig, ConsumerConfig consumerConfig, HBaseTableUtil tableUtil, org.apache.hadoop.hbase.client.HTable hTable, FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader, StreamConsumerStateStore stateStore, StreamConsumerState beginConsumerState, ReadFilter extraFilter, AbstractRowKeyDistributor keyDistributor) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	claimFifoEntry(byte[] row, byte[] value, byte[] oldValue)
protected void	doClose()
protected AbstractStreamFileConsumer.StateScanner	scanStates(byte[] startRow, byte[] stopRow)
protected void	undoState(Iterable<byte[]> rows, int size)
protected void	updateState(Iterable<byte[]> rows, int size, byte[] value)

Methods inherited from class co.cask.cdap.data2.transaction.stream.AbstractStreamFileConsumer

close, commitTx, getConsumerConfig, getStreamId, getTransactionAwareName, getTxChanges, poll, postTxCommit, rollbackTx, startTx, toString, updateTx

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

HBaseStreamFileConsumer

public HBaseStreamFileConsumer(CConfiguration cConf,
                       StreamConfig streamConfig,
                       ConsumerConfig consumerConfig,
                       HBaseTableUtil tableUtil,
                       org.apache.hadoop.hbase.client.HTable hTable,
                       FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
                       StreamConsumerStateStore stateStore,
                       StreamConsumerState beginConsumerState,
                       @Nullable
                       ReadFilter extraFilter,
                       AbstractRowKeyDistributor keyDistributor)

Constructor.

Method Detail

doClose

protected void doClose()
                throws IOException

Overrides:

doClose in class AbstractStreamFileConsumer

Throws:

IOException

claimFifoEntry

protected boolean claimFifoEntry(byte[] row,
                     byte[] value,
                     byte[] oldValue)
                          throws IOException

Specified by:

claimFifoEntry in class AbstractStreamFileConsumer

Throws:

IOException

updateState

protected void updateState(Iterable<byte[]> rows,
               int size,
               byte[] value)
                    throws IOException

Specified by:

updateState in class AbstractStreamFileConsumer

Throws:

IOException

undoState

protected void undoState(Iterable<byte[]> rows,
             int size)
                  throws IOException

Specified by:

undoState in class AbstractStreamFileConsumer

Throws:

IOException

scanStates

protected AbstractStreamFileConsumer.StateScanner scanStates(byte[] startRow,
                                                 byte[] stopRow)
                                                      throws IOException

Specified by:

scanStates in class AbstractStreamFileConsumer

Throws:

IOException