co.cask.cdap.data2.increment.hbase98

Class IncrementHandler

java.lang.Object

org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

co.cask.cdap.data2.increment.hbase98.IncrementHandler

All Implemented Interfaces:

org.apache.hadoop.hbase.Coprocessor, org.apache.hadoop.hbase.coprocessor.RegionObserver

public class IncrementHandler
extends org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

HBase coprocessor that handles reading and writing read-less increment operations.

Writes of incremental values are performed as normal Puts, flagged with a special attribute HBaseTable.DELTA_WRITE. The coprocessor intercepts these writes and rewrites the cell value to use a special marker prefix.

For read (for Get and Scan) operations, all of the delta values are summed up for a column, up to and including the most recent "full" (non-delta) value. The sum of these delta values, plus the full value (if found) is returned for the column.

To mitigate the performance impact on reading, this coprocessor also overrides the scanner used in flush and compaction operations, using IncrementSummingScanner to generate a new "full" value aggregated from all the successfully committed delta values.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.coprocessor.RegionObserver

org.apache.hadoop.hbase.coprocessor.RegionObserver.MutationType

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.Coprocessor

org.apache.hadoop.hbase.Coprocessor.State

Field Summary

Fields inherited from interface org.apache.hadoop.hbase.Coprocessor

PRIORITY_HIGHEST, PRIORITY_LOWEST, PRIORITY_SYSTEM, PRIORITY_USER, VERSION

Constructor Summary

Constructors

Constructor and Description
IncrementHandler()

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	isIncrement(org.apache.hadoop.hbase.Cell cell)
org.apache.hadoop.hbase.regionserver.RegionScanner	postScannerOpen(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx, org.apache.hadoop.hbase.client.Scan scan, org.apache.hadoop.hbase.regionserver.RegionScanner scanner)
org.apache.hadoop.hbase.regionserver.InternalScanner	preCompact(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e, org.apache.hadoop.hbase.regionserver.Store store, org.apache.hadoop.hbase.regionserver.InternalScanner scanner, org.apache.hadoop.hbase.regionserver.ScanType scanType)
org.apache.hadoop.hbase.regionserver.InternalScanner	preCompact(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e, org.apache.hadoop.hbase.regionserver.Store store, org.apache.hadoop.hbase.regionserver.InternalScanner scanner, org.apache.hadoop.hbase.regionserver.ScanType scanType, org.apache.hadoop.hbase.regionserver.compactions.CompactionRequest request)
void	preDelete(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e, org.apache.hadoop.hbase.client.Delete delete, org.apache.hadoop.hbase.regionserver.wal.WALEdit edit, org.apache.hadoop.hbase.client.Durability durability)
org.apache.hadoop.hbase.regionserver.InternalScanner	preFlush(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e, org.apache.hadoop.hbase.regionserver.Store store, org.apache.hadoop.hbase.regionserver.InternalScanner scanner)
void	preGetOp(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx, org.apache.hadoop.hbase.client.Get get, List<org.apache.hadoop.hbase.Cell> results)
void	prePut(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx, org.apache.hadoop.hbase.client.Put put, org.apache.hadoop.hbase.regionserver.wal.WALEdit edit, org.apache.hadoop.hbase.client.Durability durability)
org.apache.hadoop.hbase.regionserver.RegionScanner	preScannerOpen(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e, org.apache.hadoop.hbase.client.Scan scan, org.apache.hadoop.hbase.regionserver.RegionScanner s)
void	setTimestampOracle(TimestampOracle timeOracle)
void	start(org.apache.hadoop.hbase.CoprocessorEnvironment e)

Methods inherited from class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

postAppend, postBatchMutate, postBatchMutateIndispensably, postBulkLoadHFile, postCheckAndDelete, postCheckAndPut, postClose, postCloseRegionOperation, postCompact, postCompact, postCompactSelection, postCompactSelection, postCompleteSplit, postDelete, postExists, postFlush, postFlush, postGet, postGetClosestRowBefore, postGetOp, postIncrement, postIncrementColumnValue, postInstantiateDeleteTracker, postLogReplay, postMutationBeforeWAL, postOpen, postPut, postRollBackSplit, postScannerClose, postScannerFilterRow, postScannerNext, postSplit, postStartRegionOperation, postStoreFileReaderOpen, postWALRestore, preAppend, preAppendAfterRowLock, preBatchMutate, preBulkLoadHFile, preCheckAndDelete, preCheckAndDeleteAfterRowLock, preCheckAndPut, preCheckAndPutAfterRowLock, preClose, preCompactScannerOpen, preCompactScannerOpen, preCompactSelection, preCompactSelection, preExists, preFlush, preFlushScannerOpen, preGet, preGetClosestRowBefore, preIncrement, preIncrementAfterRowLock, preIncrementColumnValue, preOpen, prePrepareTimeStampForDeleteVersion, preRollBackSplit, preScannerClose, preScannerNext, preSplit, preSplit, preSplitAfterPONR, preSplitBeforePONR, preStoreFileReaderOpen, preStoreScannerOpen, preWALRestore, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IncrementHandler

public IncrementHandler()

Method Detail

start

public void start(org.apache.hadoop.hbase.CoprocessorEnvironment e)
           throws IOException

Specified by:

start in interface org.apache.hadoop.hbase.Coprocessor

Overrides:

start in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

setTimestampOracle

public void setTimestampOracle(TimestampOracle timeOracle)

preGetOp

public void preGetOp(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx,
            org.apache.hadoop.hbase.client.Get get,
            List<org.apache.hadoop.hbase.Cell> results)
              throws IOException

Specified by:

preGetOp in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preGetOp in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

prePut

public void prePut(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx,
          org.apache.hadoop.hbase.client.Put put,
          org.apache.hadoop.hbase.regionserver.wal.WALEdit edit,
          org.apache.hadoop.hbase.client.Durability durability)
            throws IOException

Specified by:

prePut in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

prePut in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

preDelete

public void preDelete(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e,
             org.apache.hadoop.hbase.client.Delete delete,
             org.apache.hadoop.hbase.regionserver.wal.WALEdit edit,
             org.apache.hadoop.hbase.client.Durability durability)
               throws IOException

Specified by:

preDelete in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preDelete in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

preScannerOpen

public org.apache.hadoop.hbase.regionserver.RegionScanner preScannerOpen(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e,
                                                                org.apache.hadoop.hbase.client.Scan scan,
                                                                org.apache.hadoop.hbase.regionserver.RegionScanner s)
                                                                  throws IOException

Specified by:

preScannerOpen in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preScannerOpen in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

postScannerOpen

public org.apache.hadoop.hbase.regionserver.RegionScanner postScannerOpen(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> ctx,
                                                                 org.apache.hadoop.hbase.client.Scan scan,
                                                                 org.apache.hadoop.hbase.regionserver.RegionScanner scanner)
                                                                   throws IOException

Specified by:

postScannerOpen in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

postScannerOpen in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

preFlush

public org.apache.hadoop.hbase.regionserver.InternalScanner preFlush(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e,
                                                            org.apache.hadoop.hbase.regionserver.Store store,
                                                            org.apache.hadoop.hbase.regionserver.InternalScanner scanner)
                                                              throws IOException

Specified by:

preFlush in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preFlush in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

isIncrement

public static boolean isIncrement(org.apache.hadoop.hbase.Cell cell)

preCompact

public org.apache.hadoop.hbase.regionserver.InternalScanner preCompact(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e,
                                                              org.apache.hadoop.hbase.regionserver.Store store,
                                                              org.apache.hadoop.hbase.regionserver.InternalScanner scanner,
                                                              org.apache.hadoop.hbase.regionserver.ScanType scanType)
                                                                throws IOException

Specified by:

preCompact in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preCompact in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException

preCompact

public org.apache.hadoop.hbase.regionserver.InternalScanner preCompact(org.apache.hadoop.hbase.coprocessor.ObserverContext<org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment> e,
                                                              org.apache.hadoop.hbase.regionserver.Store store,
                                                              org.apache.hadoop.hbase.regionserver.InternalScanner scanner,
                                                              org.apache.hadoop.hbase.regionserver.ScanType scanType,
                                                              org.apache.hadoop.hbase.regionserver.compactions.CompactionRequest request)
                                                                throws IOException

Specified by:

preCompact in interface org.apache.hadoop.hbase.coprocessor.RegionObserver

Overrides:

preCompact in class org.apache.hadoop.hbase.coprocessor.BaseRegionObserver

Throws:

IOException