co.cask.cdap.data2.transaction.stream

Class AbstractStreamFileConsumerFactory

java.lang.Object

co.cask.cdap.data2.transaction.stream.AbstractStreamFileConsumerFactory

All Implemented Interfaces:

StreamConsumerFactory

Direct Known Subclasses:

HBaseStreamFileConsumerFactory, LevelDBStreamFileConsumerFactory

public abstract class AbstractStreamFileConsumerFactory
extends Object
implements StreamConsumerFactory

Abstract base class for implementing StreamConsumerFactory using MultiLiveStreamFileReader.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractStreamFileConsumerFactory(CConfiguration cConf, StreamAdmin streamAdmin, StreamConsumerStateStoreFactory stateStoreFactory)

Method Summary

Methods

Modifier and Type	Method and Description
StreamConsumer	create(Id.Stream streamId, String namespace, ConsumerConfig consumerConfig) Creates a StreamConsumer.
protected abstract StreamConsumer	create(TableId tableId, StreamConfig streamConfig, ConsumerConfig consumerConfig, StreamConsumerStateStore stateStore, StreamConsumerState beginConsumerState, FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader, ReadFilter extraFilter) Creates a StreamConsumer.
void	dropAll(Id.Stream streamId, String namespace, Iterable<Long> groupIds) Deletes all consumer states for the given namespace and group ids.
protected abstract void	dropTable(TableId tableId) Deletes process states table.
protected void	getFileOffsets(Location partitionLocation, Collection<? super StreamFileOffset> fileOffsets, int generation)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractStreamFileConsumerFactory

protected AbstractStreamFileConsumerFactory(CConfiguration cConf,
                                 StreamAdmin streamAdmin,
                                 StreamConsumerStateStoreFactory stateStoreFactory)

Method Detail

create

protected abstract StreamConsumer create(TableId tableId,
                    StreamConfig streamConfig,
                    ConsumerConfig consumerConfig,
                    StreamConsumerStateStore stateStore,
                    StreamConsumerState beginConsumerState,
                    FileReader<StreamEventOffset,Iterable<StreamFileOffset>> reader,
                    @Nullable
                    ReadFilter extraFilter)
                                  throws IOException

Creates a StreamConsumer.

Parameters:

tableId - Id of the table for storing process states

streamConfig - configuration of the stream to consume from

consumerConfig - configuration of the consumer

stateStore - The StreamConsumerStateStore for recording consumer state

reader - The FileReader to read stream events from

Returns:

A new instance of StreamConsumer

Throws:

IOException

dropTable

protected abstract void dropTable(TableId tableId)
                           throws IOException

Deletes process states table.

Parameters:

tableId - Id of the process states table.

Throws:

IOException

getFileOffsets

protected void getFileOffsets(Location partitionLocation,
                  Collection<? super StreamFileOffset> fileOffsets,
                  int generation)
                       throws IOException

Throws:

IOException

create

public final StreamConsumer create(Id.Stream streamId,
                    String namespace,
                    ConsumerConfig consumerConfig)
                            throws IOException

Description copied from interface: StreamConsumerFactory

Creates a StreamConsumer.

Specified by:

create in interface StreamConsumerFactory

Parameters:

streamId - Id of the stream

namespace - application namespace for the state table.

consumerConfig - consumer configuration.

Returns:

a new instance of StreamConsumer.

Throws:

IOException

dropAll

public void dropAll(Id.Stream streamId,
           String namespace,
           Iterable<Long> groupIds)
             throws IOException

Description copied from interface: StreamConsumerFactory

Deletes all consumer states for the given namespace and group ids.

Specified by:

dropAll in interface StreamConsumerFactory

Parameters:

streamId - Id of the stream

namespace - application namespace for the state table.

groupIds - set of group id that needs to have states cleared.

Throws:

IOException