Package io.confluent.parallelconsumer

Class JStreamParallelEoSStreamProcessor<K,V>

java.lang.Object

io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor<K,V>

io.confluent.parallelconsumer.ParallelEoSStreamProcessor<K,V>

io.confluent.parallelconsumer.JStreamParallelEoSStreamProcessor<K,V>

All Implemented Interfaces:

DrainingCloseable, JStreamParallelStreamProcessor<K,V>, ParallelConsumer<K,V>, ParallelStreamProcessor<K,V>, Closeable, AutoCloseable, org.apache.kafka.clients.consumer.ConsumerRebalanceListener

public class JStreamParallelEoSStreamProcessor<K,V>
extends ParallelEoSStreamProcessor<K,V>
implements JStreamParallelStreamProcessor<K,V>

Nested Class Summary

Nested classes/interfaces inherited from interface io.confluent.parallelconsumer.internal.DrainingCloseable

DrainingCloseable.DrainingMode

Nested classes/interfaces inherited from interface io.confluent.parallelconsumer.ParallelConsumer

ParallelConsumer.Tuple<L,R>

Nested classes/interfaces inherited from interface io.confluent.parallelconsumer.ParallelStreamProcessor

ParallelStreamProcessor.ConsumeProduceResult<K,V,KK,VV>

Field Summary

Fields inherited from class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor

dynamicExtraLoadFactor, MDC_INSTANCE_ID, MDC_OFFSET_MARKER, options, wm, workerThreadPool

Fields inherited from interface io.confluent.parallelconsumer.internal.DrainingCloseable

DEFAULT_TIMEOUT

Constructor Summary

Constructors

Constructor	Description
JStreamParallelEoSStreamProcessor(ParallelConsumerOptions<K,V> parallelConsumerOptions)

Method Summary

Modifier and Type	Method	Description
Stream<ParallelStreamProcessor.ConsumeProduceResult<K,V,K,V>>	pollProduceAndStream(Function<PollContext<K,V>,List<org.apache.kafka.clients.producer.ProducerRecord<K,V>>> userFunction)	Like AbstractParallelEoSStreamProcessor#pollAndProduceMany but instead of callbacks, streams the results instead, after the produce result is ack'd by Kafka.

Methods inherited from class io.confluent.parallelconsumer.ParallelEoSStreamProcessor

poll, pollAndProduce, pollAndProduce, pollAndProduceMany, pollAndProduceMany

Methods inherited from class io.confluent.parallelconsumer.internal.AbstractParallelEoSStreamProcessor

addLoopEndCallBack, addToMailbox, addToMailBoxOnUserFunctionSuccess, calculateQuantityToRequest, checkPipelinePressure, close, close, getFailureCause, getMyId, getNumberOfAssignedPartitions, getOptions, getProducerManager, getQueueTargetLoaded, getTargetOutForProcessing, getTimeBetweenCommits, getWm, getWorkMailBox, isClosedOrFailed, notifySomethingToDo, onPartitionsAssigned, onPartitionsLost, onPartitionsRevoked, onUserFunctionSuccess, pauseIfRunning, registerWork, requestCommitAsap, resumeIfPaused, runUserFunction, setLongPollTimeout, setMyId, setTimeBetweenCommits, setupWorkerPool, submitWorkToPool, subscribe, subscribe, subscribe, subscribe, supervisorLoop, waitForProcessedNotCommitted, workRemaining

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.confluent.parallelconsumer.internal.DrainingCloseable

close, close, closeDontDrainFirst, closeDontDrainFirst, closeDrainFirst, closeDrainFirst, workRemaining

Methods inherited from interface io.confluent.parallelconsumer.ParallelConsumer

pauseIfRunning, resumeIfPaused, subscribe, subscribe, subscribe, subscribe

Constructor Details

JStreamParallelEoSStreamProcessor

public JStreamParallelEoSStreamProcessor(ParallelConsumerOptions<K,V> parallelConsumerOptions)

Method Details

pollProduceAndStream

public Stream<ParallelStreamProcessor.ConsumeProduceResult<K,V,K,V>> pollProduceAndStream(Function<PollContext<K,V>,List<org.apache.kafka.clients.producer.ProducerRecord<K,V>>> userFunction)

Description copied from interface: JStreamParallelStreamProcessor

Like AbstractParallelEoSStreamProcessor#pollAndProduceMany but instead of callbacks, streams the results instead, after the produce result is ack'd by Kafka.

Specified by:

pollProduceAndStream in interface JStreamParallelStreamProcessor<K,V>

Returns:

a stream of results of applying the function to the polled records