Package io.confluent.parallelconsumer.internal

Class ProducerManager<K,V>

java.lang.Object

io.confluent.parallelconsumer.internal.AbstractOffsetCommitter<K,V>

io.confluent.parallelconsumer.internal.ProducerManager<K,V>

All Implemented Interfaces:

OffsetCommitter

public class ProducerManager<K,V>
extends AbstractOffsetCommitter<K,V>
implements OffsetCommitter

Field Summary

Fields

Modifier and Type	Field	Description
protected final org.apache.kafka.clients.producer.Producer<K,V>	producer

Fields inherited from class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter

consumerMgr, wm

Constructor Summary

Constructors

Constructor	Description
ProducerManager(org.apache.kafka.clients.producer.Producer<K,V> newProducer, ConsumerManager<K,V> newConsumer, WorkManager<K,V> wm, ParallelConsumerOptions options)

Method Summary

Modifier and Type	Method	Description
void	close(Duration timeout)	Assumes the system is drained at this point, or draining is not desired.
protected void	commitOffsets(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsetsToSend, org.apache.kafka.clients.consumer.ConsumerGroupMetadata groupMetadata)
boolean	isTransactionInProgress()
protected void	postCommit()
protected void	preAcquireWork()
List<ParallelConsumer.Tuple<org.apache.kafka.clients.producer.ProducerRecord<K,V>,Future<org.apache.kafka.clients.producer.RecordMetadata>>>	produceMessages(List<org.apache.kafka.clients.producer.ProducerRecord<K,V>> outMsgs)	Produce a message back to the broker.

Methods inherited from class io.confluent.parallelconsumer.internal.AbstractOffsetCommitter

retrieveOffsetsAndCommit

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.confluent.parallelconsumer.internal.OffsetCommitter

retrieveOffsetsAndCommit

Field Details

producer

protected final org.apache.kafka.clients.producer.Producer<K,V> producer

Constructor Details

ProducerManager

public ProducerManager(org.apache.kafka.clients.producer.Producer<K,V> newProducer,
 ConsumerManager<K,V> newConsumer,
 WorkManager<K,V> wm,
 ParallelConsumerOptions options)

Method Details

produceMessages

public List<ParallelConsumer.Tuple<org.apache.kafka.clients.producer.ProducerRecord<K,V>,Future<org.apache.kafka.clients.producer.RecordMetadata>>> produceMessages(List<org.apache.kafka.clients.producer.ProducerRecord<K,V>> outMsgs)

Produce a message back to the broker.

Implementation uses the blocking API, performance upgrade in later versions, is not an issue for the more common use case where messages aren't produced.

See Also:

• ParallelConsumer#poll
• ParallelStreamProcessor.pollAndProduceMany(java.util.function.Function<io.confluent.parallelconsumer.PollContext<K, V>, java.util.List<org.apache.kafka.clients.producer.ProducerRecord<K, V>>>, java.util.function.Consumer<io.confluent.parallelconsumer.ParallelStreamProcessor.ConsumeProduceResult<K, V, K, V>>)

preAcquireWork

protected void preAcquireWork()

Overrides:

preAcquireWork in class AbstractOffsetCommitter<K,V>

postCommit

protected void postCommit()

Overrides:

postCommit in class AbstractOffsetCommitter<K,V>

commitOffsets

protected void commitOffsets(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsetsToSend,
 org.apache.kafka.clients.consumer.ConsumerGroupMetadata groupMetadata)

Specified by:

commitOffsets in class AbstractOffsetCommitter<K,V>

close

public void close(Duration timeout)

Assumes the system is drained at this point, or draining is not desired.

isTransactionInProgress

public boolean isTransactionInProgress()