co.cask.cdap.etl.spark.function

Class AggregatorAggregateFunction<GROUP_KEY,GROUP_VAL,OUT>

java.lang.Object

co.cask.cdap.etl.spark.function.AggregatorAggregateFunction<GROUP_KEY,GROUP_VAL,OUT>

Type Parameters:

GROUP_KEY - type of group key

GROUP_VAL - type of group value

OUT - type of aggregate output

All Implemented Interfaces:

FlatMapFunc<scala.Tuple2<GROUP_KEY,Iterable<GROUP_VAL>>,RecordInfo<Object>>, Serializable

public class AggregatorAggregateFunction<GROUP_KEY,GROUP_VAL,OUT>
extends Object
implements FlatMapFunc<scala.Tuple2<GROUP_KEY,Iterable<GROUP_VAL>>,RecordInfo<Object>>

Function that uses a BatchAggregator to perform the aggregate part of the aggregator. Non-serializable fields are lazily created since this is used in a Spark closure.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
AggregatorAggregateFunction(PluginFunctionContext pluginFunctionContext)

Method Summary

Modifier and Type	Method and Description
Iterable<RecordInfo<Object>>	call(scala.Tuple2<GROUP_KEY,Iterable<GROUP_VAL>> input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AggregatorAggregateFunction

public AggregatorAggregateFunction(PluginFunctionContext pluginFunctionContext)

Method Detail

call

public Iterable<RecordInfo<Object>> call(scala.Tuple2<GROUP_KEY,Iterable<GROUP_VAL>> input)
                                  throws Exception

Specified by:

call in interface FlatMapFunc<scala.Tuple2<GROUP_KEY,Iterable<GROUP_VAL>>,RecordInfo<Object>>

Throws:

Exception