Package co.cask.cdap.etl.spark.function

Interface Summary

Interface	Description
FlatMapFunc<T,R>	A function that returns zero or more output records from each input record.
PairFlatMapFunc<T,K,V>	A function that returns zero or more key-value pair records from each input record.

Class Summary

Class	Description
AggregatorAggregateFunction<GROUP_KEY,GROUP_VAL,OUT>	Function that uses a BatchAggregator to perform the aggregate part of the aggregator.
AggregatorGroupByFunction<GROUP_KEY,GROUP_VAL>	Function that uses a BatchAggregator to perform the groupBy part of the aggregator.
AlertPassFilter	Filters a SparkCollection containing both output and errors to one that just contains alerts.
BatchSinkFunction<IN,OUT_KEY,OUT_VAL>	Function that uses a BatchSink to transform one object into a pair.
BatchSourceFunction	Function that uses a BatchSource to transform a pair of objects into a single object.
CountingFunction<T>	Function that doesn't transform anything, but just emits counts for the number of records from that stage.
ErrorPassFilter<T>	Filters a SparkCollection containing both output and errors to one that just contains errors.
ErrorTransformFunction<T,U>	Function that uses an ErrorTransform to perform a flatmap.
InitialJoinFunction<T>	Transforms an Object into a singleton list containing the JoinElement of that object.
JoinFlattenFunction<T>	Flattens the Tuple2 of list and object returned by a join into a single list.
JoinMergeFunction<JOIN_KEY,INPUT_RECORD,OUT>	Function that merges a join result using a BatchJoiner.
JoinOnFunction<JOIN_KEY,INPUT_RECORD>	Function that uses a BatchJoiner to perform the joinOn part of the join.
LeftJoinFlattenFunction<T>	Flattens the Tuple2 of list and optional object returned by a left outer join into a single list.
MultiOutputTransformFunction<T>	Function that uses a MultiOutputTransform to perform a flatmap.
OuterJoinFlattenFunction<T>	Flattens the Tuple2 of optional list and optional object returned by a full outer join into a single list.
OutputPassFilter<T>	Filters a SparkCollection containing both output and errors to one that just contains output from a specific port.
PluginFunctionContext	Serializable collection of objects that can be used in Spark closures to instantiate plugins.
TransformFunction<T>	Function that uses a Transform to perform a flatmap.