co.cask.cdap.etl.spark.function

Class JoinMergeFunction<JOIN_KEY,INPUT_RECORD,OUT>

java.lang.Object

co.cask.cdap.etl.spark.function.JoinMergeFunction<JOIN_KEY,INPUT_RECORD,OUT>

Type Parameters:

JOIN_KEY - the type of join key

INPUT_RECORD - the type of input record

OUT - the type of output object

All Implemented Interfaces:

FlatMapFunc<scala.Tuple2<JOIN_KEY,List<JoinElement<INPUT_RECORD>>>,OUT>, Serializable

public class JoinMergeFunction<JOIN_KEY,INPUT_RECORD,OUT>
extends Object
implements FlatMapFunc<scala.Tuple2<JOIN_KEY,List<JoinElement<INPUT_RECORD>>>,OUT>

Function that merges a join result using a BatchJoiner. Non-serializable fields are lazily created since this is used in a Spark closure.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
JoinMergeFunction(PluginFunctionContext pluginFunctionContext)

Method Summary

Modifier and Type	Method and Description
Iterable<OUT>	call(scala.Tuple2<JOIN_KEY,List<JoinElement<INPUT_RECORD>>> input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JoinMergeFunction

public JoinMergeFunction(PluginFunctionContext pluginFunctionContext)

Method Detail

call

public Iterable<OUT> call(scala.Tuple2<JOIN_KEY,List<JoinElement<INPUT_RECORD>>> input)
                   throws Exception

Specified by:

call in interface FlatMapFunc<scala.Tuple2<JOIN_KEY,List<JoinElement<INPUT_RECORD>>>,OUT>

Throws:

Exception