co.cask.cdap.etl.spark.function

Class JoinOnFunction<JOIN_KEY,INPUT_RECORD>

java.lang.Object

co.cask.cdap.etl.spark.function.JoinOnFunction<JOIN_KEY,INPUT_RECORD>

Type Parameters:

JOIN_KEY - the type of join key

INPUT_RECORD - the type of input records to the join stage

All Implemented Interfaces:

PairFlatMapFunc<INPUT_RECORD,JOIN_KEY,INPUT_RECORD>, Serializable

public class JoinOnFunction<JOIN_KEY,INPUT_RECORD>
extends Object
implements PairFlatMapFunc<INPUT_RECORD,JOIN_KEY,INPUT_RECORD>

Function that uses a BatchJoiner to perform the joinOn part of the join. Non-serializable fields are lazily created since this is used in a Spark closure.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
JoinOnFunction(PluginFunctionContext pluginFunctionContext, String inputStageName)

Method Summary

Modifier and Type	Method and Description
Iterable<scala.Tuple2<JOIN_KEY,INPUT_RECORD>>	call(INPUT_RECORD input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JoinOnFunction

public JoinOnFunction(PluginFunctionContext pluginFunctionContext,
                      String inputStageName)

Method Detail

call

public Iterable<scala.Tuple2<JOIN_KEY,INPUT_RECORD>> call(INPUT_RECORD input)
                                                   throws Exception

Specified by:

call in interface PairFlatMapFunc<INPUT_RECORD,JOIN_KEY,INPUT_RECORD>

Throws:

Exception