Uses of Interface
co.cask.cdap.etl.spark.SparkPairCollection

Packages that use SparkPairCollection

Package	Description
co.cask.cdap.etl.spark
co.cask.cdap.etl.spark.batch
co.cask.cdap.etl.spark.streaming

Uses of SparkPairCollection in co.cask.cdap.etl.spark

Methods in co.cask.cdap.etl.spark that return SparkPairCollection

Modifier and Type	Method and Description
protected abstract SparkPairCollection<Object,Object>	SparkPipelineRunner.addJoinKey(StageSpec stageSpec, String inputStageName, SparkCollection<Object> inputCollection, StageStatisticsCollector collector)
<K,V> SparkPairCollection<K,V>	SparkCollection.flatMapToPair(org.apache.spark.api.java.function.PairFlatMapFunction<T,K,V> function)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	SparkPairCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	SparkPairCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	SparkPairCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	SparkPairCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	SparkPairCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	SparkPairCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,T>	SparkPairCollection.mapValues(org.apache.spark.api.java.function.Function<V,T> function)

Methods in co.cask.cdap.etl.spark with parameters of type SparkPairCollection

Modifier and Type	Method and Description
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	SparkPairCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	SparkPairCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	SparkPairCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	SparkPairCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	SparkPairCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	SparkPairCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
protected abstract SparkCollection<Object>	SparkPipelineRunner.mergeJoinResults(StageSpec stageSpec, SparkPairCollection<Object,List<JoinElement<Object>>> joinedInputs, StageStatisticsCollector collector)

Uses of SparkPairCollection in co.cask.cdap.etl.spark.batch

Classes in co.cask.cdap.etl.spark.batch that implement SparkPairCollection

Modifier and Type	Class and Description
class	PairRDDCollection<K,V> Implementation of SparkCollection that is backed by a JavaPairRDD.

Methods in co.cask.cdap.etl.spark.batch that return SparkPairCollection

Modifier and Type	Method and Description
protected SparkPairCollection<Object,Object>	BatchSparkPipelineDriver.addJoinKey(StageSpec stageSpec, String inputStageName, SparkCollection<Object> inputCollection, StageStatisticsCollector collector)
<K,V> SparkPairCollection<K,V>	RDDCollection.flatMapToPair(org.apache.spark.api.java.function.PairFlatMapFunction<T,K,V> function)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairRDDCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairRDDCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairRDDCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairRDDCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairRDDCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairRDDCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,T>	PairRDDCollection.mapValues(org.apache.spark.api.java.function.Function<V,T> function)

Methods in co.cask.cdap.etl.spark.batch with parameters of type SparkPairCollection

Modifier and Type	Method and Description
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairRDDCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairRDDCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairRDDCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairRDDCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairRDDCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairRDDCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
protected SparkCollection<Object>	BatchSparkPipelineDriver.mergeJoinResults(StageSpec stageSpec, SparkPairCollection<Object,List<JoinElement<Object>>> joinedInputs, StageStatisticsCollector collector)

Uses of SparkPairCollection in co.cask.cdap.etl.spark.streaming

Classes in co.cask.cdap.etl.spark.streaming that implement SparkPairCollection

Modifier and Type	Class and Description
class	PairDStreamCollection<K,V> JavaPairDStream backed SparkPairCollection

Methods in co.cask.cdap.etl.spark.streaming that return SparkPairCollection

Modifier and Type	Method and Description
<K,V> SparkPairCollection<K,V>	DStreamCollection.flatMapToPair(org.apache.spark.api.java.function.PairFlatMapFunction<T,K,V> function)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairDStreamCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairDStreamCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairDStreamCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairDStreamCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairDStreamCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairDStreamCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,T>	PairDStreamCollection.mapValues(org.apache.spark.api.java.function.Function<V,T> function)

Methods in co.cask.cdap.etl.spark.streaming with parameters of type SparkPairCollection

Modifier and Type	Method and Description
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairDStreamCollection.fullOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<com.google.common.base.Optional<V>,com.google.common.base.Optional<T>>>	PairDStreamCollection.fullOuterJoin(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairDStreamCollection.join(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,T>>	PairDStreamCollection.join(SparkPairCollection<K,T> other, int numPartitions)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairDStreamCollection.leftOuterJoin(SparkPairCollection<K,T> other)
<T> SparkPairCollection<K,scala.Tuple2<V,com.google.common.base.Optional<T>>>	PairDStreamCollection.leftOuterJoin(SparkPairCollection<K,T> other, int numPartitions)