Package co.cask.cdap.etl.spark

Interface Summary

Interface	Description
SparkCollection<T>	Abstraction over different types of spark collections with common shared operations on those collections.
SparkPairCollection<K,V>	Abstraction over different types of spark pair collections with common shared operations on those collections.

Class Summary

Class	Description
CombinedEmitter<T>	An emitter used in Spark to collect all output and errors emitted.
Compat	Utility class to handle incompatibilities between Spark1 and Spark2.
NoLookupProvider	A LookupProvider that doesn't work because lookups don't work in Spark.
SparkPipelineRunner	Base Spark program to run a Hydrator pipeline.
SparkPipelineRuntime	PipelineRuntime that can be created using Spark contexts.
SparkStageStatisticsCollector	Implementation of StageStatisticsCollector for batch spark pipelines.
StreamingCompat	Utility class to handle incompatibilities between Spark1 and Spark2 streaming.