Serialized Form (Hydrator Spark1 Core Scala 2.10 4.3.3 API)

Package co.cask.cdap.etl.spark
- Class co.cask.cdap.etl.spark.SparkStageStatisticsCollector extends Object implements Serializable
  
  serialVersionUID:
  
  -7897960584858589314L
  - Serialized Fields
    - inputRecordCounter
```
org.apache.spark.Accumulator<T> inputRecordCounter
```
    - outputRecordCounter
```
org.apache.spark.Accumulator<T> outputRecordCounter
```
    - errorRecordCounter
```
org.apache.spark.Accumulator<T> errorRecordCounter
```
Package co.cask.cdap.etl.spark.batch
- Class co.cask.cdap.etl.spark.batch.BatchSparkPipelineDriver extends SparkPipelineRunner implements Serializable
Package co.cask.cdap.etl.spark.function
- Class co.cask.cdap.etl.spark.function.AggregatorAggregateFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.AggregatorGroupByFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.AlertPassFilter extends Object implements Serializable
- Class co.cask.cdap.etl.spark.function.BatchSinkFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.BatchSourceFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
    - numOfRecordsPreview
```
int numOfRecordsPreview
```
- Class co.cask.cdap.etl.spark.function.CountingFunction extends Object implements Serializable
  - Serialized Fields
    - stageName
```
String stageName
```
    - metrics
```
Metrics metrics
```
    - metricName
```
String metricName
```
    - dataTracer
```
DataTracer dataTracer
```
- Class co.cask.cdap.etl.spark.function.ErrorPassFilter extends Object implements Serializable
- Class co.cask.cdap.etl.spark.function.ErrorTransformFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.InitialJoinFunction extends Object implements Serializable
  - Serialized Fields
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.function.JoinFlattenFunction extends Object implements Serializable
  - Serialized Fields
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.function.JoinMergeFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.JoinOnFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.function.LeftJoinFlattenFunction extends Object implements Serializable
  - Serialized Fields
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.function.MultiOutputTransformFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
- Class co.cask.cdap.etl.spark.function.OuterJoinFlattenFunction extends Object implements Serializable
  - Serialized Fields
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.function.OutputPassFilter extends Object implements Serializable
  - Serialized Fields
    - port
```
String port
```
- Class co.cask.cdap.etl.spark.function.PluginFunctionContext extends Object implements Serializable
  
  serialVersionUID:
  
  -7897960584858589315L
  - Serialized Fields
    - namespace
```
String namespace
```
    - pipelineName
```
String pipelineName
```
    - logicalStartTime
```
long logicalStartTime
```
    - arguments
```
BasicArguments arguments
```
    - pluginContext
```
PluginContext pluginContext
```
    - serviceDiscoverer
```
ServiceDiscoverer serviceDiscoverer
```
    - metrics
```
Metrics metrics
```
    - secureStore
```
SecureStore secureStore
```
    - dataTracer
```
DataTracer dataTracer
```
    - stageSpec
```
StageSpec stageSpec
```
    - collector
```
StageStatisticsCollector collector
```
- Class co.cask.cdap.etl.spark.function.TransformFunction extends Object implements Serializable
  - Serialized Fields
    - pluginFunctionContext
```
PluginFunctionContext pluginFunctionContext
```
Package co.cask.cdap.etl.spark.plugin
- Class co.cask.cdap.etl.spark.plugin.WrappedJavaSparkMain extends Object implements Serializable
  - Serialized Fields
    - delegate
```
JavaSparkMain delegate
```
    - caller
```
Caller caller
```
- Class co.cask.cdap.etl.spark.plugin.WrappedSparkCompute extends SparkCompute<IN,OUT> implements Serializable
  - Serialized Fields
    - compute
```
SparkCompute<IN,OUT> compute
```
    - caller
```
Caller caller
```
- Class co.cask.cdap.etl.spark.plugin.WrappedSparkMain extends Object implements Serializable
  - Serialized Fields
    - delegate
```
SparkMain delegate
```
    - caller
```
Caller caller
```
    - timestampStringStreamDecoder
```
scala.Function1<T1,R> timestampStringStreamDecoder
```
    - stringStreamDecoder
```
scala.Function1<T1,R> stringStreamDecoder
```
    - Transaction$module
```
SparkMain.Transaction$ Transaction$module
```
- Class co.cask.cdap.etl.spark.plugin.WrappedSparkSink extends SparkSink<IN> implements Serializable
  - Serialized Fields
    - sink
```
SparkSink<IN> sink
```
    - caller
```
Caller caller
```
- Class co.cask.cdap.etl.spark.plugin.WrappedStreamingSource extends StreamingSource<T> implements Serializable
  - Serialized Fields
    - source
```
StreamingSource<T> source
```
    - caller
```
Caller caller
```
- Class co.cask.cdap.etl.spark.plugin.WrappedWindower extends Windower implements Serializable
  - Serialized Fields
    - windower
```
Windower windower
```
    - caller
```
Caller caller
```

Package co.cask.cdap.etl.spark.streaming

Class co.cask.cdap.etl.spark.streaming.DynamicDriverContext extends Object implements Serializable

Serialization Methods

readExternal

public void readExternal(ObjectInput in)
                  throws IOException,
                         ClassNotFoundException

Throws:: IOException; ClassNotFoundException

writeExternal

public void writeExternal(ObjectOutput out)
                   throws IOException

Throws:: IOException

Package co.cask.cdap.etl.spark.streaming.function
- Class co.cask.cdap.etl.spark.streaming.function.ComputeTransformFunction extends Object implements Serializable
  - Serialized Fields
    - sec
```
JavaSparkExecutionContext sec
```
    - stageSpec
```
StageSpec stageSpec
```
    - compute
```
SparkCompute<IN,OUT> compute
```
- Class co.cask.cdap.etl.spark.streaming.function.CountingTransformFunction extends Object implements Serializable
  - Serialized Fields
    - metrics
```
Metrics metrics
```
    - stageName
```
String stageName
```
    - metricName
```
String metricName
```
    - dataTracer
```
DataTracer dataTracer
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicAggregatorAggregate extends Object implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicAggregatorGroupBy extends Object implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicJoinMerge extends Object implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicJoinOn extends Object implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
    - inputStageName
```
String inputStageName
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicSparkCompute extends SparkCompute<T,U> implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
- Class co.cask.cdap.etl.spark.streaming.function.DynamicTransform extends Object implements Serializable
  - Serialized Fields
    - dynamicDriverContext
```
DynamicDriverContext dynamicDriverContext
```
    - isMultiOutput
```
boolean isMultiOutput
```
- Class co.cask.cdap.etl.spark.streaming.function.StreamingAlertPublishFunction extends Object implements Serializable
  - Serialized Fields
    - sec
```
JavaSparkExecutionContext sec
```
    - stageSpec
```
StageSpec stageSpec
```
- Class co.cask.cdap.etl.spark.streaming.function.StreamingBatchSinkFunction extends Object implements Serializable
  - Serialized Fields
    - sec
```
JavaSparkExecutionContext sec
```
    - stageSpec
```
StageSpec stageSpec
```
- Class co.cask.cdap.etl.spark.streaming.function.StreamingSparkSinkFunction extends Object implements Serializable
  - Serialized Fields
    - sec
```
JavaSparkExecutionContext sec
```
    - stageSpec
```
StageSpec stageSpec
```
- Class co.cask.cdap.etl.spark.streaming.function.WrapOutputTransformFunction extends Object implements Serializable
  - Serialized Fields
    - stageName
```
String stageName
```
Package co.cask.cdap.etl.spark.streaming.function.preview
- Class co.cask.cdap.etl.spark.streaming.function.preview.LimitingFunction extends Object implements Serializable
  - Serialized Fields
    - numOfRecordsLimited
```
int numOfRecordsLimited
```

Serialized Form

Package co.cask.cdap.etl.spark

Class co.cask.cdap.etl.spark.SparkStageStatisticsCollector extends Object implements Serializable

Serialized Fields

inputRecordCounter

outputRecordCounter

errorRecordCounter

Package co.cask.cdap.etl.spark.batch

Class co.cask.cdap.etl.spark.batch.BatchSparkPipelineDriver extends SparkPipelineRunner implements Serializable

Package co.cask.cdap.etl.spark.function

Class co.cask.cdap.etl.spark.function.AggregatorAggregateFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.AggregatorGroupByFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.AlertPassFilter extends Object implements Serializable

Class co.cask.cdap.etl.spark.function.BatchSinkFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.BatchSourceFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

numOfRecordsPreview

Class co.cask.cdap.etl.spark.function.CountingFunction extends Object implements Serializable

Serialized Fields

stageName

metrics

metricName

dataTracer

Class co.cask.cdap.etl.spark.function.ErrorPassFilter extends Object implements Serializable

Class co.cask.cdap.etl.spark.function.ErrorTransformFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.InitialJoinFunction extends Object implements Serializable

Serialized Fields

inputStageName

Class co.cask.cdap.etl.spark.function.JoinFlattenFunction extends Object implements Serializable

Serialized Fields

inputStageName

Class co.cask.cdap.etl.spark.function.JoinMergeFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.JoinOnFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

inputStageName

Class co.cask.cdap.etl.spark.function.LeftJoinFlattenFunction extends Object implements Serializable

Serialized Fields

inputStageName

Class co.cask.cdap.etl.spark.function.MultiOutputTransformFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Class co.cask.cdap.etl.spark.function.OuterJoinFlattenFunction extends Object implements Serializable

Serialized Fields

inputStageName

Class co.cask.cdap.etl.spark.function.OutputPassFilter extends Object implements Serializable

Serialized Fields

port

Class co.cask.cdap.etl.spark.function.PluginFunctionContext extends Object implements Serializable

Serialized Fields

namespace

pipelineName

logicalStartTime

arguments

pluginContext

serviceDiscoverer

metrics

secureStore

dataTracer

stageSpec

collector

Class co.cask.cdap.etl.spark.function.TransformFunction extends Object implements Serializable

Serialized Fields

pluginFunctionContext

Package co.cask.cdap.etl.spark.plugin

Class co.cask.cdap.etl.spark.plugin.WrappedJavaSparkMain extends Object implements Serializable

Serialized Fields

delegate

caller