co.cask.cdap.etl.spark.batch

Class ETLSpark

java.lang.Object

co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

co.cask.cdap.internal.api.AbstractPluginConfigurable<SparkConfigurer>

co.cask.cdap.api.spark.AbstractSpark

co.cask.cdap.etl.spark.batch.ETLSpark

All Implemented Interfaces:

ProgramLifecycle<SparkClientContext>, Spark

public class ETLSpark
extends AbstractSpark

Configures and sets up runs of BatchSparkPipelineDriver.

Constructor Summary

Constructors

Constructor and Description
ETLSpark(BatchPhaseSpec phaseSpec)

Method Summary

Modifier and Type	Method and Description
protected void	configure()
void	destroy()
void	initialize()

Methods inherited from class co.cask.cdap.api.spark.AbstractSpark

beforeSubmit, configure, getConfigurer, getContext, initialize, onFinish, setClientResources, setDescription, setDriverResources, setExecutorResources, setMainClass, setMainClassName, setName, setProperties

Methods inherited from class co.cask.cdap.internal.api.AbstractPluginConfigurable

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from class co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ETLSpark

public ETLSpark(BatchPhaseSpec phaseSpec)

Method Detail

configure

protected void configure()

Overrides:

configure in class AbstractSpark

initialize

public void initialize()
                throws Exception

Overrides:

initialize in class AbstractSpark

Throws:

Exception

destroy

public void destroy()

Specified by:

destroy in interface ProgramLifecycle<SparkClientContext>

Overrides:

destroy in class AbstractSpark