co.cask.cdap.etl.spark.streaming

Class DefaultStreamingContext

java.lang.Object

co.cask.cdap.etl.common.AbstractStageContext

co.cask.cdap.etl.spark.streaming.DefaultStreamingContext

All Implemented Interfaces:

ServiceDiscoverer, Transactional, StageContext, StreamingContext

public class DefaultStreamingContext
extends AbstractStageContext
implements StreamingContext

Default implementation of StreamingContext for Spark.

Field Summary

Fields inherited from class co.cask.cdap.etl.common.AbstractStageContext

arguments

Constructor Summary

Constructors

Constructor and Description
DefaultStreamingContext(StageSpec stageSpec, JavaSparkExecutionContext sec, org.apache.spark.streaming.api.java.JavaStreamingContext jsc)

Method Summary

Modifier and Type	Method and Description
void	execute(int timeout, TxRunnable runnable)
void	execute(TxRunnable runnable)
JavaSparkExecutionContext	getSparkExecutionContext()
org.apache.spark.streaming.api.java.JavaStreamingContext	getSparkStreamingContext()
void	registerLineage(String referenceName)

Methods inherited from class co.cask.cdap.etl.common.AbstractStageContext

getArguments, getInputSchema, getInputSchemas, getLogicalStartTime, getMetrics, getNamespace, getOutputPortSchemas, getOutputSchema, getPipelineName, getPluginProperties, getPluginProperties, getServiceURL, getServiceURL, getStageName, loadPluginClass, newPluginInstance

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface co.cask.cdap.etl.api.StageContext

getArguments, getInputSchema, getInputSchemas, getLogicalStartTime, getMetrics, getNamespace, getOutputPortSchemas, getOutputSchema, getPipelineName, getPluginProperties, getPluginProperties, getStageName, loadPluginClass, newPluginInstance

Methods inherited from interface co.cask.cdap.api.ServiceDiscoverer

getServiceURL, getServiceURL

Constructor Detail

DefaultStreamingContext

public DefaultStreamingContext(StageSpec stageSpec,
                               JavaSparkExecutionContext sec,
                               org.apache.spark.streaming.api.java.JavaStreamingContext jsc)

Method Detail

getSparkStreamingContext

public org.apache.spark.streaming.api.java.JavaStreamingContext getSparkStreamingContext()

Specified by:

getSparkStreamingContext in interface StreamingContext

getSparkExecutionContext

public JavaSparkExecutionContext getSparkExecutionContext()

Specified by:

getSparkExecutionContext in interface StreamingContext

registerLineage

public void registerLineage(String referenceName)
                     throws DatasetManagementException,
                            org.apache.tephra.TransactionFailureException

Specified by:

registerLineage in interface StreamingContext

Throws:

DatasetManagementException

org.apache.tephra.TransactionFailureException

execute

public void execute(TxRunnable runnable)
             throws org.apache.tephra.TransactionFailureException

Specified by:

execute in interface Transactional

Throws:

org.apache.tephra.TransactionFailureException

execute

public void execute(int timeout,
                    TxRunnable runnable)
             throws org.apache.tephra.TransactionFailureException

Specified by:

execute in interface Transactional

Throws:

org.apache.tephra.TransactionFailureException