co.cask.cdap.etl.spark.streaming.function

Class StreamingSparkSinkFunction<T>

java.lang.Object

co.cask.cdap.etl.spark.streaming.function.StreamingSparkSinkFunction<T>

Type Parameters:

T - type of object in the rdd

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function2<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.streaming.Time,Void>

public class StreamingSparkSinkFunction<T>
extends Object
implements org.apache.spark.api.java.function.Function2<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.streaming.Time,Void>

Function used to write a batch of data to a SparkSink for use with a JavaDStream.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
StreamingSparkSinkFunction(JavaSparkExecutionContext sec, StageSpec stageSpec)

Method Summary

Modifier and Type	Method and Description
Void	call(org.apache.spark.api.java.JavaRDD<T> data, org.apache.spark.streaming.Time batchTime)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamingSparkSinkFunction

public StreamingSparkSinkFunction(JavaSparkExecutionContext sec,
                                  StageSpec stageSpec)

Method Detail

call

public Void call(org.apache.spark.api.java.JavaRDD<T> data,
                 org.apache.spark.streaming.Time batchTime)
          throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function2<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.streaming.Time,Void>

Throws:

Exception