co.cask.cdap.etl.spark.streaming.function

Class CountingTransformFunction<T>

java.lang.Object

co.cask.cdap.etl.spark.streaming.function.CountingTransformFunction<T>

Type Parameters:

T - type of object in the rdd.

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.api.java.JavaRDD<T>>

public class CountingTransformFunction<T>
extends Object
implements org.apache.spark.api.java.function.Function<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.api.java.JavaRDD<T>>

Function used to emit a metric for every item in an RDD.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CountingTransformFunction(String stageName, Metrics metrics, String metricName, DataTracer dataTracer)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.api.java.JavaRDD<T>	call(org.apache.spark.api.java.JavaRDD<T> in)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CountingTransformFunction

public CountingTransformFunction(String stageName,
                                 Metrics metrics,
                                 String metricName,
                                 @Nullable
                                 DataTracer dataTracer)

Method Detail

call

public org.apache.spark.api.java.JavaRDD<T> call(org.apache.spark.api.java.JavaRDD<T> in)
                                          throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<org.apache.spark.api.java.JavaRDD<T>,org.apache.spark.api.java.JavaRDD<T>>

Throws:

Exception