public class SparkModelUtils extends Object
Modifier and Type | Method and Description |
---|---|
static List<Map<String,Integer>> |
buildEncodings(MLModelConfigurationContext ctx)
Build the encodings against each categorical feature.
|
static ProbabilisticClassificationModelSummary |
generateProbabilisticClassificationModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData,
org.apache.spark.api.java.JavaRDD<scala.Tuple2<Object,Object>> scoresAndLabels)
A utility method to generate probabilistic classification model summary
|
static ClassClassificationAndRegressionModelSummary |
generateRegressionModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData,
org.apache.spark.api.java.JavaRDD<scala.Tuple2<Double,Double>> predictionsAndLabels)
A utility method to generate regression model summary
|
static ClassClassificationAndRegressionModelSummary |
getClassClassificationModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext,
org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData,
org.apache.spark.api.java.JavaPairRDD<Double,Double> predictionsAndLabels)
A utility method to generate class classification model summary
|
static double |
getMax(String statsAsJson) |
static double |
getMean(String statsAsJson) |
static double |
getMin(String statsAsJson) |
public static ProbabilisticClassificationModelSummary generateProbabilisticClassificationModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData, org.apache.spark.api.java.JavaRDD<scala.Tuple2<Object,Object>> scoresAndLabels)
scoresAndLabels
- Tuple2 containing scores and labelspublic static ClassClassificationAndRegressionModelSummary generateRegressionModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData, org.apache.spark.api.java.JavaRDD<scala.Tuple2<Double,Double>> predictionsAndLabels)
predictionsAndLabels
- Tuple2 containing predicted and actual valuespublic static ClassClassificationAndRegressionModelSummary getClassClassificationModelSummary(org.apache.spark.api.java.JavaSparkContext sparkContext, org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> testingData, org.apache.spark.api.java.JavaPairRDD<Double,Double> predictionsAndLabels)
predictionsAndLabels
- Predictions and actual labelspublic static List<Map<String,Integer>> buildEncodings(MLModelConfigurationContext ctx)
public static double getMean(String statsAsJson)
public static double getMin(String statsAsJson)
public static double getMax(String statsAsJson)
Copyright © 2015 WSO2, Inc.. All Rights Reserved.