org.apache.spark.mllib.util

Class LinearDataGenerator

Object

org.apache.spark.mllib.util.LinearDataGenerator

public class LinearDataGenerator
extends Object

:: DeveloperApi :: Generate sample data used for Linear Data. This class generates uniformly random values for every feature and adds Gaussian noise with mean eps to the response variable Y.

Constructor Summary

Constructors

Constructor and Description
LinearDataGenerator()

Method Summary

Methods

Modifier and Type	Method and Description
static scala.collection.Seq<LabeledPoint>	generateLinearInput(double intercept, double[] weights, int nPoints, int seed, double eps)
static java.util.List<LabeledPoint>	generateLinearInputAsList(double intercept, double[] weights, int nPoints, int seed, double eps) Return a Java List of synthetic data randomly generated according to a multi collinear model.
static RDD<LabeledPoint>	generateLinearRDD(SparkContext sc, int nexamples, int nfeatures, double eps, int nparts, double intercept) Generate an RDD containing sample data for Linear Regression models - including Ridge, Lasso, and uregularized variants.
static void	main(String[] args)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LinearDataGenerator

public LinearDataGenerator()

Method Detail

generateLinearInputAsList

public static java.util.List<LabeledPoint> generateLinearInputAsList(double intercept,
                                                     double[] weights,
                                                     int nPoints,
                                                     int seed,
                                                     double eps)

Return a Java List of synthetic data randomly generated according to a multi collinear model.

Parameters:

intercept - Data intercept

weights - Weights to be applied.

nPoints - Number of points in sample.

seed - Random seed

Returns:

Java List of input.

generateLinearInput

public static scala.collection.Seq<LabeledPoint> generateLinearInput(double intercept,
                                                     double[] weights,
                                                     int nPoints,
                                                     int seed,
                                                     double eps)

Parameters:

intercept - Data intercept

weights - Weights to be applied.

nPoints - Number of points in sample.

seed - Random seed

eps - Epsilon scaling factor.

Returns:

Seq of input.

generateLinearRDD

public static RDD<LabeledPoint> generateLinearRDD(SparkContext sc,
                                  int nexamples,
                                  int nfeatures,
                                  double eps,
                                  int nparts,
                                  double intercept)

Generate an RDD containing sample data for Linear Regression models - including Ridge, Lasso, and uregularized variants.

Parameters:

sc - SparkContext to be used for generating the RDD.

nexamples - Number of examples that will be contained in the RDD.

nfeatures - Number of features to generate for each example.

eps - Epsilon factor by which examples are scaled.

nparts - Number of partitions in the RDD. Default value is 2.

Returns:

RDD of LabeledPoint containing sample data.

main

public static void main(String[] args)