org.apache.spark.ml.tuning

Class CrossValidator

Object

org.apache.spark.ml.PipelineStage

org.apache.spark.ml.Estimator<CrossValidatorModel>

org.apache.spark.ml.tuning.CrossValidator

All Implemented Interfaces:

java.io.Serializable, Logging, Identifiable, Params, CrossValidatorParams

public class CrossValidator
extends Estimator<CrossValidatorModel>
implements CrossValidatorParams, Logging

:: AlphaComponent :: K-fold cross validation.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CrossValidator()

Method Summary

Methods

Modifier and Type	Method and Description
CrossValidatorModel	fit(DataFrame dataset, ParamMap paramMap) Fits a single model to the input data with provided parameter map.
CrossValidator	setEstimator(Estimator<?> value)
CrossValidator	setEstimatorParamMaps(ParamMap[] value)
CrossValidator	setEvaluator(Evaluator value)
CrossValidator	setNumFolds(int value)
StructType	transformSchema(StructType schema, ParamMap paramMap) :: DeveloperApi ::

Methods inherited from class org.apache.spark.ml.Estimator

fit, fit, fit

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.ml.tuning.CrossValidatorParams

estimator, estimatorParamMaps, evaluator, getEstimator, getEstimatorParamMaps, getEvaluator, getNumFolds, numFolds

Methods inherited from interface org.apache.spark.ml.param.Params

addOutputColumn, checkInputColumn, explainParams, get, getParam, isSet, paramMap, params, set, set, validate, validate

Methods inherited from interface org.apache.spark.ml.Identifiable

uid

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

CrossValidator

public CrossValidator()

Method Detail

setEstimator

public CrossValidator setEstimator(Estimator<?> value)

setEstimatorParamMaps

public CrossValidator setEstimatorParamMaps(ParamMap[] value)

setEvaluator

public CrossValidator setEvaluator(Evaluator value)

setNumFolds

public CrossValidator setNumFolds(int value)

fit

public CrossValidatorModel fit(DataFrame dataset,
                      ParamMap paramMap)

Description copied from class: Estimator

Fits a single model to the input data with provided parameter map.

Specified by:

fit in class Estimator<CrossValidatorModel>

Parameters:

dataset - input dataset

paramMap - Parameter map. These values override any specified in this Estimator's embedded ParamMap.

Returns:

fitted model

transformSchema

public StructType transformSchema(StructType schema,
                         ParamMap paramMap)

Description copied from class: PipelineStage

:: DeveloperApi ::

Derives the output schema from the input schema and parameters. The schema describes the columns and types of the data.

Specified by:

transformSchema in class PipelineStage

Parameters:

schema - Input schema to this stage

paramMap - Parameters passed to this stage

Returns:

Output schema from this stage