org.apache.spark.ml

Class PipelineStage

java.lang.Object

org.apache.spark.ml.PipelineStage

All Implemented Interfaces:

java.io.Serializable, Params, Identifiable

Direct Known Subclasses:

Estimator, Transformer

public abstract class PipelineStage
extends java.lang.Object
implements Params

:: DeveloperApi :: A stage in a pipeline, either an Estimator or a Transformer.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PipelineStage()

Method Summary

Methods

Modifier and Type	Method and Description
abstract PipelineStage	copy(ParamMap extra) Creates a copy of this instance with the same UID and some extra params.
abstract StructType	transformSchema(StructType schema) :: DeveloperApi ::
protected StructType	transformSchema(StructType schema, boolean logging) :: DeveloperApi ::

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.ml.param.Params

clear, copyValues, defaultCopy, defaultParamMap, explainParam, explainParams, extractParamMap, extractParamMap, get, getDefault, getOrDefault, getParam, hasDefault, hasParam, isDefined, isSet, paramMap, params, set, set, set, setDefault, setDefault, shouldOwn, validateParams

Methods inherited from interface org.apache.spark.ml.util.Identifiable

toString, uid

Constructor Detail

PipelineStage

public PipelineStage()

Method Detail

transformSchema

public abstract StructType transformSchema(StructType schema)

:: DeveloperApi ::

Derives the output schema from the input schema.

Parameters:

schema - (undocumented)

Returns:

(undocumented)

transformSchema

protected StructType transformSchema(StructType schema,
                         boolean logging)

:: DeveloperApi ::

Derives the output schema from the input schema and parameters, optionally with logging.

This should be optimistic. If it is unclear whether the schema will be valid, then it should be assumed valid until proven otherwise.

Parameters:

schema - (undocumented)

logging - (undocumented)

Returns:

(undocumented)

copy

public abstract PipelineStage copy(ParamMap extra)

Description copied from interface: Params

Creates a copy of this instance with the same UID and some extra params. Subclasses should implement this method and set the return type properly.

Specified by:

copy in interface Params

Parameters:

extra - (undocumented)

Returns:

(undocumented)

See Also:

defaultCopy()