public abstract class PipelineStage extends Object implements scala.Serializable, Logging
Estimator or a Transformer.| Constructor and Description |
|---|
PipelineStage() |
| Modifier and Type | Method and Description |
|---|---|
abstract org.apache.spark.sql.types.StructType |
transformSchema(org.apache.spark.sql.types.StructType schema,
ParamMap paramMap)
:: DeveloperAPI ::
|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitinitializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarningpublic abstract org.apache.spark.sql.types.StructType transformSchema(org.apache.spark.sql.types.StructType schema,
ParamMap paramMap)
Derives the output schema from the input schema and parameters. The schema describes the columns and types of the data.
schema - Input schema to this stageparamMap - Parameters passed to this stage