org.apache.spark.sql.hive.execution

Class ScriptTransformation

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.execution.SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.hive.execution.ScriptTransformation

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.UnaryNode<org.apache.spark.sql.execution.SparkPlan>, scala.Equals, scala.Product

public class ScriptTransformation
extends org.apache.spark.sql.execution.SparkPlan
implements org.apache.spark.sql.execution.UnaryNode, scala.Product, scala.Serializable

Transforms the input by forking and running the specified script.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ScriptTransformation(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> input, String script, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output, org.apache.spark.sql.execution.SparkPlan child, HiveScriptIOSchema ioschema, HiveContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.spark.sql.execution.SparkPlan	child()
RDD<org.apache.spark.sql.Row>	execute()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	input()
HiveScriptIOSchema	ioschema()
scala.collection.immutable.List<HiveContext>	otherCopyArgs()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
String	script()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, executeTake, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, makeCopy, newMutableProjection, newOrdering, newPredicate, newProjection, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_, outputPartitioning, requiredChildDistribution, sparkContext, sqlContext

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, foreachUp, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, origin, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.execution.UnaryNode

outputPartitioning

Methods inherited from interface org.apache.spark.sql.catalyst.trees.UnaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

ScriptTransformation

public ScriptTransformation(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> input,
                    String script,
                    scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output,
                    org.apache.spark.sql.execution.SparkPlan child,
                    HiveScriptIOSchema ioschema,
                    HiveContext sc)

Method Detail

input

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> input()

script

public String script()

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.execution.SparkPlan>

child

public org.apache.spark.sql.execution.SparkPlan child()

Specified by:

child in interface org.apache.spark.sql.catalyst.trees.UnaryNode<org.apache.spark.sql.execution.SparkPlan>

ioschema

public HiveScriptIOSchema ioschema()

otherCopyArgs

public scala.collection.immutable.List<HiveContext> otherCopyArgs()

execute

public RDD<org.apache.spark.sql.Row> execute()

Specified by:

execute in class org.apache.spark.sql.execution.SparkPlan