org.apache.spark.sql.execution

Class Aggregate

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.Aggregate

All Implemented Interfaces:

com.typesafe.scalalogging.slf4j.Logging, java.io.Serializable, org.apache.spark.sql.catalyst.expressions.NoBind, scala.Equals, scala.Product

public class Aggregate
extends SparkPlan
implements org.apache.spark.sql.catalyst.expressions.NoBind, scala.Product, scala.Serializable

:: DeveloperApi :: Groups input data by groupingExpressions and computes the aggregateExpressions for each group.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	Aggregate.ComputedAggregate An aggregate that needs to be computed for each row in a group.
class	Aggregate.ComputedAggregate$

Constructor Summary

Constructors

Constructor and Description
Aggregate(boolean partial, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions, SparkPlan child, SparkContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression>	aggregateExpressions()
SparkPlan	child()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	groupingExpressions()
scala.collection.immutable.List<SparkContext>	otherCopyArgs()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning()
boolean	partial()
scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution>	requiredChildDistribution() Specifies any partition requirements on the input data for this operator.

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

executeCollect, outputPartitioning

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, makeCopy, map, mapChildren, nextId, nodeName, numberedTreeString, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.UnaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface com.typesafe.scalalogging.slf4j.Logging

logger

Constructor Detail

Aggregate

public Aggregate(boolean partial,
         scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions,
         scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions,
         SparkPlan child,
         SparkContext sc)

Method Detail

partial

public boolean partial()

groupingExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions()

aggregateExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions()

child

public SparkPlan child()

requiredChildDistribution

public scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution> requiredChildDistribution()

Description copied from class: SparkPlan

Specifies any partition requirements on the input data for this operator.

Overrides:

requiredChildDistribution in class SparkPlan

otherCopyArgs

public scala.collection.immutable.List<SparkContext> otherCopyArgs()

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()