org.apache.spark.sql.sources

Class CatalystScan

Object

org.apache.spark.sql.sources.BaseRelation

org.apache.spark.sql.sources.CatalystScan

Direct Known Subclasses:

ParquetRelation2

public abstract class CatalystScan
extends BaseRelation

::Experimental:: An interface for experimenting with a more direct connection to the query planner. Compared to PrunedFilteredScan, this operator receives the raw expressions from the LogicalPlan. Unlike the other APIs this interface is not designed to be binary compatible across releases and thus should only be used for experimentation.

Constructor Summary

Constructors

Constructor and Description
CatalystScan()

Method Summary

Methods

Modifier and Type	Method and Description
abstract RDD<org.apache.spark.sql.catalyst.expressions.Row>	buildScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requiredColumns, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> filters)

Methods inherited from class org.apache.spark.sql.sources.BaseRelation

schema, sizeInBytes, sqlContext

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CatalystScan

public CatalystScan()

Method Detail

buildScan

public abstract RDD<org.apache.spark.sql.catalyst.expressions.Row> buildScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requiredColumns,
                                                           scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> filters)