org.apache.spark.sql.hive

Class HiveMetastoreCatalog.ParquetConversions

Object

org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.hive.HiveMetastoreCatalog.ParquetConversions

All Implemented Interfaces:

Logging

Enclosing class:

HiveMetastoreCatalog

public class HiveMetastoreCatalog.ParquetConversions
extends org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

Constructor Summary

Constructors

Constructor and Description
HiveMetastoreCatalog.ParquetConversions() When scanning or writing to non-partitioned Metastore Parquet tables, convert them to Parquet data source relations for better performance.

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Methods inherited from class org.apache.spark.sql.catalyst.rules.Rule

isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_, ruleName

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

HiveMetastoreCatalog.ParquetConversions

public HiveMetastoreCatalog.ParquetConversions()

When scanning or writing to non-partitioned Metastore Parquet tables, convert them to Parquet data source relations for better performance.

This rule can be considered as HiveStrategies.ParquetConversion done right.

Method Detail

apply

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Specified by:

apply in class org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>