org.apache.spark.sql.hive

Class HiveMetastoreCatalog

Object

org.apache.spark.sql.hive.HiveMetastoreCatalog

All Implemented Interfaces:

Logging, org.apache.spark.sql.catalyst.analysis.Catalog

public class HiveMetastoreCatalog
extends Object
implements org.apache.spark.sql.catalyst.analysis.Catalog, Logging

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	HiveMetastoreCatalog.CreateTables
class	HiveMetastoreCatalog.PreInsertionCasts

Constructor Summary

Constructors

Constructor and Description
HiveMetastoreCatalog(HiveContext hive)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	caseSensitive()
void	createTable(String databaseName, String tableName, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> schema, boolean allowExisting, scala.Option<org.apache.hadoop.hive.ql.plan.CreateTableDesc> desc) Create table with specified database, table name, table description and schema
org.apache.spark.sql.hive.HiveMetastoreCatalog.CreateTables$	CreateTables()
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	lookupRelation(scala.Option<String> db, String tableName, scala.Option<String> alias)
org.apache.spark.sql.hive.HiveMetastoreCatalog.PreInsertionCasts$	PreInsertionCasts()
void	registerTable(scala.Option<String> databaseName, String tableName, org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan) UNIMPLEMENTED: It needs to be decided how we will persist in-memory tables to the metastore.
boolean	tableExists(scala.Option<String> db, String tableName)
void	unregisterAllTables()
void	unregisterTable(scala.Option<String> databaseName, String tableName) UNIMPLEMENTED: It needs to be decided how we will persist in-memory tables to the metastore.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.analysis.Catalog

lookupRelation$default$3, processDatabaseAndTableName, processDatabaseAndTableName

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

HiveMetastoreCatalog

public HiveMetastoreCatalog(HiveContext hive)

Method Detail

caseSensitive

public boolean caseSensitive()

Specified by:

caseSensitive in interface org.apache.spark.sql.catalyst.analysis.Catalog

tableExists

public boolean tableExists(scala.Option<String> db,
                  String tableName)

Specified by:

tableExists in interface org.apache.spark.sql.catalyst.analysis.Catalog

lookupRelation

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan lookupRelation(scala.Option<String> db,
                                                                     String tableName,
                                                                     scala.Option<String> alias)

Specified by:

lookupRelation in interface org.apache.spark.sql.catalyst.analysis.Catalog

createTable

public void createTable(String databaseName,
               String tableName,
               scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> schema,
               boolean allowExisting,
               scala.Option<org.apache.hadoop.hive.ql.plan.CreateTableDesc> desc)

Create table with specified database, table name, table description and schema

Parameters:

databaseName - Database Name

tableName - Table Name

schema - Schema of the new table, if not specified, will use the schema specified in crtTbl

allowExisting - if true, ignore AlreadyExistsException

desc - CreateTableDesc object which contains the SerDe info. Currently we support most of the features except the bucket.

CreateTables

public org.apache.spark.sql.hive.HiveMetastoreCatalog.CreateTables$ CreateTables()

PreInsertionCasts

public org.apache.spark.sql.hive.HiveMetastoreCatalog.PreInsertionCasts$ PreInsertionCasts()

registerTable

public void registerTable(scala.Option<String> databaseName,
                 String tableName,
                 org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

UNIMPLEMENTED: It needs to be decided how we will persist in-memory tables to the metastore. For now, if this functionality is desired mix in the in-memory OverrideCatalog.

Specified by:

registerTable in interface org.apache.spark.sql.catalyst.analysis.Catalog

unregisterTable

public void unregisterTable(scala.Option<String> databaseName,
                   String tableName)

UNIMPLEMENTED: It needs to be decided how we will persist in-memory tables to the metastore. For now, if this functionality is desired mix in the in-memory OverrideCatalog.

Specified by:

unregisterTable in interface org.apache.spark.sql.catalyst.analysis.Catalog

unregisterAllTables

public void unregisterAllTables()

Specified by:

unregisterAllTables in interface org.apache.spark.sql.catalyst.analysis.Catalog