org.apache.spark.sql

Class RuntimeConfig

java.lang.Object

org.apache.spark.sql.RuntimeConfig

public class RuntimeConfig
extends java.lang.Object

Runtime configuration interface for Spark. To access this, use SparkSession.conf.

Options set here are automatically propagated to the Hadoop configuration during I/O.

Since:

2.0.0

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	contains(java.lang.String key) Returns whether a particular key is set.
protected <T> T	get( entry) Returns the value of Spark runtime configuration property for the given key.
protected <T> scala.Option<T>	get( entry)
protected <T> T	get( entry, T default_) Returns the value of Spark runtime configuration property for the given key.
java.lang.String	get(java.lang.String key) Returns the value of Spark runtime configuration property for the given key.
java.lang.String	get(java.lang.String key, java.lang.String default_) Returns the value of Spark runtime configuration property for the given key.
scala.collection.immutable.Map<java.lang.String,java.lang.String>	getAll() Returns all properties set in this conf.
scala.Option<java.lang.String>	getOption(java.lang.String key) Returns the value of Spark runtime configuration property for the given key.
void	set(java.lang.String key, boolean value) Sets the given Spark runtime configuration property.
void	set(java.lang.String key, long value) Sets the given Spark runtime configuration property.
void	set(java.lang.String key, java.lang.String value) Sets the given Spark runtime configuration property.
void	unset(java.lang.String key) Resets the configuration property for the given key.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

set

public void set(java.lang.String key,
       java.lang.String value)

Sets the given Spark runtime configuration property.

Parameters:

key - (undocumented)

value - (undocumented)

Since:

2.0.0

set

public void set(java.lang.String key,
       boolean value)

Sets the given Spark runtime configuration property.

Parameters:

key - (undocumented)

value - (undocumented)

Since:

2.0.0

set

public void set(java.lang.String key,
       long value)

Sets the given Spark runtime configuration property.

Parameters:

key - (undocumented)

value - (undocumented)

Since:

2.0.0

get

public java.lang.String get(java.lang.String key)
                     throws java.util.NoSuchElementException

Returns the value of Spark runtime configuration property for the given key.

Parameters:

key - (undocumented)

Returns:

(undocumented)

Throws:

NoSuchElementException - if the key is not set and does not have a default value

Since:

2.0.0

get

public java.lang.String get(java.lang.String key,
                   java.lang.String default_)

Returns the value of Spark runtime configuration property for the given key.

Parameters:

key - (undocumented)

default_ - (undocumented)

Returns:

(undocumented)

Since:

2.0.0

get

protected <T> T get( entry)
         throws java.util.NoSuchElementException

Returns the value of Spark runtime configuration property for the given key.

Parameters:

entry - (undocumented)

Returns:

(undocumented)

Throws:

java.util.NoSuchElementException

get

protected <T> scala.Option<T> get( entry)

get

protected <T> T get( entry,
        T default_)

Returns the value of Spark runtime configuration property for the given key.

Parameters:

entry - (undocumented)

default_ - (undocumented)

Returns:

(undocumented)

getAll

public scala.collection.immutable.Map<java.lang.String,java.lang.String> getAll()

Returns all properties set in this conf.

Returns:

(undocumented)

Since:

2.0.0

getOption

public scala.Option<java.lang.String> getOption(java.lang.String key)

Returns the value of Spark runtime configuration property for the given key.

Parameters:

key - (undocumented)

Returns:

(undocumented)

Since:

2.0.0

unset

public void unset(java.lang.String key)

Resets the configuration property for the given key.

Parameters:

key - (undocumented)

Since:

2.0.0

contains

protected boolean contains(java.lang.String key)

Returns whether a particular key is set.

Parameters:

key - (undocumented)

Returns:

(undocumented)