org.apache.spark.storage

Class StorageStatusListener

Object

org.apache.spark.storage.StorageStatusListener

All Implemented Interfaces:

SparkListener

public class StorageStatusListener
extends Object
implements SparkListener

:: DeveloperApi :: A SparkListener that maintains executor storage status.

This class is thread-safe (unlike JobProgressListener)

Constructor Summary

Constructors

Constructor and Description
StorageStatusListener()

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.mutable.Map<String,StorageStatus>	executorIdToStorageStatus()
void	onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded) Called when a new block manager has joined
void	onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved) Called when an existing block manager has been removed
void	onBlockUpdated(SparkListenerBlockUpdated blockUpdated) Called when the driver receives a block update info.
void	onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD) Called when an RDD is manually unpersisted by the application
scala.collection.Seq<StorageStatus>	storageStatusList()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.scheduler.SparkListener

onApplicationEnd, onApplicationStart, onEnvironmentUpdate, onExecutorAdded, onExecutorMetricsUpdate, onExecutorRemoved, onJobEnd, onJobStart, onStageCompleted, onStageSubmitted, onTaskEnd, onTaskGettingResult, onTaskStart

Constructor Detail

StorageStatusListener

public StorageStatusListener()

Method Detail

executorIdToStorageStatus

public scala.collection.mutable.Map<String,StorageStatus> executorIdToStorageStatus()

storageStatusList

public scala.collection.Seq<StorageStatus> storageStatusList()

onUnpersistRDD

public void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)

Description copied from interface: SparkListener

Called when an RDD is manually unpersisted by the application

Specified by:

onUnpersistRDD in interface SparkListener

Parameters:

unpersistRDD - (undocumented)

onBlockManagerAdded

public void onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)

Description copied from interface: SparkListener

Called when a new block manager has joined

Specified by:

onBlockManagerAdded in interface SparkListener

Parameters:

blockManagerAdded - (undocumented)

onBlockManagerRemoved

public void onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)

Description copied from interface: SparkListener

Called when an existing block manager has been removed

Specified by:

onBlockManagerRemoved in interface SparkListener

Parameters:

blockManagerRemoved - (undocumented)

onBlockUpdated

public void onBlockUpdated(SparkListenerBlockUpdated blockUpdated)

Description copied from interface: SparkListener

Called when the driver receives a block update info.

Specified by:

onBlockUpdated in interface SparkListener

Parameters:

blockUpdated - (undocumented)