org.apache.spark.storage
Class StorageStatusListener

Object
  org.apache.spark.storage.StorageStatusListener

All Implemented Interfaces:

SparkListener

public class StorageStatusListener
extends Object
implements SparkListener

:: DeveloperApi :: A SparkListener that maintains executor storage status.

This class is thread-safe (unlike JobProgressListener)

Constructor Summary

StorageStatusListener()

Method Summary

scala.collection.mutable.Map<String,StorageStatus>	executorIdToStorageStatus()
void	onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded) Called when a new block manager has joined
void	onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved) Called when an existing block manager has been removed
void	onTaskEnd(SparkListenerTaskEnd taskEnd) Called when a task ends
void	onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD) Called when an RDD is manually unpersisted by the application
scala.collection.Seq<StorageStatus>	storageStatusList()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.scheduler.SparkListener

onApplicationEnd, onApplicationStart, onEnvironmentUpdate, onExecutorAdded, onExecutorMetricsUpdate, onExecutorRemoved, onJobEnd, onJobStart, onStageCompleted, onStageSubmitted, onTaskGettingResult, onTaskStart

Constructor Detail

StorageStatusListener

public StorageStatusListener()

Method Detail

executorIdToStorageStatus

public scala.collection.mutable.Map<String,StorageStatus> executorIdToStorageStatus()

storageStatusList

public scala.collection.Seq<StorageStatus> storageStatusList()

onTaskEnd

public void onTaskEnd(SparkListenerTaskEnd taskEnd)

Description copied from interface: SparkListener

Called when a task ends

Specified by:

onTaskEnd in interface SparkListener

Parameters:

taskEnd - (undocumented)

onUnpersistRDD

public void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)

Description copied from interface: SparkListener

Called when an RDD is manually unpersisted by the application

Specified by:

onUnpersistRDD in interface SparkListener

Parameters:

unpersistRDD - (undocumented)

onBlockManagerAdded

public void onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)

Description copied from interface: SparkListener

Called when a new block manager has joined

Specified by:

onBlockManagerAdded in interface SparkListener

Parameters:

blockManagerAdded - (undocumented)

onBlockManagerRemoved

public void onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)

Description copied from interface: SparkListener

Called when an existing block manager has been removed

Specified by:

onBlockManagerRemoved in interface SparkListener

Parameters:

blockManagerRemoved - (undocumented)