org.apache.spark

Class SpillListener

Object

org.apache.spark.scheduler.SparkListener

org.apache.spark.SpillListener

public class SpillListener
extends SparkListener

A SparkListener that detects whether spills have occurred in Spark jobs.

Constructor Summary

Constructors

Constructor and Description
SpillListener()

Method Summary

Modifier and Type	Method and Description
int	numSpilledStages()
void	onJobEnd(SparkListenerJobEnd jobEnd) Called when a job ends
void	onStageCompleted(SparkListenerStageCompleted stageComplete) Called when a stage completes successfully or fails, with information on the completed stage.
void	onTaskEnd(SparkListenerTaskEnd taskEnd) Called when a task ends

Methods inherited from class org.apache.spark.scheduler.SparkListener

onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorBlacklisted, onExecutorMetricsUpdate, onExecutorRemoved, onExecutorUnblacklisted, onJobStart, onNodeBlacklisted, onNodeUnblacklisted, onOtherEvent, onSpeculativeTaskSubmitted, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SpillListener

public SpillListener()

Method Detail

numSpilledStages

public int numSpilledStages()

onTaskEnd

public void onTaskEnd(SparkListenerTaskEnd taskEnd)

Called when a task ends

Overrides:

onTaskEnd in class SparkListener

Parameters:

taskEnd - (undocumented)

onStageCompleted

public void onStageCompleted(SparkListenerStageCompleted stageComplete)

Called when a stage completes successfully or fails, with information on the completed stage.

Overrides:

onStageCompleted in class SparkListener

Parameters:

stageComplete - (undocumented)

onJobEnd

public void onJobEnd(SparkListenerJobEnd jobEnd)

Called when a job ends

Overrides:

onJobEnd in class SparkListener

Parameters:

jobEnd - (undocumented)