org.apache.spark

Class SpillListener

Object

org.apache.spark.SpillListener

All Implemented Interfaces:

SparkListener

public class SpillListener
extends Object
implements SparkListener

A SparkListener that detects whether spills have occurred in Spark jobs.

Constructor Summary

Constructors

Constructor and Description
SpillListener()

Method Summary

Methods

Modifier and Type	Method and Description
int	numSpilledStages()
void	onJobEnd(SparkListenerJobEnd jobEnd) Called when a job ends
void	onStageCompleted(SparkListenerStageCompleted stageComplete) Called when a stage completes successfully or fails, with information on the completed stage.
void	onTaskEnd(SparkListenerTaskEnd taskEnd) Called when a task ends

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.scheduler.SparkListener

onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorMetricsUpdate, onExecutorRemoved, onJobStart, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD

Constructor Detail

SpillListener

public SpillListener()

Method Detail

numSpilledStages

public int numSpilledStages()

onTaskEnd

public void onTaskEnd(SparkListenerTaskEnd taskEnd)

Description copied from interface: SparkListener

Called when a task ends

Specified by:

onTaskEnd in interface SparkListener

Parameters:

taskEnd - (undocumented)

onStageCompleted

public void onStageCompleted(SparkListenerStageCompleted stageComplete)

Description copied from interface: SparkListener

Called when a stage completes successfully or fails, with information on the completed stage.

Specified by:

onStageCompleted in interface SparkListener

Parameters:

stageComplete - (undocumented)

onJobEnd

public void onJobEnd(SparkListenerJobEnd jobEnd)

Description copied from interface: SparkListener

Called when a job ends

Specified by:

onJobEnd in interface SparkListener

Parameters:

jobEnd - (undocumented)