SparkFirehoseListener (Spark 1.4.1 JavaDoc)

Overview

Package

Class

Tree

Deprecated

Index

Help

PREV CLASS NEXT CLASS

FRAMES NO FRAMES

SUMMARY: NESTED | FIELD | CONSTR | METHOD

DETAIL: FIELD | CONSTR | METHOD

org.apache.spark
Class SparkFirehoseListener

Object
  org.apache.spark.SparkFirehoseListener

All Implemented Interfaces:: SparkListener

public class SparkFirehoseListener
extends Object
implements SparkListener
extends Object
implements SparkListener

Class that allows users to receive all SparkListener events. Users should override the onEvent method. This is a concrete Java class in order to ensure that we don't forget to update it when adding new methods to SparkListener: forgetting to add a method will result in a compilation error (if this was a concrete Scala class, default implementations of new event handlers would be inherited from the SparkListener trait).

Constructor Summary
`SparkFirehoseListener()`

Method Summary
`void`	`onApplicationEnd(SparkListenerApplicationEnd applicationEnd)` Called when the application ends
`void`	`onApplicationStart(SparkListenerApplicationStart applicationStart)` Called when the application starts
`void`	`onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)` Called when a new block manager has joined
`void`	`onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)` Called when an existing block manager has been removed
`void`	`onEnvironmentUpdate(SparkListenerEnvironmentUpdate environmentUpdate)` Called when environment properties have been updated
`void`	`onEvent(SparkListenerEvent event)`
`void`	`onExecutorAdded(SparkListenerExecutorAdded executorAdded)` Called when the driver registers a new executor.
`void`	`onExecutorMetricsUpdate(SparkListenerExecutorMetricsUpdate executorMetricsUpdate)` Called when the driver receives task metrics from an executor in a heartbeat.
`void`	`onExecutorRemoved(SparkListenerExecutorRemoved executorRemoved)` Called when the driver removes an executor.
`void`	`onJobEnd(SparkListenerJobEnd jobEnd)` Called when a job ends
`void`	`onJobStart(SparkListenerJobStart jobStart)` Called when a job starts
`void`	`onStageCompleted(SparkListenerStageCompleted stageCompleted)` Called when a stage completes successfully or fails, with information on the completed stage.
`void`	`onStageSubmitted(SparkListenerStageSubmitted stageSubmitted)` Called when a stage is submitted
`void`	`onTaskEnd(SparkListenerTaskEnd taskEnd)` Called when a task ends
`void`	`onTaskGettingResult(SparkListenerTaskGettingResult taskGettingResult)` Called when a task begins remotely fetching its result (will not be called for tasks that do not need to fetch the result remotely).
`void`	`onTaskStart(SparkListenerTaskStart taskStart)` Called when a task starts
`void`	`onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)` Called when an RDD is manually unpersisted by the application

Methods inherited from class Object
`equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

Constructor Detail

SparkFirehoseListener

public SparkFirehoseListener()

Method Detail