Package org.apache.spark

Class SparkFirehoseListener

Object
org.apache.spark.SparkFirehoseListener
All Implemented Interfaces:
org.apache.spark.scheduler.SparkListenerInterface
@DeveloperApi public class SparkFirehoseListener extends Object implements org.apache.spark.scheduler.SparkListenerInterface
Class that allows users to receive all SparkListener events. Users should override the onEvent method. This is a concrete Java class in order to ensure that we don't forget to update it when adding new methods to SparkListener: forgetting to add a method will result in a compilation error (if this was a concrete Scala class, default implementations of new event handlers would be inherited from the SparkListener trait). Please note until Spark 3.1.0 this was missing the DevelopApi annotation, this needs to be taken into account if changing this API before a major release.

  • Constructor Details

    • SparkFirehoseListener

      public SparkFirehoseListener()

  • Method Details

    • onEvent

      public void onEvent(SparkListenerEvent event)

    • onStageCompleted

      public final void onStageCompleted(SparkListenerStageCompleted stageCompleted)
      Specified by:
      onStageCompleted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onStageSubmitted

      public final void onStageSubmitted(SparkListenerStageSubmitted stageSubmitted)
      Specified by:
      onStageSubmitted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onTaskStart

      public final void onTaskStart(SparkListenerTaskStart taskStart)
      Specified by:
      onTaskStart in interface org.apache.spark.scheduler.SparkListenerInterface

    • onTaskGettingResult

      public final void onTaskGettingResult(SparkListenerTaskGettingResult taskGettingResult)
      Specified by:
      onTaskGettingResult in interface org.apache.spark.scheduler.SparkListenerInterface

    • onTaskEnd

      public final void onTaskEnd(SparkListenerTaskEnd taskEnd)
      Specified by:
      onTaskEnd in interface org.apache.spark.scheduler.SparkListenerInterface

    • onJobStart

      public final void onJobStart(SparkListenerJobStart jobStart)
      Specified by:
      onJobStart in interface org.apache.spark.scheduler.SparkListenerInterface

    • onJobEnd

      public final void onJobEnd(SparkListenerJobEnd jobEnd)
      Specified by:
      onJobEnd in interface org.apache.spark.scheduler.SparkListenerInterface

    • onEnvironmentUpdate

      public final void onEnvironmentUpdate(SparkListenerEnvironmentUpdate environmentUpdate)
      Specified by:
      onEnvironmentUpdate in interface org.apache.spark.scheduler.SparkListenerInterface

    • onBlockManagerAdded

      public final void onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)
      Specified by:
      onBlockManagerAdded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onBlockManagerRemoved

      public final void onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)
      Specified by:
      onBlockManagerRemoved in interface org.apache.spark.scheduler.SparkListenerInterface

    • onUnpersistRDD

      public final void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
      Specified by:
      onUnpersistRDD in interface org.apache.spark.scheduler.SparkListenerInterface

    • onApplicationStart

      public final void onApplicationStart(SparkListenerApplicationStart applicationStart)
      Specified by:
      onApplicationStart in interface org.apache.spark.scheduler.SparkListenerInterface

    • onApplicationEnd

      public final void onApplicationEnd(SparkListenerApplicationEnd applicationEnd)
      Specified by:
      onApplicationEnd in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorMetricsUpdate

      public final void onExecutorMetricsUpdate(SparkListenerExecutorMetricsUpdate executorMetricsUpdate)
      Specified by:
      onExecutorMetricsUpdate in interface org.apache.spark.scheduler.SparkListenerInterface

    • onStageExecutorMetrics

      public final void onStageExecutorMetrics(SparkListenerStageExecutorMetrics executorMetrics)
      Specified by:
      onStageExecutorMetrics in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorAdded

      public final void onExecutorAdded(SparkListenerExecutorAdded executorAdded)
      Specified by:
      onExecutorAdded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorRemoved

      public final void onExecutorRemoved(SparkListenerExecutorRemoved executorRemoved)
      Specified by:
      onExecutorRemoved in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorBlacklisted

      public final void onExecutorBlacklisted(SparkListenerExecutorBlacklisted executorBlacklisted)
      Specified by:
      onExecutorBlacklisted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorExcluded

      public final void onExecutorExcluded(SparkListenerExecutorExcluded executorExcluded)
      Specified by:
      onExecutorExcluded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorBlacklistedForStage

      public void onExecutorBlacklistedForStage(SparkListenerExecutorBlacklistedForStage executorBlacklistedForStage)
      Specified by:
      onExecutorBlacklistedForStage in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorExcludedForStage

      public void onExecutorExcludedForStage(SparkListenerExecutorExcludedForStage executorExcludedForStage)
      Specified by:
      onExecutorExcludedForStage in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeBlacklistedForStage

      public void onNodeBlacklistedForStage(SparkListenerNodeBlacklistedForStage nodeBlacklistedForStage)
      Specified by:
      onNodeBlacklistedForStage in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeExcludedForStage

      public void onNodeExcludedForStage(SparkListenerNodeExcludedForStage nodeExcludedForStage)
      Specified by:
      onNodeExcludedForStage in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorUnblacklisted

      public final void onExecutorUnblacklisted(SparkListenerExecutorUnblacklisted executorUnblacklisted)
      Specified by:
      onExecutorUnblacklisted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onExecutorUnexcluded

      public final void onExecutorUnexcluded(SparkListenerExecutorUnexcluded executorUnexcluded)
      Specified by:
      onExecutorUnexcluded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeBlacklisted

      public final void onNodeBlacklisted(SparkListenerNodeBlacklisted nodeBlacklisted)
      Specified by:
      onNodeBlacklisted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeExcluded

      public final void onNodeExcluded(SparkListenerNodeExcluded nodeExcluded)
      Specified by:
      onNodeExcluded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeUnblacklisted

      public final void onNodeUnblacklisted(SparkListenerNodeUnblacklisted nodeUnblacklisted)
      Specified by:
      onNodeUnblacklisted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onNodeUnexcluded

      public final void onNodeUnexcluded(SparkListenerNodeUnexcluded nodeUnexcluded)
      Specified by:
      onNodeUnexcluded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onBlockUpdated

      public void onBlockUpdated(SparkListenerBlockUpdated blockUpdated)
      Specified by:
      onBlockUpdated in interface org.apache.spark.scheduler.SparkListenerInterface

    • onSpeculativeTaskSubmitted

      public void onSpeculativeTaskSubmitted(SparkListenerSpeculativeTaskSubmitted speculativeTask)
      Specified by:
      onSpeculativeTaskSubmitted in interface org.apache.spark.scheduler.SparkListenerInterface

    • onUnschedulableTaskSetAdded

      public void onUnschedulableTaskSetAdded(SparkListenerUnschedulableTaskSetAdded unschedulableTaskSetAdded)
      Specified by:
      onUnschedulableTaskSetAdded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onUnschedulableTaskSetRemoved

      public void onUnschedulableTaskSetRemoved(SparkListenerUnschedulableTaskSetRemoved unschedulableTaskSetRemoved)
      Specified by:
      onUnschedulableTaskSetRemoved in interface org.apache.spark.scheduler.SparkListenerInterface

    • onResourceProfileAdded

      public void onResourceProfileAdded(SparkListenerResourceProfileAdded event)
      Specified by:
      onResourceProfileAdded in interface org.apache.spark.scheduler.SparkListenerInterface

    • onOtherEvent

      public void onOtherEvent(SparkListenerEvent event)
      Specified by:
      onOtherEvent in interface org.apache.spark.scheduler.SparkListenerInterface