Package org.apache.spark.sql.pipelines.logging

Class StreamListener

Object

org.apache.spark.sql.streaming.StreamingQueryListener

org.apache.spark.sql.pipelines.logging.StreamListener

All Implemented Interfaces:

Serializable, org.apache.spark.internal.Logging

public class StreamListener
extends StreamingQueryListener
implements org.apache.spark.internal.Logging

A streaming listener that converts streaming events into pipeline events for the relevant flows.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.spark.sql.streaming.StreamingQueryListener

StreamingQueryListener.Event, StreamingQueryListener.QueryIdleEvent, StreamingQueryListener.QueryIdleEvent$, StreamingQueryListener.QueryProgressEvent, StreamingQueryListener.QueryProgressEvent$, StreamingQueryListener.QueryStartedEvent, StreamingQueryListener.QueryStartedEvent$, StreamingQueryListener.QueryTerminatedEvent, StreamingQueryListener.QueryTerminatedEvent$

Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging

org.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter

Constructor Summary

Constructors

Constructor	Description
StreamListener(PipelineUpdateContext env, DataflowGraph graphForExecution)

Method Summary

Modifier and Type	Method	Description
void	onQueryProgress(StreamingQueryListener.QueryProgressEvent event)	Called when there is some status update (ingestion rate updated, etc.)
void	onQueryStarted(StreamingQueryListener.QueryStartedEvent event)	Called when a query is started.
void	onQueryTerminated(StreamingQueryListener.QueryTerminatedEvent event)	Called when a query is stopped, with or without error.

Methods inherited from class org.apache.spark.sql.streaming.StreamingQueryListener

onQueryIdle

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.internal.Logging

initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logBasedOnLevel, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, MDC, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext

Constructor Details

StreamListener

public StreamListener(PipelineUpdateContext env,
 DataflowGraph graphForExecution)

Method Details

onQueryProgress

public void onQueryProgress(StreamingQueryListener.QueryProgressEvent event)

Description copied from class: StreamingQueryListener

Called when there is some status update (ingestion rate updated, etc.)

Specified by:

onQueryProgress in class StreamingQueryListener

Parameters:

event - (undocumented)

onQueryStarted

public void onQueryStarted(StreamingQueryListener.QueryStartedEvent event)

Description copied from class: StreamingQueryListener

Called when a query is started.

Specified by:

onQueryStarted in class StreamingQueryListener

Parameters:

event - (undocumented)

onQueryTerminated

public void onQueryTerminated(StreamingQueryListener.QueryTerminatedEvent event)

Description copied from class: StreamingQueryListener

Called when a query is stopped, with or without error.

Specified by:

onQueryTerminated in class StreamingQueryListener

Parameters:

event - (undocumented)