| Interface | Description |
|---|---|
| ActorLogReceive |
A trait to enable logging all Akka actor messages.
|
| Clock |
An interface to represent clocks, so that they can be mocked out in unit tests.
|
| TaskCompletionListener |
:: DeveloperApi ::
|
| Class | Description |
|---|---|
| AkkaUtils |
Various utility classes for working with Akka.
|
| BoundedPriorityQueue<A> |
Bounded priority queue.
|
| ByteBufferInputStream |
Reads data from a ByteBuffer, and optionally cleans it up using BlockManager.dispose()
at the end of the stream (e.g.
|
| CallSite |
CallSite represents a place in user code.
|
| ClosureCleaner | |
| CollectionsUtils | |
| CompletionIterator<A,I extends scala.collection.Iterator<A>> |
Wrapper around an iterator which calls a completion method after it successfully iterates
through all the elements.
|
| Distribution |
Util for getting some stats from a small sample of numeric values, with some handy
summary functions.
|
| FieldAccessFinder | |
| FileLogger |
A generic class for logging information to file.
|
| IdGenerator |
A util used to get a unique generation ID.
|
| InnerClosureFinder | |
| IntParam |
An extractor object for parsing strings into integers.
|
| JsonProtocol |
Serializes SparkListener events to/from JSON.
|
| MemoryParam |
An extractor object for parsing JVM memory strings, such as "10g", into an Int representing
the number of megabytes.
|
| MetadataCleaner |
Runs a timer task to periodically clean up metadata (e.g.
|
| MetadataCleanerType | |
| MutablePair<T1,T2> |
:: DeveloperApi ::
A tuple of 2 elements.
|
| NextIterator<U> |
Provides a basic/boilerplate Iterator implementation.
|
| ParentClassLoader |
A class loader which makes findClass accesible to the child
|
| RedirectThread |
A utility class to redirect the child process's stdout or stderr.
|
| ReturnStatementFinder | |
| SerializableBuffer |
A wrapper around a java.nio.ByteBuffer that is serializable through Java serialization, to make
it easier to pass ByteBuffers in case class messages.
|
| SignalLogger |
Used to log signals received.
|
| SignalLoggerHandler | |
| SizeEstimator |
Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in
memory-aware caches.
|
| SparkExitCode | |
| SparkUncaughtExceptionHandler |
The default uncaught exception handler for Executors terminates the whole process, to avoid
getting into a bad state indefinitely.
|
| StatCounter |
A class for tracking the statistics of a set of numbers (count, mean and variance) in a
numerically robust way.
|
| SystemClock | |
| ThreadStackTrace |
Used for shipping per-thread stacktraces from the executors to driver.
|
| TimeStampedHashMap<A,B> |
This is a custom implementation of scala.collection.mutable.Map which stores the insertion
timestamp along with each key-value pair.
|
| TimeStampedHashSet<A> | |
| TimeStampedValue<V> | |
| TimeStampedWeakValueHashMap<A,B> |
A wrapper of TimeStampedHashMap that ensures the values are weakly referenced and timestamped.
|
| Utils |
Various utility methods used by Spark.
|
| Vector | |
| Vector.Multiplier | |
| Vector.VectorAccumParam$ |
| Exception | Description |
|---|---|
| TaskCompletionListenerException |
Exception thrown when there is an exception in
executing the callback in TaskCompletionListener.
|