org.apache.spark.input

Class StreamRecordReader

Object

org.apache.hadoop.mapreduce.RecordReader<String,T>

org.apache.spark.input.StreamBasedRecordReader<PortableDataStream>

org.apache.spark.input.StreamRecordReader

All Implemented Interfaces:

java.io.Closeable, AutoCloseable

public class StreamRecordReader
extends StreamBasedRecordReader<PortableDataStream>

Reads the record in directly as a stream for other objects to manipulate and handle

Constructor Summary

Constructors

Constructor and Description
StreamRecordReader(org.apache.hadoop.mapreduce.lib.input.CombineFileSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context, Integer index)

Method Summary

Methods

Modifier and Type	Method and Description
PortableDataStream	parseStream(PortableDataStream inStream) Parse the stream (and close it afterwards) and return the value as in type T

Methods inherited from class org.apache.spark.input.StreamBasedRecordReader

close, getCurrentKey, getCurrentValue, getProgress, initialize, nextKeyValue

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamRecordReader

public StreamRecordReader(org.apache.hadoop.mapreduce.lib.input.CombineFileSplit split,
                  org.apache.hadoop.mapreduce.TaskAttemptContext context,
                  Integer index)

Method Detail

parseStream

public PortableDataStream parseStream(PortableDataStream inStream)

Description copied from class: StreamBasedRecordReader

Parse the stream (and close it afterwards) and return the value as in type T

Specified by:

parseStream in class StreamBasedRecordReader<PortableDataStream>

Parameters:

inStream - the stream to be read in

Returns:

the data formatted as