org.apache.spark.input

Class WholeCombineFileRecordReader

Object

org.apache.hadoop.mapreduce.RecordReader<K,V>

org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<String,String>

org.apache.spark.input.WholeCombineFileRecordReader

All Implemented Interfaces:

java.io.Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

public class WholeCombineFileRecordReader
extends org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<String,String>
implements org.apache.hadoop.conf.Configurable

A RecordReader for reading a single whole text file out in a key-value pair, where the key is the file path and the value is the entire content of the file.

Constructor Summary

Constructors

Constructor and Description
WholeCombineFileRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
boolean	initNextRecordReader()
void	setConf(org.apache.hadoop.conf.Configuration c)

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader

close, getCurrentKey, getCurrentValue, getProgress, initialize, nextKeyValue

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WholeCombineFileRecordReader

public WholeCombineFileRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                            org.apache.hadoop.mapreduce.TaskAttemptContext context)

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration c)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

initNextRecordReader

public boolean initNextRecordReader()

Overrides:

initNextRecordReader in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<String,String>