org.apache.spark.input

Class ConfigurableCombineFileRecordReader<K,V>

Object

org.apache.hadoop.mapreduce.RecordReader<K,V>

org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<K,V>

org.apache.spark.input.ConfigurableCombineFileRecordReader<K,V>

All Implemented Interfaces:

java.io.Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

public class ConfigurableCombineFileRecordReader<K,V>
extends org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<K,V>
implements Configurable

A CombineFileRecordReader that can pass Hadoop Configuration to Configurable RecordReaders.

Constructor Summary

Constructors

Constructor and Description
ConfigurableCombineFileRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context, Class<? extends org.apache.hadoop.mapreduce.RecordReader<K,V>> recordReaderClass)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	initNextRecordReader()

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader

close, getCurrentKey, getCurrentValue, getProgress, initialize, nextKeyValue

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.input.Configurable

conf, getConf, setConf

Constructor Detail

ConfigurableCombineFileRecordReader

public ConfigurableCombineFileRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                   org.apache.hadoop.mapreduce.TaskAttemptContext context,
                                   Class<? extends org.apache.hadoop.mapreduce.RecordReader<K,V>> recordReaderClass)

Method Detail

initNextRecordReader

public boolean initNextRecordReader()

Overrides:

initNextRecordReader in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader<K,V>