Package org.apache.orc.mapreduce

Class OrcInputFormat<V extends WritableComparable>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<NullWritable,V>

org.apache.orc.mapreduce.OrcInputFormat<V>

public class OrcInputFormat<V extends WritableComparable>
extends FileInputFormat<NullWritable,V>

An ORC input format that satisfies the org.apache.hadoop.mapreduce API.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

Constructor Summary

Constructors

Constructor	Description
OrcInputFormat()

Method Summary

Modifier and Type	Method	Description
RecordReader<NullWritable,V>	createRecordReader(InputSplit inputSplit, TaskAttemptContext taskAttemptContext)
protected List<FileStatus>	listStatus(JobContext job)
static void	setSearchArgument(Configuration conf, org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg, String[] columnNames)	Put the given SearchArgument into the configuration for an OrcInputFormat.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize, shrinkStatus

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OrcInputFormat

public OrcInputFormat()

Method Details

setSearchArgument

public static void setSearchArgument(Configuration conf,
 org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg,
 String[] columnNames)

Put the given SearchArgument into the configuration for an OrcInputFormat.

Parameters:

conf - the configuration to modify

sarg - the SearchArgument to put in the configuration

columnNames - the list of column names for the SearchArgument

createRecordReader

public RecordReader<NullWritable,V> createRecordReader(InputSplit inputSplit,
 TaskAttemptContext taskAttemptContext)
                                                throws IOException,
InterruptedException

Specified by:

createRecordReader in class InputFormat<NullWritable,V extends WritableComparable>

Throws:

IOException

InterruptedException

listStatus

protected List<FileStatus> listStatus(JobContext job)
                               throws IOException

Overrides:

listStatus in class FileInputFormat<NullWritable,V extends WritableComparable>

Throws:

IOException