Package org.apache.orc.mapred

Class OrcMapredRecordWriter<V extends Writable>

java.lang.Object

org.apache.orc.mapred.OrcMapredRecordWriter<V>

All Implemented Interfaces:

RecordWriter<NullWritable,V>

public class OrcMapredRecordWriter<V extends Writable>
extends Object
implements RecordWriter<NullWritable,V>

Constructor Summary

Constructors

Constructor	Description
OrcMapredRecordWriter(Writer writer)
OrcMapredRecordWriter(Writer writer, int rowBatchSize)
OrcMapredRecordWriter(Writer writer, int rowBatchSize, int maxChildLength)

Method Summary

Modifier and Type	Method	Description
static void	addVariableLengthColumns(List<org.apache.hadoop.hive.ql.exec.vector.MultiValuedColumnVector> result, org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch)	Find variable length columns and add them to the list.
void	close(Reporter reporter)
static int	getMaxChildLength(List<org.apache.hadoop.hive.ql.exec.vector.MultiValuedColumnVector> columns)	Get the longest variable length vector in a column vector
static void	setColumn(TypeDescription schema, org.apache.hadoop.hive.ql.exec.vector.ColumnVector vector, int row, Writable value)
void	write(NullWritable nullWritable, V v)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OrcMapredRecordWriter

public OrcMapredRecordWriter(Writer writer)

OrcMapredRecordWriter

public OrcMapredRecordWriter(Writer writer,
 int rowBatchSize)

OrcMapredRecordWriter

public OrcMapredRecordWriter(Writer writer,
 int rowBatchSize,
 int maxChildLength)

Method Details

addVariableLengthColumns

public static void addVariableLengthColumns(List<org.apache.hadoop.hive.ql.exec.vector.MultiValuedColumnVector> result,
 org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch)

Find variable length columns and add them to the list.

Parameters:

result - the list to be appended to

batch - the batch to scan

setColumn

public static void setColumn(TypeDescription schema,
 org.apache.hadoop.hive.ql.exec.vector.ColumnVector vector,
 int row,
 Writable value)

getMaxChildLength

public static int getMaxChildLength(List<org.apache.hadoop.hive.ql.exec.vector.MultiValuedColumnVector> columns)

Get the longest variable length vector in a column vector

Returns:

the length of the longest sub-column

write

public void write(NullWritable nullWritable,
 V v)
           throws IOException

Specified by:

write in interface RecordWriter<NullWritable,V extends Writable>

Throws:

IOException

close

public void close(Reporter reporter)
           throws IOException

Specified by:

close in interface RecordWriter<NullWritable,V extends Writable>

Throws:

IOException