Uses of Class
org.apache.orc.TypeDescription
Package
Description
-
Uses of TypeDescription in org.apache.orc
Modifier and TypeMethodDescriptionTypeDescription.addField
(String field, TypeDescription fieldType) Add a field to a struct type as it is built.TypeDescription.addUnionChild
(TypeDescription child) Add a child to a union type.TypeDescription.clone()
static TypeDescription
OrcUtils.convertTypeFromProtobuf
(List<OrcProto.Type> types, int rootColumn) Translate the given rootColumn from the list of types to a TypeDescription.static TypeDescription
TypeDescription.createBinary()
static TypeDescription
TypeDescription.createBoolean()
static TypeDescription
TypeDescription.createByte()
static TypeDescription
TypeDescription.createChar()
static TypeDescription
TypeDescription.createDate()
static TypeDescription
TypeDescription.createDecimal()
static TypeDescription
TypeDescription.createDouble()
static TypeDescription
TypeDescription.createFloat()
static TypeDescription
TypeDescription.createInt()
static TypeDescription
TypeDescription.createList
(TypeDescription childType) static TypeDescription
TypeDescription.createLong()
static TypeDescription
TypeDescription.createMap
(TypeDescription keyType, TypeDescription valueType) static TypeDescription
TypeDescription.createShort()
static TypeDescription
TypeDescription.createString()
static TypeDescription
TypeDescription.createStruct()
static TypeDescription
TypeDescription.createTimestamp()
static TypeDescription
TypeDescription.createTimestampInstant()
static TypeDescription
TypeDescription.createUnion()
static TypeDescription
TypeDescription.createVarchar()
TypeDescription.findSubtype
(int goal) Locate a subtype by its id.TypeDescription.findSubtype
(String columnName) Find a subtype of this schema by name.TypeDescription.findSubtype
(String columnName, boolean isSchemaEvolutionCaseAware) static TypeDescription
TypeDescription.fromString
(String typeName) Parse TypeDescription from the Hive type names.DataMaskDescription.getColumns()
Get the list of columns that use this mask.TypeDescription.getParent()
Get the parent of the current typeEncryptionVariant.getRoot()
Get the root column for this variant.OrcFile.WriterOptions.getSchema()
Reader.getSchema()
Get the type of rows in this ORC file.Reader.Options.getSchema()
Writer.getSchema()
Get the schema for this writerTypeDescription.removeAttribute
(@NotNull String key) Remove attribute on this type, if it is set.TypeDescription.setAttribute
(@NotNull String key, String value) Set an attribute on this type.TypeDescription.withMaxLength
(int maxLength) Set the maximum length for char and varchar types.TypeDescription.withPrecision
(int precision) For decimal types, set the precision.TypeDescription.withScale
(int scale) For decimal types, set the scale.Modifier and TypeMethodDescriptionTypeDescription.findSubtypes
(String columnNameList) Find a list of subtypes from a string, including the empty list.TypeDescription.getChildren()
Get the subtypes of this type.Modifier and TypeMethodDescriptionvoid
TypeDescription.addChild
(TypeDescription child) Add a child to a type.TypeDescription.addField
(String field, TypeDescription fieldType) Add a field to a struct type as it is built.TypeDescription.addUnionChild
(TypeDescription child) Add a child to a union type.static DataMask
DataMask.Factory.build
(DataMaskDescription mask, TypeDescription schema, DataMask.MaskOverrides overrides) Build a new DataMask instance.DataMask.Provider.build
(DataMaskDescription description, TypeDescription schema, DataMask.MaskOverrides overrides) Build a mask with the given parameters.int
TypeDescription.compareTo
(TypeDescription other) static TypeDescription
TypeDescription.createList
(TypeDescription childType) static TypeDescription
TypeDescription.createMap
(TypeDescription keyType, TypeDescription valueType) static List<OrcProto.Type>
OrcUtils.getOrcTypes
(TypeDescription typeDescr) DataMask.MaskOverrides.hasOverride
(TypeDescription type) Should the current mask be overridden on a sub-column?static boolean[]
OrcUtils.includeColumns
(String selectedColumns, TypeDescription schema) Returns selected columns as a boolean array with true value set for specified column names.static void
TypeDescriptionPrettyPrint.print
(PrintStream output, TypeDescription schema) Reader.Options.schema
(TypeDescription schema) Set the schema on read type description.OrcFile.WriterOptions.setSchema
(TypeDescription schema) Set the schema for the file.ModifierConstructorDescriptionStripeStatistics
(TypeDescription schema, List<OrcProto.ColumnStatistics> list, boolean writerUsedProlepticGregorian, boolean convertToProlepticGregorian) -
Uses of TypeDescription in org.apache.orc.impl
Modifier and TypeFieldDescriptionParserUtils.TypeFinder.current
protected final TypeDescription
ConvertTreeReaderFactory.StringGroupFromAnyIntegerTreeReader.readerType
protected final TypeDescription
RecordReaderImpl.schema
Modifier and TypeMethodDescriptionstatic TypeDescription
SchemaEvolution.createEventSchema
(TypeDescription typeDescr) static TypeDescription
ParserUtils.findSubtype
(TypeDescription schema, ParserUtils.StringPosition source) static TypeDescription
ParserUtils.findSubtype
(TypeDescription schema, ParserUtils.StringPosition source, boolean isSchemaEvolutionCaseAware) static TypeDescription
SchemaEvolution.getBaseRow
(TypeDescription typeDescription) Get the underlying base row from an ACID event struct.MaskDescriptionImpl.getColumns()
SchemaEvolution.getFileSchema()
SchemaEvolution.getFileType
(int id) Get the file type by reader type id.SchemaEvolution.getFileType
(TypeDescription readerType) SchemaEvolution.getReaderBaseSchema()
Returns the non-ACID (aka base) reader type description.SchemaEvolution.getReaderSchema()
OrcTail.getSchema()
ReaderImpl.getSchema()
WriterImpl.getSchema()
static TypeDescription
ParserUtils.parseType
(ParserUtils.StringPosition source) Modifier and TypeMethodDescriptionstatic List<TypeDescription>
ParserUtils.findSubtypeList
(TypeDescription schema, ParserUtils.StringPosition source) Modifier and TypeMethodDescriptionvoid
MaskDescriptionImpl.addColumn
(TypeDescription column) protected void
ConvertTreeReaderFactory.ConvertTreeReader.assignStringGroupVectorEntry
(org.apache.hadoop.hive.ql.exec.vector.BytesColumnVector bytesColVector, int elementNum, TypeDescription readerType, byte[] bytes) protected void
ConvertTreeReaderFactory.ConvertTreeReader.assignStringGroupVectorEntry
(org.apache.hadoop.hive.ql.exec.vector.BytesColumnVector bytesColVector, int elementNum, TypeDescription readerType, byte[] bytes, int start, int length) static boolean
ConvertTreeReaderFactory.canConvert
(TypeDescription fileType, TypeDescription readerType) static boolean
SchemaEvolution.checkAcidSchema
(TypeDescription type) protected void
ConvertTreeReaderFactory.ConvertTreeReader.convertStringGroupVectorElement
(org.apache.hadoop.hive.ql.exec.vector.BytesColumnVector bytesColVector, int elementNum, TypeDescription readerType) static ColumnStatisticsImpl
ColumnStatisticsImpl.create
(TypeDescription schema) static ColumnStatisticsImpl
ColumnStatisticsImpl.create
(TypeDescription schema, boolean convertToProleptic) MaskDescriptionImpl.create
(TypeDescription schema, DataMask.MaskOverrides overrides) static org.apache.hadoop.hive.ql.exec.vector.ColumnVector
TypeUtils.createColumn
(TypeDescription schema, TypeDescription.RowBatchVersion version, int maxSize) static TypeReader
ConvertTreeReaderFactory.createConvertTreeReader
(TypeDescription readerType, TreeReaderFactory.Context context) (Rules from Hive's PrimitiveObjectInspectorUtils conversion) To BOOLEAN, BYTE, SHORT, INT, LONG: Convert from (BOOLEAN, BYTE, SHORT, INT, LONG) with down cast if necessary.static TypeDescription
SchemaEvolution.createEventSchema
(TypeDescription typeDescr) static BatchReader
TreeReaderFactory.createRootReader
(TypeDescription readerType, TreeReaderFactory.Context context) static TypeReader
TreeReaderFactory.createTreeReader
(TypeDescription readerType, TreeReaderFactory.Context context) static ColumnStatisticsImpl
ColumnStatisticsImpl.deserialize
(TypeDescription schema, OrcProto.ColumnStatistics stats) static ColumnStatisticsImpl
ColumnStatisticsImpl.deserialize
(TypeDescription schema, OrcProto.ColumnStatistics stats, boolean writerUsedProlepticGregorian, boolean convertToProlepticGregorian) ReaderImpl.deserializeStats
(TypeDescription schema, List<OrcProto.ColumnStatistics> fileStats) void
ConvertTreeReaderFactory.ConvertTreeReader.downCastAnyInteger
(org.apache.hadoop.hive.ql.exec.vector.LongColumnVector longColVector, int elementNum, long inputLong, TypeDescription readerType) void
ConvertTreeReaderFactory.ConvertTreeReader.downCastAnyInteger
(org.apache.hadoop.hive.ql.exec.vector.LongColumnVector longColVector, int elementNum, TypeDescription readerType) static void
ParserUtils.findColumn
(TypeDescription schema, List<String> names, boolean isSchemaEvolutionCaseAware, ParserUtils.TypeVisitor visitor) Find a column in a schema by walking down the type tree to find the right column.static void
ParserUtils.findColumn
(TypeDescription schema, ParserUtils.StringPosition source, boolean isSchemaEvolutionCaseAware, ParserUtils.TypeVisitor visitor) Find a column in a schema by walking down the type tree to find the right column.static org.apache.hadoop.hive.ql.exec.vector.ColumnVector[]
ParserUtils.findColumnVectors
(TypeDescription schema, ParserUtils.StringPosition source, boolean isCaseSensitive, org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch) static void
ParserUtils.findSubtype
(TypeDescription schema, int goal, ParserUtils.TypeVisitor visitor) static TypeDescription
ParserUtils.findSubtype
(TypeDescription schema, ParserUtils.StringPosition source) static TypeDescription
ParserUtils.findSubtype
(TypeDescription schema, ParserUtils.StringPosition source, boolean isSchemaEvolutionCaseAware) static List<TypeDescription>
ParserUtils.findSubtypeList
(TypeDescription schema, ParserUtils.StringPosition source) static TypeDescription
SchemaEvolution.getBaseRow
(TypeDescription typeDescription) Get the underlying base row from an ACID event struct.SchemaEvolution.getFileType
(TypeDescription readerType) protected boolean
ConvertTreeReaderFactory.ConvertTreeReader.integerDownCastNeeded
(TypeDescription fileType, TypeDescription readerType) static void
ParserUtils.parseKeys
(ParserUtils.StringPosition source, TypeDescription schema) Annotate the given schema with the encryption information.static void
ParserUtils.parseMasks
(ParserUtils.StringPosition source, TypeDescription schema) Annotate the given schema with the masking information.void
ParserUtils.TypeFinder.visit
(TypeDescription type, int posn) void
ParserUtils.TypeVisitor.visit
(TypeDescription type, int posn) As we navigate to the column, call this on each levelModifierConstructorDescriptionprotected
ListTreeReader
(int fileColumn, TypeDescription readerSchema, TreeReaderFactory.Context context) protected
MapTreeReader
(int fileColumn, TypeDescription readerSchema, TreeReaderFactory.Context context) OrcFilterContextImpl
(TypeDescription readSchema, boolean isSchemaCaseAware) SchemaEvolution
(TypeDescription fileSchema, boolean[] readerIncluded) Deprecated.SchemaEvolution
(TypeDescription fileSchema, TypeDescription readerSchema, boolean[] readerIncluded) Deprecated.SchemaEvolution
(TypeDescription fileSchema, TypeDescription readerSchema, Reader.Options options) StripeStatisticsImpl
(TypeDescription schema, boolean writerUsedProlepticGregorian, boolean convertToProlepticGregorian) StripeStatisticsImpl
(TypeDescription schema, List<OrcProto.ColumnStatistics> list, boolean writerUsedProlepticGregorian, boolean convertToProlepticGregorian) protected
StructTreeReader
(int columnId, TypeDescription readerSchema, TreeReaderFactory.Context context) TypeFinder
(TypeDescription schema) protected
UnionTreeReader
(int fileColumn, TypeDescription readerSchema, TreeReaderFactory.Context context) -
Uses of TypeDescription in org.apache.orc.impl.filter
Modifier and TypeMethodDescriptionstatic BatchFilter
FilterFactory.createBatchFilter
(Reader.Options opts, TypeDescription readSchema, boolean isSchemaCaseAware, OrcFile.Version version, boolean normalize, String filePath, Configuration conf) Create a BatchFilter.static VectorFilter
FilterFactory.createSArgFilter
(org.apache.hadoop.hive.ql.io.sarg.ExpressionTree expr, Set<String> colIds, List<org.apache.hadoop.hive.ql.io.sarg.PredicateLeaf> leaves, TypeDescription readSchema, boolean isSchemaCaseAware, OrcFile.Version version) -
Uses of TypeDescription in org.apache.orc.impl.filter.leaf
Modifier and TypeMethodDescriptionstatic VectorFilter
LeafFilterFactory.createLeafVectorFilter
(org.apache.hadoop.hive.ql.io.sarg.PredicateLeaf leaf, Set<String> colIds, TypeDescription readSchema, boolean isSchemaCaseAware, OrcFile.Version version, boolean negated) -
Uses of TypeDescription in org.apache.orc.impl.mask
Modifier and TypeMethodDescriptionMaskFactory.build
(TypeDescription schema, DataMask.MaskOverrides overrides) MaskProvider.build
(DataMaskDescription description, TypeDescription schema, DataMask.MaskOverrides overrides) protected abstract DataMask
MaskFactory.buildBinaryMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildBinaryMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildBinaryMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildBooleanMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildBooleanMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildBooleanMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildDateMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildDateMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildDateMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildDecimalMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildDecimalMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildDecimalMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildDoubleMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildDoubleMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildDoubleMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildLongMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildLongMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildLongMask
(TypeDescription schema) protected abstract DataMask
MaskFactory.buildStringMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildStringMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildStringMask
(TypeDescription schema) protected DataMask
MaskFactory.buildStructMask
(TypeDescription schema, DataMask.MaskOverrides overrides) protected abstract DataMask
MaskFactory.buildTimestampMask
(TypeDescription schema) protected DataMask
RedactMaskFactory.buildTimestampMask
(TypeDescription schema) protected DataMask
SHA256MaskFactory.buildTimestampMask
(TypeDescription schema) Modifier and TypeMethodDescriptionprotected DataMask[]
MaskFactory.buildChildren
(List<TypeDescription> children, DataMask.MaskOverrides overrides) -
Uses of TypeDescription in org.apache.orc.impl.reader
ModifierConstructorDescriptionReaderEncryption
(OrcProto.Footer footer, TypeDescription schema, long stripeStatisticsOffset, BufferChunk serializedTail, List<StripeInformation> stripes, KeyProvider provider, Configuration conf) StripePlanner
(TypeDescription schema, ReaderEncryption encryption, DataReader dataReader, OrcFile.WriterVersion version, boolean ignoreNonUtf8BloomFilter, long maxBufferSize) StripePlanner
(TypeDescription schema, ReaderEncryption encryption, DataReader dataReader, OrcFile.WriterVersion version, boolean ignoreNonUtf8BloomFilter, long maxBufferSize, Set<Integer> filterColIds) Create a stripe parser. -
Uses of TypeDescription in org.apache.orc.impl.writer
Modifier and TypeMethodDescriptionstatic TreeWriter
TreeWriter.Factory.create
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext streamFactory) Create a new tree writer for the given types and insert encryption if required.ModifierConstructorDescriptionBinaryTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) BooleanTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) ByteTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) DateTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) Decimal64TreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) DecimalTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) DoubleTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) FloatTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) IntegerTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) StructTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context) TimestampTreeWriter
(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext context, boolean instantType) WriterEncryptionVariant
(WriterEncryptionKey key, TypeDescription root, LocalKey columnKey)