Package org.apache.parquet.format
Class FileMetaData
- java.lang.Object
-
- org.apache.parquet.format.FileMetaData
-
- All Implemented Interfaces:
Serializable,Cloneable,Comparable<FileMetaData>,org.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>,org.apache.thrift.TSerializable
@Generated(value="Autogenerated by Thrift Compiler (0.16.0)", date="2023-05-12") public class FileMetaData extends Object implements org.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>, Serializable, Cloneable, Comparable<FileMetaData>
- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classFileMetaData._FieldsThe set of fields this struct contains, along with convenience methods for finding and manipulating them.
-
Field Summary
Fields Modifier and Type Field Description List<ColumnOrder>column_ordersSort order used for the min_value and max_value fields of each column in this file.Stringcreated_byString for application that wrote this file.EncryptionAlgorithmencryption_algorithmEncryption algorithm.ByteBufferfooter_signing_key_metadataRetrieval metadata of key used for signing the footer.List<KeyValue>key_value_metadataOptional key/value metadata *static Map<FileMetaData._Fields,org.apache.thrift.meta_data.FieldMetaData>metaDataMaplongnum_rowsNumber of rows in this file *List<RowGroup>row_groupsRow groups in this file *List<SchemaElement>schemaParquet schema for this file.intversionVersion of this file *
-
Constructor Summary
Constructors Constructor Description FileMetaData()FileMetaData(int version, List<SchemaElement> schema, long num_rows, List<RowGroup> row_groups)FileMetaData(FileMetaData other)Performs a deep copy on other.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidaddToColumn_orders(ColumnOrder elem)voidaddToKey_value_metadata(KeyValue elem)voidaddToRow_groups(RowGroup elem)voidaddToSchema(SchemaElement elem)ByteBufferbufferForFooter_signing_key_metadata()voidclear()intcompareTo(FileMetaData other)FileMetaDatadeepCopy()booleanequals(Object that)booleanequals(FileMetaData that)FileMetaData._FieldsfieldForId(int fieldId)List<ColumnOrder>getColumn_orders()Sort order used for the min_value and max_value fields of each column in this file.Iterator<ColumnOrder>getColumn_ordersIterator()intgetColumn_ordersSize()StringgetCreated_by()String for application that wrote this file.EncryptionAlgorithmgetEncryption_algorithm()Encryption algorithm.ObjectgetFieldValue(FileMetaData._Fields field)byte[]getFooter_signing_key_metadata()Retrieval metadata of key used for signing the footer.List<KeyValue>getKey_value_metadata()Optional key/value metadata *Iterator<KeyValue>getKey_value_metadataIterator()intgetKey_value_metadataSize()longgetNum_rows()Number of rows in this file *List<RowGroup>getRow_groups()Row groups in this file *Iterator<RowGroup>getRow_groupsIterator()intgetRow_groupsSize()List<SchemaElement>getSchema()Parquet schema for this file.Iterator<SchemaElement>getSchemaIterator()intgetSchemaSize()intgetVersion()Version of this file *inthashCode()booleanisSet(FileMetaData._Fields field)Returns true if field corresponding to fieldID is set (has been assigned a value) and false otherwisebooleanisSetColumn_orders()Returns true if field column_orders is set (has been assigned a value) and false otherwisebooleanisSetCreated_by()Returns true if field created_by is set (has been assigned a value) and false otherwisebooleanisSetEncryption_algorithm()Returns true if field encryption_algorithm is set (has been assigned a value) and false otherwisebooleanisSetFooter_signing_key_metadata()Returns true if field footer_signing_key_metadata is set (has been assigned a value) and false otherwisebooleanisSetKey_value_metadata()Returns true if field key_value_metadata is set (has been assigned a value) and false otherwisebooleanisSetNum_rows()Returns true if field num_rows is set (has been assigned a value) and false otherwisebooleanisSetRow_groups()Returns true if field row_groups is set (has been assigned a value) and false otherwisebooleanisSetSchema()Returns true if field schema is set (has been assigned a value) and false otherwisebooleanisSetVersion()Returns true if field version is set (has been assigned a value) and false otherwisevoidread(org.apache.thrift.protocol.TProtocol iprot)FileMetaDatasetColumn_orders(List<ColumnOrder> column_orders)Sort order used for the min_value and max_value fields of each column in this file.voidsetColumn_ordersIsSet(boolean value)FileMetaDatasetCreated_by(String created_by)String for application that wrote this file.voidsetCreated_byIsSet(boolean value)FileMetaDatasetEncryption_algorithm(EncryptionAlgorithm encryption_algorithm)Encryption algorithm.voidsetEncryption_algorithmIsSet(boolean value)voidsetFieldValue(FileMetaData._Fields field, Object value)FileMetaDatasetFooter_signing_key_metadata(byte[] footer_signing_key_metadata)Retrieval metadata of key used for signing the footer.FileMetaDatasetFooter_signing_key_metadata(ByteBuffer footer_signing_key_metadata)voidsetFooter_signing_key_metadataIsSet(boolean value)FileMetaDatasetKey_value_metadata(List<KeyValue> key_value_metadata)Optional key/value metadata *voidsetKey_value_metadataIsSet(boolean value)FileMetaDatasetNum_rows(long num_rows)Number of rows in this file *voidsetNum_rowsIsSet(boolean value)FileMetaDatasetRow_groups(List<RowGroup> row_groups)Row groups in this file *voidsetRow_groupsIsSet(boolean value)FileMetaDatasetSchema(List<SchemaElement> schema)Parquet schema for this file.voidsetSchemaIsSet(boolean value)FileMetaDatasetVersion(int version)Version of this file *voidsetVersionIsSet(boolean value)StringtoString()voidunsetColumn_orders()voidunsetCreated_by()voidunsetEncryption_algorithm()voidunsetFooter_signing_key_metadata()voidunsetKey_value_metadata()voidunsetNum_rows()voidunsetRow_groups()voidunsetSchema()voidunsetVersion()voidvalidate()voidwrite(org.apache.thrift.protocol.TProtocol oprot)
-
-
-
Field Detail
-
version
public int version
Version of this file *
-
schema
public List<SchemaElement> schema
Parquet schema for this file. This schema contains metadata for all the columns. The schema is represented as a tree with a single root. The nodes of the tree are flattened to a list by doing a depth-first traversal. The column metadata contains the path in the schema for that column which can be used to map columns to nodes in the schema. The first element is the root *
-
num_rows
public long num_rows
Number of rows in this file *
-
created_by
public String created_by
String for application that wrote this file. This should be in the formatversion (build ). e.g. impala version 1.0 (build 6cf94d29b2b7115df4de2c06e2ab4326d721eb55)
-
column_orders
public List<ColumnOrder> column_orders
Sort order used for the min_value and max_value fields of each column in this file. Sort orders are listed in the order matching the columns in the schema. The indexes are not necessary the same though, because only leaf nodes of the schema are represented in the list of sort orders. Without column_orders, the meaning of the min_value and max_value fields is undefined. To ensure well-defined behaviour, if min_value and max_value are written to a Parquet file, column_orders must be written as well. The obsolete min and max fields are always sorted by signed comparison regardless of column_orders.
-
encryption_algorithm
public EncryptionAlgorithm encryption_algorithm
Encryption algorithm. This field is set only in encrypted files with plaintext footer. Files with encrypted footer store algorithm id in FileCryptoMetaData structure.
-
footer_signing_key_metadata
public ByteBuffer footer_signing_key_metadata
Retrieval metadata of key used for signing the footer. Used only in encrypted files with plaintext footer.
-
metaDataMap
public static final Map<FileMetaData._Fields,org.apache.thrift.meta_data.FieldMetaData> metaDataMap
-
-
Constructor Detail
-
FileMetaData
public FileMetaData()
-
FileMetaData
public FileMetaData(int version, List<SchemaElement> schema, long num_rows, List<RowGroup> row_groups)
-
FileMetaData
public FileMetaData(FileMetaData other)
Performs a deep copy on other.
-
-
Method Detail
-
deepCopy
public FileMetaData deepCopy()
- Specified by:
deepCopyin interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
clear
public void clear()
- Specified by:
clearin interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
getVersion
public int getVersion()
Version of this file *
-
setVersion
public FileMetaData setVersion(int version)
Version of this file *
-
unsetVersion
public void unsetVersion()
-
isSetVersion
public boolean isSetVersion()
Returns true if field version is set (has been assigned a value) and false otherwise
-
setVersionIsSet
public void setVersionIsSet(boolean value)
-
getSchemaSize
public int getSchemaSize()
-
getSchemaIterator
public Iterator<SchemaElement> getSchemaIterator()
-
addToSchema
public void addToSchema(SchemaElement elem)
-
getSchema
public List<SchemaElement> getSchema()
Parquet schema for this file. This schema contains metadata for all the columns. The schema is represented as a tree with a single root. The nodes of the tree are flattened to a list by doing a depth-first traversal. The column metadata contains the path in the schema for that column which can be used to map columns to nodes in the schema. The first element is the root *
-
setSchema
public FileMetaData setSchema(List<SchemaElement> schema)
Parquet schema for this file. This schema contains metadata for all the columns. The schema is represented as a tree with a single root. The nodes of the tree are flattened to a list by doing a depth-first traversal. The column metadata contains the path in the schema for that column which can be used to map columns to nodes in the schema. The first element is the root *
-
unsetSchema
public void unsetSchema()
-
isSetSchema
public boolean isSetSchema()
Returns true if field schema is set (has been assigned a value) and false otherwise
-
setSchemaIsSet
public void setSchemaIsSet(boolean value)
-
getNum_rows
public long getNum_rows()
Number of rows in this file *
-
setNum_rows
public FileMetaData setNum_rows(long num_rows)
Number of rows in this file *
-
unsetNum_rows
public void unsetNum_rows()
-
isSetNum_rows
public boolean isSetNum_rows()
Returns true if field num_rows is set (has been assigned a value) and false otherwise
-
setNum_rowsIsSet
public void setNum_rowsIsSet(boolean value)
-
getRow_groupsSize
public int getRow_groupsSize()
-
addToRow_groups
public void addToRow_groups(RowGroup elem)
-
setRow_groups
public FileMetaData setRow_groups(List<RowGroup> row_groups)
Row groups in this file *
-
unsetRow_groups
public void unsetRow_groups()
-
isSetRow_groups
public boolean isSetRow_groups()
Returns true if field row_groups is set (has been assigned a value) and false otherwise
-
setRow_groupsIsSet
public void setRow_groupsIsSet(boolean value)
-
getKey_value_metadataSize
public int getKey_value_metadataSize()
-
addToKey_value_metadata
public void addToKey_value_metadata(KeyValue elem)
-
setKey_value_metadata
public FileMetaData setKey_value_metadata(List<KeyValue> key_value_metadata)
Optional key/value metadata *
-
unsetKey_value_metadata
public void unsetKey_value_metadata()
-
isSetKey_value_metadata
public boolean isSetKey_value_metadata()
Returns true if field key_value_metadata is set (has been assigned a value) and false otherwise
-
setKey_value_metadataIsSet
public void setKey_value_metadataIsSet(boolean value)
-
getCreated_by
public String getCreated_by()
String for application that wrote this file. This should be in the formatversion (build ). e.g. impala version 1.0 (build 6cf94d29b2b7115df4de2c06e2ab4326d721eb55)
-
setCreated_by
public FileMetaData setCreated_by(String created_by)
String for application that wrote this file. This should be in the formatversion (build ). e.g. impala version 1.0 (build 6cf94d29b2b7115df4de2c06e2ab4326d721eb55)
-
unsetCreated_by
public void unsetCreated_by()
-
isSetCreated_by
public boolean isSetCreated_by()
Returns true if field created_by is set (has been assigned a value) and false otherwise
-
setCreated_byIsSet
public void setCreated_byIsSet(boolean value)
-
getColumn_ordersSize
public int getColumn_ordersSize()
-
getColumn_ordersIterator
public Iterator<ColumnOrder> getColumn_ordersIterator()
-
addToColumn_orders
public void addToColumn_orders(ColumnOrder elem)
-
getColumn_orders
public List<ColumnOrder> getColumn_orders()
Sort order used for the min_value and max_value fields of each column in this file. Sort orders are listed in the order matching the columns in the schema. The indexes are not necessary the same though, because only leaf nodes of the schema are represented in the list of sort orders. Without column_orders, the meaning of the min_value and max_value fields is undefined. To ensure well-defined behaviour, if min_value and max_value are written to a Parquet file, column_orders must be written as well. The obsolete min and max fields are always sorted by signed comparison regardless of column_orders.
-
setColumn_orders
public FileMetaData setColumn_orders(List<ColumnOrder> column_orders)
Sort order used for the min_value and max_value fields of each column in this file. Sort orders are listed in the order matching the columns in the schema. The indexes are not necessary the same though, because only leaf nodes of the schema are represented in the list of sort orders. Without column_orders, the meaning of the min_value and max_value fields is undefined. To ensure well-defined behaviour, if min_value and max_value are written to a Parquet file, column_orders must be written as well. The obsolete min and max fields are always sorted by signed comparison regardless of column_orders.
-
unsetColumn_orders
public void unsetColumn_orders()
-
isSetColumn_orders
public boolean isSetColumn_orders()
Returns true if field column_orders is set (has been assigned a value) and false otherwise
-
setColumn_ordersIsSet
public void setColumn_ordersIsSet(boolean value)
-
getEncryption_algorithm
public EncryptionAlgorithm getEncryption_algorithm()
Encryption algorithm. This field is set only in encrypted files with plaintext footer. Files with encrypted footer store algorithm id in FileCryptoMetaData structure.
-
setEncryption_algorithm
public FileMetaData setEncryption_algorithm(EncryptionAlgorithm encryption_algorithm)
Encryption algorithm. This field is set only in encrypted files with plaintext footer. Files with encrypted footer store algorithm id in FileCryptoMetaData structure.
-
unsetEncryption_algorithm
public void unsetEncryption_algorithm()
-
isSetEncryption_algorithm
public boolean isSetEncryption_algorithm()
Returns true if field encryption_algorithm is set (has been assigned a value) and false otherwise
-
setEncryption_algorithmIsSet
public void setEncryption_algorithmIsSet(boolean value)
-
getFooter_signing_key_metadata
public byte[] getFooter_signing_key_metadata()
Retrieval metadata of key used for signing the footer. Used only in encrypted files with plaintext footer.
-
bufferForFooter_signing_key_metadata
public ByteBuffer bufferForFooter_signing_key_metadata()
-
setFooter_signing_key_metadata
public FileMetaData setFooter_signing_key_metadata(byte[] footer_signing_key_metadata)
Retrieval metadata of key used for signing the footer. Used only in encrypted files with plaintext footer.
-
setFooter_signing_key_metadata
public FileMetaData setFooter_signing_key_metadata(ByteBuffer footer_signing_key_metadata)
-
unsetFooter_signing_key_metadata
public void unsetFooter_signing_key_metadata()
-
isSetFooter_signing_key_metadata
public boolean isSetFooter_signing_key_metadata()
Returns true if field footer_signing_key_metadata is set (has been assigned a value) and false otherwise
-
setFooter_signing_key_metadataIsSet
public void setFooter_signing_key_metadataIsSet(boolean value)
-
setFieldValue
public void setFieldValue(FileMetaData._Fields field, Object value)
- Specified by:
setFieldValuein interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
getFieldValue
public Object getFieldValue(FileMetaData._Fields field)
- Specified by:
getFieldValuein interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
isSet
public boolean isSet(FileMetaData._Fields field)
Returns true if field corresponding to fieldID is set (has been assigned a value) and false otherwise- Specified by:
isSetin interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
equals
public boolean equals(FileMetaData that)
-
compareTo
public int compareTo(FileMetaData other)
- Specified by:
compareToin interfaceComparable<FileMetaData>
-
fieldForId
public FileMetaData._Fields fieldForId(int fieldId)
- Specified by:
fieldForIdin interfaceorg.apache.thrift.TBase<FileMetaData,FileMetaData._Fields>
-
read
public void read(org.apache.thrift.protocol.TProtocol iprot) throws org.apache.thrift.TException- Specified by:
readin interfaceorg.apache.thrift.TSerializable- Throws:
org.apache.thrift.TException
-
write
public void write(org.apache.thrift.protocol.TProtocol oprot) throws org.apache.thrift.TException- Specified by:
writein interfaceorg.apache.thrift.TSerializable- Throws:
org.apache.thrift.TException
-
validate
public void validate() throws org.apache.thrift.TException- Throws:
org.apache.thrift.TException
-
-