com.facebook.presto.common.block

Class AbstractMapBlock

java.lang.Object

com.facebook.presto.common.block.AbstractMapBlock

All Implemented Interfaces:

Block, UncheckedBlock

Direct Known Subclasses:

MapBlock, MapBlockBuilder

public abstract class AbstractMapBlock
extends Object
implements Block

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AbstractMapBlock.HashTables

Field Summary

Fields

Modifier and Type	Field and Description
protected long	logicalSizeInBytes

Constructor Summary

Constructors

Constructor and Description
AbstractMapBlock()

Method Summary

Modifier and Type	Method and Description
Block	appendNull() Returns a block that has an appended null at the end, no matter if the original block has null or not.
Block	copyPositions(int[] positions, int offset, int length) Returns a block containing the specified positions.
Block	copyRegion(int position, int length) Returns a block starting at the specified position and extends for the specified length.
protected abstract void	ensureHashTableLoaded(MethodHandle keyBlockHashCode)
OptionalInt	fixedSizeInBytesPerPosition() Returns the number of bytes (in terms of Block.getSizeInBytes()) required per position that this block contains, assuming that the number of bytes required is a known static quantity and not dependent on any particular specific position.
long	getApproximateRegionLogicalSizeInBytes(int position, int length) Returns the approximate logical size of block.getRegion(position, length).
Block	getBlock(int position) Gets a block in the value at position.
Block	getBlockUnchecked(int internalPosition) Gets a Block value at internalPosition - getOffsetBase().
String	getEncodingName() Get the encoding for this block.
long	getEstimatedDataSizeForStats(int position) Returns the estimated in memory data size for stats of position.
protected abstract AbstractMapBlock.HashTables	getHashTables()
long	getLogicalSizeInBytes() Returns the size of the block contents, regardless of internal representation.
protected abstract boolean[]	getMapIsNull()
abstract int	getOffsetBase() offset is entry-based, not position-based.
protected abstract int[]	getOffsets() offset is entry-based, not position-based.
long	getPositionsSizeInBytes(boolean[] positions, int selectedMapPositions) Returns the size of all positions marked true in the positions array.
protected abstract Block	getRawKeyBlock()
protected abstract Block	getRawValueBlock()
Block	getRegion(int position, int length) Returns a block starting at the specified position and extends for the specified length.
long	getRegionLogicalSizeInBytes(int position, int length) Returns the size of block.getRegion(position, length).
long	getRegionSizeInBytes(int position, int length) Returns the size of block.getRegion(position, length).
protected Block	getSingleValueBlockInternal(int position)
boolean	isHashTablesPresent()
boolean	isNull(int position) Is the specified position null?
boolean	isNullUnchecked(int internalPosition)
boolean	mayHaveNull() Is it possible the block may have a null value? If false, the block can not contain a null, but if true, the block may or may not have a null.
void	writePositionTo(int position, BlockBuilder blockBuilder) Appends the value at position to blockBuilder and close the entry.
void	writePositionTo(int position, io.airlift.slice.SliceOutput output) Appends the value at position to output.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.facebook.presto.common.block.Block

bytesCompare, bytesEqual, compareTo, equals, getByte, getInt, getLoadedBlock, getLong, getLong, getPositionCount, getPositions, getRetainedSizeInBytes, getShort, getSingleValueBlock, getSizeInBytes, getSlice, getSliceLength, hash, retainedBytesForEachPart, writeBytesTo, writeBytesTo

Methods inherited from interface com.facebook.presto.common.block.UncheckedBlock

getByteUnchecked, getIntUnchecked, getLongUnchecked, getLongUnchecked, getShortUnchecked, getSliceLengthUnchecked, getSliceUnchecked

Field Detail

logicalSizeInBytes

protected volatile long logicalSizeInBytes

Constructor Detail

AbstractMapBlock

public AbstractMapBlock()

Method Detail

getRawKeyBlock

protected abstract Block getRawKeyBlock()

getRawValueBlock

protected abstract Block getRawValueBlock()

getHashTables

protected abstract AbstractMapBlock.HashTables getHashTables()

getOffsets

protected abstract int[] getOffsets()

offset is entry-based, not position-based. In other words, if offset[1] is 6, it means the first map has 6 key-value pairs, not 6 key/values (which would be 3 pairs).

getOffsetBase

public abstract int getOffsetBase()

offset is entry-based, not position-based. (see getOffsets)

Specified by:

getOffsetBase in interface UncheckedBlock

Returns:

the internal offset of the underlying data structure of this block

getMapIsNull

@Nullable
protected abstract boolean[] getMapIsNull()

ensureHashTableLoaded

protected abstract void ensureHashTableLoaded(MethodHandle keyBlockHashCode)

getEncodingName

public String getEncodingName()

Description copied from interface: Block

Get the encoding for this block.

Specified by:

getEncodingName in interface Block

copyPositions

public Block copyPositions(int[] positions,
                           int offset,
                           int length)

Description copied from interface: Block

Returns a block containing the specified positions. Positions to copy are stored in a subarray within positions array that starts at offset and has length of length. All specified positions must be valid for this block.

The returned block must be a compact representation of the original block.

Specified by:

copyPositions in interface Block

getRegion

public Block getRegion(int position,
                       int length)

Description copied from interface: Block

Returns a block starting at the specified position and extends for the specified length. The specified region must be entirely contained within this block.

The region can be a view over this block. If this block is released the region block may also be released. If the region block is released this block may also be released.

Specified by:

getRegion in interface Block

fixedSizeInBytesPerPosition

public OptionalInt fixedSizeInBytesPerPosition()

Description copied from interface: Block

Returns the number of bytes (in terms of Block.getSizeInBytes()) required per position that this block contains, assuming that the number of bytes required is a known static quantity and not dependent on any particular specific position. This allows for some complex block wrappings to potentially avoid having to call Block.getPositionsSizeInBytes(boolean[], int) which would require computing the specific positions selected

Specified by:

fixedSizeInBytesPerPosition in interface Block

Returns:

The size in bytes, per position, if this block type does not require specific position information to compute its size

getRegionSizeInBytes

public long getRegionSizeInBytes(int position,
                                 int length)

Description copied from interface: Block

Returns the size of block.getRegion(position, length). The method can be expensive. Do not use it outside an implementation of Block.

Specified by:

getRegionSizeInBytes in interface Block

getLogicalSizeInBytes

public long getLogicalSizeInBytes()

Description copied from interface: Block

Returns the size of the block contents, regardless of internal representation. The same logical data values should always have the same size, no matter what block type is used or how they are represented within a specific block. This can differ substantially from Block.getSizeInBytes() for certain block types. For RLE, it will be N times larger. For dictionary, it will be larger based on how many times dictionary entries are reused.

Specified by:

getLogicalSizeInBytes in interface Block

getRegionLogicalSizeInBytes

public long getRegionLogicalSizeInBytes(int position,
                                        int length)

Description copied from interface: Block

Returns the size of block.getRegion(position, length). The method can be expensive. Do not use it outside an implementation of Block.

Specified by:

getRegionLogicalSizeInBytes in interface Block

getApproximateRegionLogicalSizeInBytes

public long getApproximateRegionLogicalSizeInBytes(int position,
                                                   int length)

Description copied from interface: Block

Returns the approximate logical size of block.getRegion(position, length). This method is faster than getRegionLogicalSizeInBytes(). For dictionary blocks, this counts the amortized flattened size of the included positions. For example, for a DictionaryBlock with 5 ids [1, 1, 1, 1, 1] and a dictionary of VariableWidthBlock with 3 elements of sizes [9, 5, 7], the result of getApproximateRegionLogicalSizeInBytes(0, 5) would be (9 + 5 + 7) / 3 * 5 = 35, while getRegionLogicalSizeInBytes(0, 5) would be 5 * 5 = 25.

Specified by:

getApproximateRegionLogicalSizeInBytes in interface Block

getPositionsSizeInBytes

public final long getPositionsSizeInBytes(boolean[] positions,
                                          int selectedMapPositions)

Description copied from interface: Block

Returns the size of all positions marked true in the positions array. This is equivalent to multiple calls of block.getRegionSizeInBytes(position, length) where you mark all positions for the regions first.

Specified by:

getPositionsSizeInBytes in interface Block

copyRegion

public Block copyRegion(int position,
                        int length)

Description copied from interface: Block

Returns a block starting at the specified position and extends for the specified length. The specified region must be entirely contained within this block.

The region returned must be a compact representation of the original block, unless their internal representation will be exactly the same. This method is useful for operators that hold on to a range of values without holding on to the entire block.

Specified by:

copyRegion in interface Block

getBlock

public Block getBlock(int position)

Description copied from interface: Block

Gets a block in the value at position.

Specified by:

getBlock in interface Block

Returns:

writePositionTo

public void writePositionTo(int position,
                            BlockBuilder blockBuilder)

Description copied from interface: Block

Appends the value at position to blockBuilder and close the entry.

Specified by:

writePositionTo in interface Block

writePositionTo

public void writePositionTo(int position,
                            io.airlift.slice.SliceOutput output)

Description copied from interface: Block

Appends the value at position to output.

Specified by:

writePositionTo in interface Block

getSingleValueBlockInternal

protected Block getSingleValueBlockInternal(int position)

getEstimatedDataSizeForStats

public long getEstimatedDataSizeForStats(int position)

Description copied from interface: Block

Returns the estimated in memory data size for stats of position. Do not use it for other purpose.

Specified by:

getEstimatedDataSizeForStats in interface Block

mayHaveNull

public boolean mayHaveNull()

Description copied from interface: Block

Is it possible the block may have a null value? If false, the block can not contain a null, but if true, the block may or may not have a null.

Specified by:

mayHaveNull in interface Block

isNull

public boolean isNull(int position)

Description copied from interface: Block

Is the specified position null?

Specified by:

isNull in interface Block

isHashTablesPresent

public boolean isHashTablesPresent()

getBlockUnchecked

public Block getBlockUnchecked(int internalPosition)

Description copied from interface: UncheckedBlock

Gets a Block value at internalPosition - getOffsetBase().

Specified by:

getBlockUnchecked in interface UncheckedBlock

isNullUnchecked

public boolean isNullUnchecked(int internalPosition)

Specified by:

isNullUnchecked in interface UncheckedBlock

Returns:

true if value at internalPosition - getOffsetBase() is null

appendNull

public Block appendNull()

Description copied from interface: Block

Returns a block that has an appended null at the end, no matter if the original block has null or not. The original block won't be modified.

Specified by:

appendNull in interface Block