online

Type Members

1. abstract class Api extends Serializable

   

2. class ArrayRow extends Row

   

   Consumed by row aggregator after decoding.

   Consumed by row aggregator after decoding. Mutations follow the same schema as input for value indices. However there are two main differences. * ts and reversal columns are required for computation * Mutation ts takes on the role of ts. Since the schema is the same with the sole difference of the added columns, we add these columns on the tail of the Array and extract them accordingly. i.e. for mutations: reversal index = ArrayRow.length - (Constants.MutationAvroColumns.length - (index of reversal in Constants.MutationAvroColumns)

3. class AvroCodec extends Serializable

   

4. case class AvroSchemaTraverser(currentNode: Schema) extends SchemaTraverser[Schema] with Product with Serializable

   

5. class CatalystUtil extends AnyRef

   

6. case class DataMetrics(series: Seq[(Long, SortedMap[String, Any])]) extends Product with Serializable

   

7. case class DataStream(df: DataFrame, partitions: Int, topicInfo: TopicInfo) extends Product with Serializable

   

8. abstract class ExternalSourceFactory extends Serializable

   

   Factory interface for creating external source handlers dynamically.

   Factory interface for creating external source handlers dynamically.

   Implementations of this factory can be registered with ExternalSourceRegistry to enable dynamic creation of ExternalSourceHandler instances based on external source configurations at runtime.

   The factory pattern allows for flexible handler creation where the specific handler implementation can be determined by the ExternalSource configuration, including factory parameters passed through ExternalSourceFactoryConfig.

9. abstract class ExternalSourceHandler extends Serializable

   

10. class ExternalSourceRegistry extends Serializable

    

11. class Fetcher extends FetcherBase

    

12. class FetcherBase extends MetadataStore with FetcherCache

    

13. trait FetcherCache extends AnyRef

    

14. trait FlagStore extends Serializable

    

15. class GroupByServingInfoParsed extends GroupByServingInfo with Serializable

    

16. abstract class JTry[V] extends AnyRef

    

17. abstract class JavaExternalSourceHandler extends ExternalSourceHandler

    

18. class JavaFetcher extends AnyRef

    

19. class JavaRequest extends AnyRef

    

20. class JavaResponse extends AnyRef

    

21. class JavaSeriesStatsResponse extends AnyRef

    

22. class JavaStatsRequest extends AnyRef

    

23. class JavaStatsResponse extends AnyRef

    

24. case class JoinCodec(conf: JoinOps, keySchema: StructType, baseValueSchema: StructType) extends Serializable with Product

    

25. trait KVStore extends AnyRef

    

26. case class LoggableResponse(keyBytes: Array[Byte], valueBytes: Array[Byte], joinName: String, tsMillis: Long, schemaHash: String) extends Product with Serializable

    

27. case class LoggableResponseBase64(keyBase64: String, valueBase64: String, name: String, tsMillis: Long, schemaHash: String) extends Product with Serializable

    

28. class MetadataDirWalker extends AnyRef

    

29. case class MetadataEndPoint[Conf <: TBase[_, _]](extractFn: (String, Conf) ⇒ (String, String), name: String)(implicit evidence$1: Manifest[Conf], evidence$2: ClassTag[Conf]) extends Product with Serializable

    

30. class MetadataStore extends AnyRef

    

31. trait ModelBackend extends AnyRef

    

32. case class Mutation(schema: StructType = null, before: Array[Any] = null, after: Array[Any] = null) extends Product with Serializable

    

    Mutation is the general case of an Event Imagine a user impression/view stream - impressions/views are immutable events Imagine a stream of changes to a credit card transaction stream.

    MUTATION vs. EVENT

    Mutation is the general case of an Event Imagine a user impression/view stream - impressions/views are immutable events Imagine a stream of changes to a credit card transaction stream.

    • transactions can be "corrected"/updated & deleted, besides being "inserted"
    • This is one of the core difference between entity and event sources. Events are insert-only.
    • (The other difference is Entites are stored in the warehouse typically as snapshots of the table as of midnight) In case of an update - one must produce both before and after values In case of a delete - only before is populated & after is left as null In case of a insert - only after is populated & before is left as null

    TIME ASSUMPTIONS

    The schema needs to contain a ts(milliseconds as a java Long) For the entities case, mutation_ts when absent will use ts as a replacement

    TYPE CONVERSIONS

    Java types corresponding to the schema types. StreamDecoder should produce mutations that comply. NOTE: everything is nullable (hence boxed) IntType java.lang.Integer LongType java.lang.Long DoubleType java.lang.Double FloatType java.lang.Float ShortType java.lang.Short BooleanType java.lang.Boolean ByteType java.lang.Byte StringType java.lang.String BinaryType Array[Byte] ListType java.util.List[Byte] MapType java.util.Map[Byte] StructType Array[Any]

33. class PoolMap[Key, Value] extends AnyRef

    

34. class PooledCatalystUtil extends AnyRef

    

35. class RowWrapper extends Row

    

36. case class RunModelInferenceRequest(model: Model, inputs: Seq[Map[String, AnyRef]]) extends Product with Serializable

    

37. case class RunModelInferenceResponse(request: RunModelInferenceRequest, outputs: Seq[Map[String, AnyRef]]) extends Product with Serializable

    

38. trait SerializableFunction[T, R] extends Function[T, R] with Serializable

    

39. trait StreamBuilder extends AnyRef

    

40. abstract class StreamDecoder extends Serializable

    

41. class TBaseDecoderFactory extends Serializable

    

42. class TTLCache[I, O] extends AnyRef

    

43. class ThriftDecoder extends Serializable

    

44. class TileCodec extends AnyRef

    

    TileCodec is a helper class that allows for the creation of pre-aggregated tiles of feature values.

    TileCodec is a helper class that allows for the creation of pre-aggregated tiles of feature values. These pre-aggregated tiles can be used in the serving layer to compute the final feature values along with batch pre-aggregates produced by GroupByUploads. The pre-aggregated tiles are serialized as Avro and indicate whether the tile is complete or not (partial aggregates)

45. case class TopicInfo(name: String, topicType: String, params: Map[String, String]) extends Product with Serializable