Class/Object

ai.chronon.online

Fetcher

Related Docs: object Fetcher | package online

Permalink

class Fetcher extends FetcherBase

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Fetcher
  2. FetcherBase
  3. FetcherCache
  4. MetadataStore
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Fetcher(kvStore: KVStore, metaDataSet: String, timeoutMillis: Long = 10000, logFunc: Consumer[LoggableResponse] = null, debug: Boolean = false, externalSourceRegistry: ExternalSourceRegistry = null, callerName: String = null, flagStore: FlagStore = null, disableErrorThrows: Boolean = false, executionContextOverride: ExecutionContext = null, joinFetchParallelChunkSize: Option[Int] = None, modelBackend: ModelBackend = null)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. val batchIrCacheName: String

    Permalink
    Definition Classes
    FetcherCache
  6. def buildJoinCodec(joinConf: Join, refreshOnFail: Boolean): (JoinCodec, Boolean)

    Permalink
  7. val caffeineMetricsContext: Context

    Permalink
    Attributes
    protected
    Definition Classes
    FetcherCache
  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @throws( ... )
  9. val dataset: String

    Permalink
    Definition Classes
    MetadataStore
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. implicit val executionContext: ExecutionContext

    Permalink
    Definition Classes
    MetadataStore
  13. val externalSourceRegistry: ExternalSourceRegistry

    Permalink
  14. def fetchBaseJoin(requests: Seq[Request], joinConf: Option[Join]): Future[Seq[ResponseWithContext]]

    Permalink
  15. def fetchColumns(columnSpecs: Seq[ColumnSpec]): Future[Map[ColumnSpec, Response]]

    Permalink

    Fetch method to simulate a random access interface for Chronon by distributing requests to relevant GroupBys.

    Fetch method to simulate a random access interface for Chronon by distributing requests to relevant GroupBys. This is a batch API which allows the caller to provide a sequence of ColumnSpec queries and receive a mapping of results.

    TODO: Metrics TODO: Collection identifier for metrics TODO: Consider removing prefix interface for this method TODO: Consider using simpler response type since mapping is redundant

    columnSpecs

    – batch of ColumnSpec queries

    returns

    Future map of query to GroupBy response

    Definition Classes
    FetcherBase
  16. def fetchConsistencyMetricsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching OOC metrics stats or drifts.

  17. def fetchExternal(joinRequests: Seq[Request], joinConf: Option[Join] = None): Future[Seq[Response]]

    Permalink
  18. def fetchGroupByStructured(requests: Seq[Request]): Future[Seq[StructuredResponse]]

    Permalink

    Like fetchGroupBys, but names struct-typed values (and lists of structs) at every nesting level instead of returning them as bare positional arrays.

    Like fetchGroupBys, but names struct-typed values (and lists of structs) at every nesting level instead of returning them as bare positional arrays. Resolves the same value schema that the classic map response is already shaped by - derivations included - so this is purely an alternative view of the same values.

    Definition Classes
    FetcherBase
  19. def fetchGroupBys(requests: Seq[Request]): Future[Seq[Response]]

    Permalink
    Definition Classes
    FetcherBase
  20. def fetchJoin(requests: Seq[Request], joinConf: Option[Join] = None): Future[Seq[Response]]

    Permalink
    Definition Classes
    FetcherFetcherBase
  21. def fetchJoinChunked(requests: Seq[Request], chunkSizeOverride: Int, joinConf: Option[Join] = None): Seq[Future[Seq[Response]]]

    Permalink
  22. def fetchJoinStructured(requests: Seq[Request], joinConf: Option[Join] = None): Future[Seq[StructuredResponse]]

    Permalink

    Like fetchJoin, but names struct-typed values (and lists of structs) at every nesting level instead of returning them as bare positional arrays.

    Like fetchJoin, but names struct-typed values (and lists of structs) at every nesting level instead of returning them as bare positional arrays. This is purely an alternative view of the values fetchJoin already returns, resolved against the same JoinCodec.valueSchema.

    That schema spans base, derived and model-transform fields while any single response holds only one of those sets, so FeatureRecord narrows it to the fields actually present.

  23. def fetchLogStatsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching logging stats or drifts.

  24. def fetchModelTransforms(derivedValuesFuture: Future[Seq[ResponseWithContext]]): Future[Seq[ResponseWithContext]]

    Permalink
  25. def fetchStatsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching backfill tables stats or drifts.

  26. def getCachedRequests(groupByRequestToKvRequest: Seq[(Request, Try[GroupByRequestMeta])]): Map[GetRequest, CachedBatchResponse]

    Permalink

    Given a list of GetRequests, return a map of GetRequests to cached FinalBatchIrs.

    Given a list of GetRequests, return a map of GetRequests to cached FinalBatchIrs.

    Definition Classes
    FetcherCache
  27. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate()
  28. def getConf[T <: TBase[_, _]](confPathOrName: String)(implicit arg0: Manifest[T]): Try[T]

    Permalink
    Definition Classes
    MetadataStore
  29. def getEntityListByTeam[T <: TBase[_, _]](team: String)(implicit arg0: Manifest[T]): Try[Seq[String]]

    Permalink
    Definition Classes
    MetadataStore
  30. lazy val getGroupByListByTeam: TTLCache[String, Try[Seq[String]]]

    Permalink
    Definition Classes
    MetadataStore
  31. lazy val getGroupByServingInfo: TTLCache[String, Try[GroupByServingInfoParsed]]

    Permalink
    Definition Classes
    MetadataStore
  32. lazy val getJoinCodecs: TTLCache[String, Try[(JoinCodec, Boolean)]]

    Permalink
  33. lazy val getJoinConf: TTLCache[String, Try[JoinOps]]

    Permalink
    Definition Classes
    MetadataStore
  34. lazy val getJoinListByTeam: TTLCache[String, Try[Seq[String]]]

    Permalink
    Definition Classes
    MetadataStore
  35. def getSchemaFromKVStore(dataset: String, key: String): AvroCodec

    Permalink
    Definition Classes
    MetadataStore
  36. lazy val getStatsSchemaFromKVStore: TTLCache[(String, String), AvroCodec]

    Permalink
    Definition Classes
    MetadataStore
  37. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate()
  38. def instrumentAndLog(modelTransformsF: Future[Seq[ResponseWithContext]]): Future[Seq[Response]]

    Permalink
  39. def isCacheSizeConfigured: Boolean

    Permalink
    Definition Classes
    FetcherCache
  40. def isCachingEnabled(groupBy: GroupBy): Boolean

    Permalink
    Definition Classes
    FetcherBaseFetcherCache
  41. def isEntityValidityCheckEnabled: Boolean

    Permalink
    Definition Classes
    FetcherBase
  42. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  43. val kvStore: KVStore

    Permalink
  44. def logResponseInternal(resp: ResponseWithContext): ResponseWithContext

    Permalink
    Attributes
    protected
  45. implicit lazy val logger: Logger

    Permalink
    Definition Classes
    MetadataStore
  46. val maybeBatchIrCache: Option[BatchIrCache]

    Permalink
    Definition Classes
    FetcherCache
  47. val modelBackend: ModelBackend

    Permalink
  48. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  49. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate()
  50. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate()
  51. def parseGroupByResponse(prefix: String, groupByRequest: Request, responseMap: Map[Request, Try[Map[String, AnyRef]]]): Map[String, AnyRef]

    Permalink
    Definition Classes
    FetcherBase
  52. def put(kVPairs: Map[String, Seq[String]], datasetName: String = ChrononMetadataKey, batchSize: Int = CONF_BATCH_SIZE): Future[Seq[Boolean]]

    Permalink
    Definition Classes
    MetadataStore
  53. def putJoinConf(join: Join): Unit

    Permalink
    Definition Classes
    MetadataStore
  54. def reportKvResponse(ctx: Context, response: Seq[TimedValue], queryTsMillis: Long, latencyMillis: Long, totalResponseBytes: Int): Unit

    Permalink
    Definition Classes
    FetcherBase
  55. def setPartitionMeta(format: String): Unit

    Permalink
    Definition Classes
    MetadataStore
  56. def setPartitionMeta(format: String, spanMillis: Long): Unit

    Permalink
    Definition Classes
    MetadataStore
  57. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  58. def toBatchIr(bytes: Array[Byte], gbInfo: GroupByServingInfoParsed): FinalBatchIr

    Permalink

    Convert an array of bytes to a FinalBatchIr.

    Convert an array of bytes to a FinalBatchIr.

    Definition Classes
    FetcherBase
  59. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  60. def validateGroupByExist(team: String, name: String): Boolean

    Permalink
    Definition Classes
    MetadataStore
  61. def validateJoinExist(team: String, name: String): Boolean

    Permalink
    Definition Classes
    MetadataStore
  62. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  63. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  64. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from FetcherBase

Inherited from FetcherCache

Inherited from MetadataStore

Inherited from AnyRef

Inherited from Any

Ungrouped