Class/Object

ai.chronon.online

Fetcher

Related Docs: object Fetcher | package online

Permalink

class Fetcher extends FetcherBase

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Fetcher
  2. FetcherBase
  3. FetcherCache
  4. MetadataStore
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Fetcher(kvStore: KVStore, metaDataSet: String, timeoutMillis: Long = 10000, logFunc: Consumer[LoggableResponse] = null, debug: Boolean = false, externalSourceRegistry: ExternalSourceRegistry = null, callerName: String = null, flagStore: FlagStore = null, disableErrorThrows: Boolean = false, executionContextOverride: ExecutionContext = null, joinFetchParallelChunkSize: Option[Int] = None, modelBackend: ModelBackend = null)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. val batchIrCacheName: String

    Permalink
    Definition Classes
    FetcherCache
  6. def buildJoinCodec(joinConf: Join, refreshOnFail: Boolean): (JoinCodec, Boolean)

    Permalink
  7. val caffeineMetricsContext: Context

    Permalink
    Attributes
    protected
    Definition Classes
    FetcherCache
  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @throws( ... )
  9. val dataset: String

    Permalink
    Definition Classes
    MetadataStore
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. implicit val executionContext: ExecutionContext

    Permalink
    Definition Classes
    MetadataStore
  13. val externalSourceRegistry: ExternalSourceRegistry

    Permalink
  14. def fetchBaseJoin(requests: Seq[Request], joinConf: Option[Join]): Future[Seq[ResponseWithContext]]

    Permalink
  15. def fetchColumns(columnSpecs: Seq[ColumnSpec]): Future[Map[ColumnSpec, Response]]

    Permalink

    Fetch method to simulate a random access interface for Chronon by distributing requests to relevant GroupBys.

    Fetch method to simulate a random access interface for Chronon by distributing requests to relevant GroupBys. This is a batch API which allows the caller to provide a sequence of ColumnSpec queries and receive a mapping of results.

    TODO: Metrics TODO: Collection identifier for metrics TODO: Consider removing prefix interface for this method TODO: Consider using simpler response type since mapping is redundant

    columnSpecs

    – batch of ColumnSpec queries

    returns

    Future map of query to GroupBy response

    Definition Classes
    FetcherBase
  16. def fetchConsistencyMetricsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching OOC metrics stats or drifts.

  17. def fetchExternal(joinRequests: Seq[Request], joinConf: Option[Join] = None): Future[Seq[Response]]

    Permalink
  18. def fetchGroupBys(requests: Seq[Request]): Future[Seq[Response]]

    Permalink
    Definition Classes
    FetcherBase
  19. def fetchJoin(requests: Seq[Request], joinConf: Option[Join] = None): Future[Seq[Response]]

    Permalink
    Definition Classes
    FetcherFetcherBase
  20. def fetchJoinChunked(requests: Seq[Request], chunkSizeOverride: Int, joinConf: Option[Join] = None): Seq[Future[Seq[Response]]]

    Permalink
  21. def fetchLogStatsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching logging stats or drifts.

  22. def fetchModelTransforms(derivedValuesFuture: Future[Seq[ResponseWithContext]]): Future[Seq[ResponseWithContext]]

    Permalink
  23. def fetchStatsTimeseries(joinRequest: StatsRequest): Future[SeriesStatsResponse]

    Permalink

    Main endpoint for fetching backfill tables stats or drifts.

  24. def getCachedRequests(groupByRequestToKvRequest: Seq[(Request, Try[GroupByRequestMeta])]): Map[GetRequest, CachedBatchResponse]

    Permalink

    Given a list of GetRequests, return a map of GetRequests to cached FinalBatchIrs.

    Given a list of GetRequests, return a map of GetRequests to cached FinalBatchIrs.

    Definition Classes
    FetcherCache
  25. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate()
  26. def getConf[T <: TBase[_, _]](confPathOrName: String)(implicit arg0: Manifest[T]): Try[T]

    Permalink
    Definition Classes
    MetadataStore
  27. def getEntityListByTeam[T <: TBase[_, _]](team: String)(implicit arg0: Manifest[T]): Try[Seq[String]]

    Permalink
    Definition Classes
    MetadataStore
  28. lazy val getGroupByListByTeam: TTLCache[String, Try[Seq[String]]]

    Permalink
    Definition Classes
    MetadataStore
  29. lazy val getGroupByServingInfo: TTLCache[String, Try[GroupByServingInfoParsed]]

    Permalink
    Definition Classes
    MetadataStore
  30. lazy val getJoinCodecs: TTLCache[String, Try[(JoinCodec, Boolean)]]

    Permalink
  31. lazy val getJoinConf: TTLCache[String, Try[JoinOps]]

    Permalink
    Definition Classes
    MetadataStore
  32. lazy val getJoinListByTeam: TTLCache[String, Try[Seq[String]]]

    Permalink
    Definition Classes
    MetadataStore
  33. def getSchemaFromKVStore(dataset: String, key: String): AvroCodec

    Permalink
    Definition Classes
    MetadataStore
  34. lazy val getStatsSchemaFromKVStore: TTLCache[(String, String), AvroCodec]

    Permalink
    Definition Classes
    MetadataStore
  35. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate()
  36. def instrumentAndLog(modelTransformsF: Future[Seq[ResponseWithContext]]): Future[Seq[Response]]

    Permalink
  37. def isCacheSizeConfigured: Boolean

    Permalink
    Definition Classes
    FetcherCache
  38. def isCachingEnabled(groupBy: GroupBy): Boolean

    Permalink
    Definition Classes
    FetcherBaseFetcherCache
  39. def isEntityValidityCheckEnabled: Boolean

    Permalink
    Definition Classes
    FetcherBase
  40. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  41. val kvStore: KVStore

    Permalink
  42. implicit lazy val logger: Logger

    Permalink
    Definition Classes
    MetadataStore
  43. val maybeBatchIrCache: Option[BatchIrCache]

    Permalink
    Definition Classes
    FetcherCache
  44. val modelBackend: ModelBackend

    Permalink
  45. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  46. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate()
  47. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate()
  48. def parseGroupByResponse(prefix: String, groupByRequest: Request, responseMap: Map[Request, Try[Map[String, AnyRef]]]): Map[String, AnyRef]

    Permalink
    Definition Classes
    FetcherBase
  49. def put(kVPairs: Map[String, Seq[String]], datasetName: String = ChrononMetadataKey, batchSize: Int = CONF_BATCH_SIZE): Future[Seq[Boolean]]

    Permalink
    Definition Classes
    MetadataStore
  50. def putJoinConf(join: Join): Unit

    Permalink
    Definition Classes
    MetadataStore
  51. def reportKvResponse(ctx: Context, response: Seq[TimedValue], queryTsMillis: Long, latencyMillis: Long, totalResponseBytes: Int): Unit

    Permalink
    Definition Classes
    FetcherBase
  52. def setPartitionMeta(format: String): Unit

    Permalink
    Definition Classes
    MetadataStore
  53. def setPartitionMeta(format: String, spanMillis: Long): Unit

    Permalink
    Definition Classes
    MetadataStore
  54. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  55. def toBatchIr(bytes: Array[Byte], gbInfo: GroupByServingInfoParsed): FinalBatchIr

    Permalink

    Convert an array of bytes to a FinalBatchIr.

    Convert an array of bytes to a FinalBatchIr.

    Definition Classes
    FetcherBase
  56. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  57. def validateGroupByExist(team: String, name: String): Boolean

    Permalink
    Definition Classes
    MetadataStore
  58. def validateJoinExist(team: String, name: String): Boolean

    Permalink
    Definition Classes
    MetadataStore
  59. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  60. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  61. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from FetcherBase

Inherited from FetcherCache

Inherited from MetadataStore

Inherited from AnyRef

Inherited from Any

Ungrouped