Class PipeDocAcceptanceService
java.lang.Object
ai.pipestream.connector.intake.pipedoc.PipeDocAcceptanceService
Per-doc acceptance for the gRPC upload paths
(
bidi
and unary). Two responsibilities:
- Route inline documents according to
pipestream.intake.inline-handoff-mode. The defaultredismode enqueues topipestream:intake:ingress; compatibility modes can call the engine directly. - If
resolved.shouldPersist()is true: schedule a fire-and-forget durable copy viaIntakeReplayPersister. Runs on its own VT executor; failure logs but does not block, fail, or delay the engine handoff. Used for replay; not currently on any read path.
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionai.pipestream.connector.intake.v1.UploadPipeDocStreamResponseacceptStreamingItem(ai.pipestream.connector.intake.v1.PipeDocItem item, ai.pipestream.connector.intake.v1.StreamContext ctx, ConfigResolutionService.ResolvedConfig resolved) ai.pipestream.connector.intake.v1.UploadPipeDocResponseenqueueAndMaybePersist(ai.pipestream.data.v1.PipeDoc pipeDoc, ConfigResolutionService.ResolvedConfig resolved, String crawlId, long startTime) Accepts a fully-hydrated inline PipeDoc into the configured handoff path.
-
Constructor Details
-
PipeDocAcceptanceService
public PipeDocAcceptanceService()
-
-
Method Details
-
enqueueAndMaybePersist
public ai.pipestream.connector.intake.v1.UploadPipeDocResponse enqueueAndMaybePersist(ai.pipestream.data.v1.PipeDoc pipeDoc, ConfigResolutionService.ResolvedConfig resolved, String crawlId, long startTime) Accepts a fully-hydrated inline PipeDoc into the configured handoff path.Redis mode writes an
IntakeHandoffRequestto the intake ingress stream for the sidecar to drain. Compatibility modes call engine directly. In all modes, replay persistence is optional, asynchronous, and not part of the admission decision.- Parameters:
pipeDoc- document after doc-id derivation and ownership stampingresolved- datasource/account configuration for this requestcrawlId- optional crawl session identifierstartTime- start time from the transport handler, used for timing logs- Returns:
- upload response for the connector-facing API
-
acceptStreamingItem
public ai.pipestream.connector.intake.v1.UploadPipeDocStreamResponse acceptStreamingItem(ai.pipestream.connector.intake.v1.PipeDocItem item, ai.pipestream.connector.intake.v1.StreamContext ctx, ConfigResolutionService.ResolvedConfig resolved)
-