Package ai.pipestream.module.pipelineprobe.moduletest.engineperf
package ai.pipestream.module.pipelineprobe.moduletest.engineperf
-
ClassDescriptionOne open bidi stream to connector-intake's
uploadPipeDocStream— the SAME protocol the JDBC connector speaks (IntakeCrawlStreamis the reference implementation):StreamContexthandshake first (datasource + api key + crawl_id), then onePipeDocItemper doc with per-doc acks; backpressure is HTTP/2 native.Per-doc intake outcome.Engine-path perf (Test 2): the sidecar acts as its OWN connector and pushes corpus docs through the production front door — connector-intake'suploadPipeDocStream— so the engine does everything it does for a real crawl: claim-check staging, fan-out to the subscribed graph, work dispensing over the bidi work stream, and the module's own worker loop self-ramps against the backlog.