Record Class PipelineCrawlerResource.PipelineCrawlPayload

java.lang.Object

java.lang.Record

ai.pipestream.module.pipelineprobe.pipelinecrawl.PipelineCrawlerResource.PipelineCrawlPayload

Record Components:

source - the source type: "JDBC", "S3" or "SINGLE_DOC"

steps - the ordered pipeline steps, e.g. ["CHUNKER", "EMBEDDER", ...]

observeSteps - subset of steps to put in rich (observed) mode

persistSteps - subset of steps whose input body the engine retains for replay

edgeTransports - one transport per main-flow edge in canonical order ("GRPC" | "KAFKA" | "REDIS"); size must equal the number of edges produced after dependency cascade and JDBC parser-strip

accountId - optional account override (the intake account)

skipCleanup - when true, keep everything after the run instead of ninja-cleaning

retainIndex - when true, keep only the OS indices and their IndexPlan after the run; ignored when skipCleanup is set

parserConfig - parser node custom_config, authored verbatim onto the temporary graph's parser node; shape matches the parser's registered ParserConfig schema

separateIntakePipeline - when true, provision two accounts — datasource/intake under accountId and the pipeline graph under a separate cluster

pipelineAccountId - the separate pipeline-graph account when separateIntakePipeline is set; minted when absent

pollingTimeoutSeconds - optional override for the run polling timeout, in seconds

kafkaPartitions - optional override for the number of Kafka partitions

jdbc - JDBC-specific config (only meaningful when source is "JDBC")

singleDoc - SINGLE_DOC-specific config (only meaningful when source is "SINGLE_DOC")

s3 - S3-specific config (only meaningful when source is "S3")

Enclosing class:

PipelineCrawlerResource

public static record PipelineCrawlerResource.PipelineCrawlPayload(String source, List<String> steps, List<String> observeSteps, List<String> persistSteps, List<String> edgeTransports, String accountId, boolean skipCleanup, boolean retainIndex, Map<String,Object> parserConfig, Boolean separateIntakePipeline, String pipelineAccountId, Integer pollingTimeoutSeconds, Integer kafkaPartitions, PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload jdbc, PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload singleDoc, PipelineCrawlerResource.PipelineCrawlPayload.S3Payload s3)
extends Record

FE-facing payload. Compact JSON shape — mirrors the proto fields the Pipeline tab cares about, with optional source-specific blobs we forward verbatim. Keeps the FE free of full-proto JSON serialization.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload	JDBC source payload.
static final record	PipelineCrawlerResource.PipelineCrawlPayload.S3Payload	S3 source payload.
static final record	PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload	SINGLE_DOC source payload.

Constructor Summary

Constructors

Constructor

Description

PipelineCrawlPayload(String source, List<String> steps, List<String> observeSteps, List<String> persistSteps, List<String> edgeTransports, String accountId, boolean skipCleanup, boolean retainIndex, Map<String,Object> parserConfig, Boolean separateIntakePipeline, String pipelineAccountId, Integer pollingTimeoutSeconds, Integer kafkaPartitions, PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload jdbc, PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload singleDoc, PipelineCrawlerResource.PipelineCrawlPayload.S3Payload s3)

Creates an instance of a PipelineCrawlPayload record class.

Method Summary

Modifier and Type	Method	Description
String	accountId()	Returns the value of the accountId record component.
List<String>	edgeTransports()	Returns the value of the edgeTransports record component.
final boolean	equals(Object o)	Indicates whether some other object is "equal to" this one.
final int	hashCode()	Returns a hash code value for this object.
PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload	jdbc()	Returns the value of the jdbc record component.
Integer	kafkaPartitions()	Returns the value of the kafkaPartitions record component.
List<String>	observeSteps()	Returns the value of the observeSteps record component.
Map<String,Object>	parserConfig()	Returns the value of the parserConfig record component.
List<String>	persistSteps()	Returns the value of the persistSteps record component.
String	pipelineAccountId()	Returns the value of the pipelineAccountId record component.
Integer	pollingTimeoutSeconds()	Returns the value of the pollingTimeoutSeconds record component.
boolean	retainIndex()	Returns the value of the retainIndex record component.
PipelineCrawlerResource.PipelineCrawlPayload.S3Payload	s3()	Returns the value of the s3 record component.
Boolean	separateIntakePipeline()	Returns the value of the separateIntakePipeline record component.
PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload	singleDoc()	Returns the value of the singleDoc record component.
boolean	skipCleanup()	Returns the value of the skipCleanup record component.
String	source()	Returns the value of the source record component.
List<String>	steps()	Returns the value of the steps record component.
final String	toString()	Returns a string representation of this record class.

Methods inherited from class Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

PipelineCrawlPayload

public PipelineCrawlPayload(String source,
 List<String> steps,
 List<String> observeSteps,
 List<String> persistSteps,
 List<String> edgeTransports,
 String accountId,
 boolean skipCleanup,
 boolean retainIndex,
 Map<String,Object> parserConfig,
 Boolean separateIntakePipeline,
 String pipelineAccountId,
 Integer pollingTimeoutSeconds,
 Integer kafkaPartitions,
 PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload jdbc,
 PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload singleDoc,
 PipelineCrawlerResource.PipelineCrawlPayload.S3Payload s3)

Creates an instance of a PipelineCrawlPayload record class.

Parameters:

source - the value for the source record component

steps - the value for the steps record component

observeSteps - the value for the observeSteps record component

persistSteps - the value for the persistSteps record component

edgeTransports - the value for the edgeTransports record component

accountId - the value for the accountId record component

skipCleanup - the value for the skipCleanup record component

retainIndex - the value for the retainIndex record component

parserConfig - the value for the parserConfig record component

separateIntakePipeline - the value for the separateIntakePipeline record component

pipelineAccountId - the value for the pipelineAccountId record component

pollingTimeoutSeconds - the value for the pollingTimeoutSeconds record component

kafkaPartitions - the value for the kafkaPartitions record component

jdbc - the value for the jdbc record component

singleDoc - the value for the singleDoc record component

s3 - the value for the s3 record component

Method Details

toString

public final String toString()

Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.

Specified by:

toString in class Record

Returns:

a string representation of this object

hashCode

public final int hashCode()

Returns a hash code value for this object. The value is derived from the hash code of each of the record components.

Specified by:

hashCode in class Record

Returns:

a hash code value for this object

equals

public final boolean equals(Object o)

Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with the compare method from their corresponding wrapper classes.

Specified by:

equals in class Record

Parameters:

o - the object with which to compare

Returns:

true if this object is the same as the o argument; false otherwise.

source

public String source()

Returns the value of the source record component.

Returns:

the value of the source record component

steps

public List<String> steps()

Returns the value of the steps record component.

Returns:

the value of the steps record component

observeSteps

public List<String> observeSteps()

Returns the value of the observeSteps record component.

Returns:

the value of the observeSteps record component

persistSteps

public List<String> persistSteps()

Returns the value of the persistSteps record component.

Returns:

the value of the persistSteps record component

edgeTransports

public List<String> edgeTransports()

Returns the value of the edgeTransports record component.

Returns:

the value of the edgeTransports record component

accountId

public String accountId()

Returns the value of the accountId record component.

Returns:

the value of the accountId record component

skipCleanup

public boolean skipCleanup()

Returns the value of the skipCleanup record component.

Returns:

the value of the skipCleanup record component

retainIndex

public boolean retainIndex()

Returns the value of the retainIndex record component.

Returns:

the value of the retainIndex record component

parserConfig

public Map<String,Object> parserConfig()

Returns the value of the parserConfig record component.

Returns:

the value of the parserConfig record component

separateIntakePipeline

public Boolean separateIntakePipeline()

Returns the value of the separateIntakePipeline record component.

Returns:

the value of the separateIntakePipeline record component

pipelineAccountId

public String pipelineAccountId()

Returns the value of the pipelineAccountId record component.

Returns:

the value of the pipelineAccountId record component

pollingTimeoutSeconds

public Integer pollingTimeoutSeconds()

Returns the value of the pollingTimeoutSeconds record component.

Returns:

the value of the pollingTimeoutSeconds record component

kafkaPartitions

public Integer kafkaPartitions()

Returns the value of the kafkaPartitions record component.

Returns:

the value of the kafkaPartitions record component

jdbc

public PipelineCrawlerResource.PipelineCrawlPayload.JdbcPayload jdbc()

Returns the value of the jdbc record component.

Returns:

the value of the jdbc record component

singleDoc

public PipelineCrawlerResource.PipelineCrawlPayload.SingleDocPayload singleDoc()

Returns the value of the singleDoc record component.

Returns:

the value of the singleDoc record component

s3

public PipelineCrawlerResource.PipelineCrawlPayload.S3Payload s3()

Returns the value of the s3 record component.

Returns:

the value of the s3 record component