Package ai.pipestream.parsed.data.warc.v1

Class WarcMetadata.Builder

java.lang.Object
com.google.protobuf.AbstractMessageLite.Builder
com.google.protobuf.AbstractMessage.Builder<WarcMetadata.Builder>
com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder>
ai.pipestream.parsed.data.warc.v1.WarcMetadata.Builder
All Implemented Interfaces:
WarcMetadataOrBuilder, com.google.protobuf.Message.Builder, com.google.protobuf.MessageLite.Builder, com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder, Cloneable
Enclosing class:
WarcMetadata
public static final class WarcMetadata.Builder extends com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder> implements WarcMetadataOrBuilder
 Comprehensive WARC (Web ARChive) metadata as extracted by Tika from WARC and ARC files.
 Based on Tika's WARC interface, WARCParser implementation, and WARC/ARC specifications.
 This is a 1:1 mapping to all fields that Tika can extract from web archive files.
 WARC files are the standard format for web archiving, containing:
 - Web pages and their resources
 - HTTP request/response pairs
 - Metadata about the crawl process
 - Relationships between archived resources
 Critical for digital preservation and web content analysis.
Protobuf type ai.pipestream.parsed.data.warc.v1.WarcMetadata

  • Method Details

    • getDescriptor

      public static final com.google.protobuf.Descriptors.Descriptor getDescriptor()

    • internalGetFieldAccessorTable

      protected com.google.protobuf.GeneratedMessage.FieldAccessorTable internalGetFieldAccessorTable()
      Specified by:
      internalGetFieldAccessorTable in class com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder>

    • clear

      public WarcMetadata.Builder clear()
      Specified by:
      clear in interface com.google.protobuf.Message.Builder
      Specified by:
      clear in interface com.google.protobuf.MessageLite.Builder
      Overrides:
      clear in class com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder>

    • getDescriptorForType

      public com.google.protobuf.Descriptors.Descriptor getDescriptorForType()
      Specified by:
      getDescriptorForType in interface com.google.protobuf.Message.Builder
      Specified by:
      getDescriptorForType in interface com.google.protobuf.MessageOrBuilder
      Overrides:
      getDescriptorForType in class com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder>

    • getDefaultInstanceForType

      public WarcMetadata getDefaultInstanceForType()
      Specified by:
      getDefaultInstanceForType in interface com.google.protobuf.MessageLiteOrBuilder
      Specified by:
      getDefaultInstanceForType in interface com.google.protobuf.MessageOrBuilder

    • build

      public WarcMetadata build()
      Specified by:
      build in interface com.google.protobuf.Message.Builder
      Specified by:
      build in interface com.google.protobuf.MessageLite.Builder

    • buildPartial

      public WarcMetadata buildPartial()
      Specified by:
      buildPartial in interface com.google.protobuf.Message.Builder
      Specified by:
      buildPartial in interface com.google.protobuf.MessageLite.Builder

    • mergeFrom

      public WarcMetadata.Builder mergeFrom(com.google.protobuf.Message other)
      Specified by:
      mergeFrom in interface com.google.protobuf.Message.Builder
      Overrides:
      mergeFrom in class com.google.protobuf.AbstractMessage.Builder<WarcMetadata.Builder>

    • mergeFrom

      public WarcMetadata.Builder mergeFrom(WarcMetadata other)

    • isInitialized

      public final boolean isInitialized()
      Specified by:
      isInitialized in interface com.google.protobuf.MessageLiteOrBuilder
      Overrides:
      isInitialized in class com.google.protobuf.GeneratedMessage.Builder<WarcMetadata.Builder>

    • mergeFrom

      public WarcMetadata.Builder mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
      Specified by:
      mergeFrom in interface com.google.protobuf.Message.Builder
      Specified by:
      mergeFrom in interface com.google.protobuf.MessageLite.Builder
      Overrides:
      mergeFrom in class com.google.protobuf.AbstractMessage.Builder<WarcMetadata.Builder>
      Throws:
      IOException

    • getWarcWarningsList

      public com.google.protobuf.ProtocolStringList getWarcWarningsList()
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Specified by:
      getWarcWarningsList in interface WarcMetadataOrBuilder
      Returns:
      A list containing the warcWarnings.

    • getWarcWarningsCount

      public int getWarcWarningsCount()
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Specified by:
      getWarcWarningsCount in interface WarcMetadataOrBuilder
      Returns:
      The count of warcWarnings.

    • getWarcWarnings

      public String getWarcWarnings(int index)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Specified by:
      getWarcWarnings in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the element to return.
      Returns:
      The warcWarnings at the given index.

    • getWarcWarningsBytes

      public com.google.protobuf.ByteString getWarcWarningsBytes(int index)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Specified by:
      getWarcWarningsBytes in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the warcWarnings at the given index.

    • setWarcWarnings

      public WarcMetadata.Builder setWarcWarnings(int index, String value)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Parameters:
      index - The index to set the value at.
      value - The warcWarnings to set.
      Returns:
      This builder for chaining.

    • addWarcWarnings

      public WarcMetadata.Builder addWarcWarnings(String value)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Parameters:
      value - The warcWarnings to add.
      Returns:
      This builder for chaining.

    • addAllWarcWarnings

      public WarcMetadata.Builder addAllWarcWarnings(Iterable<String> values)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Parameters:
      values - The warcWarnings to add.
      Returns:
      This builder for chaining.

    • clearWarcWarnings

      public WarcMetadata.Builder clearWarcWarnings()
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Returns:
      This builder for chaining.

    • addWarcWarningsBytes

      public WarcMetadata.Builder addWarcWarningsBytes(com.google.protobuf.ByteString value)
       WARC warnings encountered during parsing
 Multiple warnings can be present
 WARC.WARC_WARNING
      repeated string warc_warnings = 1 [json_name = "warcWarnings"];
      Parameters:
      value - The bytes of the warcWarnings to add.
      Returns:
      This builder for chaining.

    • hasWarcRecordContentType

      public boolean hasWarcRecordContentType()
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Specified by:
      hasWarcRecordContentType in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcRecordContentType field is set.

    • getWarcRecordContentType

      public String getWarcRecordContentType()
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Specified by:
      getWarcRecordContentType in interface WarcMetadataOrBuilder
      Returns:
      The warcRecordContentType.

    • getWarcRecordContentTypeBytes

      public com.google.protobuf.ByteString getWarcRecordContentTypeBytes()
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Specified by:
      getWarcRecordContentTypeBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcRecordContentType.

    • setWarcRecordContentType

      public WarcMetadata.Builder setWarcRecordContentType(String value)
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Parameters:
      value - The warcRecordContentType to set.
      Returns:
      This builder for chaining.

    • clearWarcRecordContentType

      public WarcMetadata.Builder clearWarcRecordContentType()
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Returns:
      This builder for chaining.

    • setWarcRecordContentTypeBytes

      public WarcMetadata.Builder setWarcRecordContentTypeBytes(com.google.protobuf.ByteString value)
       Content type of the WARC record itself
 e.g., "application/http; msgtype=response"
 WARC.WARC_RECORD_CONTENT_TYPE
      optional string warc_record_content_type = 2 [json_name = "warcRecordContentType"];
      Parameters:
      value - The bytes for warcRecordContentType to set.
      Returns:
      This builder for chaining.

    • hasWarcPayloadContentType

      public boolean hasWarcPayloadContentType()
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Specified by:
      hasWarcPayloadContentType in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcPayloadContentType field is set.

    • getWarcPayloadContentType

      public String getWarcPayloadContentType()
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Specified by:
      getWarcPayloadContentType in interface WarcMetadataOrBuilder
      Returns:
      The warcPayloadContentType.

    • getWarcPayloadContentTypeBytes

      public com.google.protobuf.ByteString getWarcPayloadContentTypeBytes()
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Specified by:
      getWarcPayloadContentTypeBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcPayloadContentType.

    • setWarcPayloadContentType

      public WarcMetadata.Builder setWarcPayloadContentType(String value)
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Parameters:
      value - The warcPayloadContentType to set.
      Returns:
      This builder for chaining.

    • clearWarcPayloadContentType

      public WarcMetadata.Builder clearWarcPayloadContentType()
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Returns:
      This builder for chaining.

    • setWarcPayloadContentTypeBytes

      public WarcMetadata.Builder setWarcPayloadContentTypeBytes(com.google.protobuf.ByteString value)
       Content type of the payload within the WARC record
 e.g., "text/html", "image/jpeg"
 WARC.WARC_PAYLOAD_CONTENT_TYPE
      optional string warc_payload_content_type = 3 [json_name = "warcPayloadContentType"];
      Parameters:
      value - The bytes for warcPayloadContentType to set.
      Returns:
      This builder for chaining.

    • hasWarcRecordId

      public boolean hasWarcRecordId()
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Specified by:
      hasWarcRecordId in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcRecordId field is set.

    • getWarcRecordId

      public String getWarcRecordId()
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Specified by:
      getWarcRecordId in interface WarcMetadataOrBuilder
      Returns:
      The warcRecordId.

    • getWarcRecordIdBytes

      public com.google.protobuf.ByteString getWarcRecordIdBytes()
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Specified by:
      getWarcRecordIdBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcRecordId.

    • setWarcRecordId

      public WarcMetadata.Builder setWarcRecordId(String value)
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Parameters:
      value - The warcRecordId to set.
      Returns:
      This builder for chaining.

    • clearWarcRecordId

      public WarcMetadata.Builder clearWarcRecordId()
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Returns:
      This builder for chaining.

    • setWarcRecordIdBytes

      public WarcMetadata.Builder setWarcRecordIdBytes(com.google.protobuf.ByteString value)
       Unique identifier for this WARC record
 Format: <urn:uuid:...> or similar URI
 WARC.WARC_RECORD_ID
      optional string warc_record_id = 4 [json_name = "warcRecordId"];
      Parameters:
      value - The bytes for warcRecordId to set.
      Returns:
      This builder for chaining.

    • hasWarcType

      public boolean hasWarcType()
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Specified by:
      hasWarcType in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcType field is set.

    • getWarcType

      public String getWarcType()
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Specified by:
      getWarcType in interface WarcMetadataOrBuilder
      Returns:
      The warcType.

    • getWarcTypeBytes

      public com.google.protobuf.ByteString getWarcTypeBytes()
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Specified by:
      getWarcTypeBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcType.

    • setWarcType

      public WarcMetadata.Builder setWarcType(String value)
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Parameters:
      value - The warcType to set.
      Returns:
      This builder for chaining.

    • clearWarcType

      public WarcMetadata.Builder clearWarcType()
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Returns:
      This builder for chaining.

    • setWarcTypeBytes

      public WarcMetadata.Builder setWarcTypeBytes(com.google.protobuf.ByteString value)
       Type of WARC record (response, request, metadata, resource, etc.)
 WARC-Type header
      optional string warc_type = 5 [json_name = "warcType"];
      Parameters:
      value - The bytes for warcType to set.
      Returns:
      This builder for chaining.

    • hasWarcTargetUri

      public boolean hasWarcTargetUri()
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Specified by:
      hasWarcTargetUri in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcTargetUri field is set.

    • getWarcTargetUri

      public String getWarcTargetUri()
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Specified by:
      getWarcTargetUri in interface WarcMetadataOrBuilder
      Returns:
      The warcTargetUri.

    • getWarcTargetUriBytes

      public com.google.protobuf.ByteString getWarcTargetUriBytes()
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Specified by:
      getWarcTargetUriBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcTargetUri.

    • setWarcTargetUri

      public WarcMetadata.Builder setWarcTargetUri(String value)
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Parameters:
      value - The warcTargetUri to set.
      Returns:
      This builder for chaining.

    • clearWarcTargetUri

      public WarcMetadata.Builder clearWarcTargetUri()
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Returns:
      This builder for chaining.

    • setWarcTargetUriBytes

      public WarcMetadata.Builder setWarcTargetUriBytes(com.google.protobuf.ByteString value)
       Target URI that was archived
 The original URL of the web resource
 WARC-Target-URI
      optional string warc_target_uri = 6 [json_name = "warcTargetUri"];
      Parameters:
      value - The bytes for warcTargetUri to set.
      Returns:
      This builder for chaining.

    • hasWarcDate

      public boolean hasWarcDate()
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];
      Specified by:
      hasWarcDate in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcDate field is set.

    • getWarcDate

      public com.google.protobuf.Timestamp getWarcDate()
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];
      Specified by:
      getWarcDate in interface WarcMetadataOrBuilder
      Returns:
      The warcDate.

    • setWarcDate

      public WarcMetadata.Builder setWarcDate(com.google.protobuf.Timestamp value)
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];

    • setWarcDate

      public WarcMetadata.Builder setWarcDate(com.google.protobuf.Timestamp.Builder builderForValue)
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];

    • mergeWarcDate

      public WarcMetadata.Builder mergeWarcDate(com.google.protobuf.Timestamp value)
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];

    • clearWarcDate

      public WarcMetadata.Builder clearWarcDate()
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];

    • getWarcDateBuilder

      public com.google.protobuf.Timestamp.Builder getWarcDateBuilder()
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];

    • getWarcDateOrBuilder

      public com.google.protobuf.TimestampOrBuilder getWarcDateOrBuilder()
       Date and time when the resource was captured
 WARC-Date
      optional .google.protobuf.Timestamp warc_date = 7 [json_name = "warcDate"];
      Specified by:
      getWarcDateOrBuilder in interface WarcMetadataOrBuilder

    • hasWarcContentLength

      public boolean hasWarcContentLength()
       Length of the record payload in bytes
 Content-Length
      optional int64 warc_content_length = 8 [json_name = "warcContentLength"];
      Specified by:
      hasWarcContentLength in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcContentLength field is set.

    • getWarcContentLength

      public long getWarcContentLength()
       Length of the record payload in bytes
 Content-Length
      optional int64 warc_content_length = 8 [json_name = "warcContentLength"];
      Specified by:
      getWarcContentLength in interface WarcMetadataOrBuilder
      Returns:
      The warcContentLength.

    • setWarcContentLength

      public WarcMetadata.Builder setWarcContentLength(long value)
       Length of the record payload in bytes
 Content-Length
      optional int64 warc_content_length = 8 [json_name = "warcContentLength"];
      Parameters:
      value - The warcContentLength to set.
      Returns:
      This builder for chaining.

    • clearWarcContentLength

      public WarcMetadata.Builder clearWarcContentLength()
       Length of the record payload in bytes
 Content-Length
      optional int64 warc_content_length = 8 [json_name = "warcContentLength"];
      Returns:
      This builder for chaining.

    • hasWarcFilename

      public boolean hasWarcFilename()
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Specified by:
      hasWarcFilename in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcFilename field is set.

    • getWarcFilename

      public String getWarcFilename()
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Specified by:
      getWarcFilename in interface WarcMetadataOrBuilder
      Returns:
      The warcFilename.

    • getWarcFilenameBytes

      public com.google.protobuf.ByteString getWarcFilenameBytes()
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Specified by:
      getWarcFilenameBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcFilename.

    • setWarcFilename

      public WarcMetadata.Builder setWarcFilename(String value)
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Parameters:
      value - The warcFilename to set.
      Returns:
      This builder for chaining.

    • clearWarcFilename

      public WarcMetadata.Builder clearWarcFilename()
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Returns:
      This builder for chaining.

    • setWarcFilenameBytes

      public WarcMetadata.Builder setWarcFilenameBytes(com.google.protobuf.ByteString value)
       WARC filename where this record is stored
 WARC-Filename
      optional string warc_filename = 9 [json_name = "warcFilename"];
      Parameters:
      value - The bytes for warcFilename to set.
      Returns:
      This builder for chaining.

    • hasWarcRefersTo

      public boolean hasWarcRefersTo()
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Specified by:
      hasWarcRefersTo in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcRefersTo field is set.

    • getWarcRefersTo

      public String getWarcRefersTo()
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Specified by:
      getWarcRefersTo in interface WarcMetadataOrBuilder
      Returns:
      The warcRefersTo.

    • getWarcRefersToBytes

      public com.google.protobuf.ByteString getWarcRefersToBytes()
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Specified by:
      getWarcRefersToBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcRefersTo.

    • setWarcRefersTo

      public WarcMetadata.Builder setWarcRefersTo(String value)
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Parameters:
      value - The warcRefersTo to set.
      Returns:
      This builder for chaining.

    • clearWarcRefersTo

      public WarcMetadata.Builder clearWarcRefersTo()
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Returns:
      This builder for chaining.

    • setWarcRefersToBytes

      public WarcMetadata.Builder setWarcRefersToBytes(com.google.protobuf.ByteString value)
       WARC record ID that this record refers to
 Used for linking related records
 WARC-Refers-To
      optional string warc_refers_to = 10 [json_name = "warcRefersTo"];
      Parameters:
      value - The bytes for warcRefersTo to set.
      Returns:
      This builder for chaining.

    • hasWarcConcurrentTo

      public boolean hasWarcConcurrentTo()
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Specified by:
      hasWarcConcurrentTo in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcConcurrentTo field is set.

    • getWarcConcurrentTo

      public String getWarcConcurrentTo()
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Specified by:
      getWarcConcurrentTo in interface WarcMetadataOrBuilder
      Returns:
      The warcConcurrentTo.

    • getWarcConcurrentToBytes

      public com.google.protobuf.ByteString getWarcConcurrentToBytes()
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Specified by:
      getWarcConcurrentToBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcConcurrentTo.

    • setWarcConcurrentTo

      public WarcMetadata.Builder setWarcConcurrentTo(String value)
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Parameters:
      value - The warcConcurrentTo to set.
      Returns:
      This builder for chaining.

    • clearWarcConcurrentTo

      public WarcMetadata.Builder clearWarcConcurrentTo()
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Returns:
      This builder for chaining.

    • setWarcConcurrentToBytes

      public WarcMetadata.Builder setWarcConcurrentToBytes(com.google.protobuf.ByteString value)
       WARC record ID that this record is concurrent with
 WARC-Concurrent-To
      optional string warc_concurrent_to = 11 [json_name = "warcConcurrentTo"];
      Parameters:
      value - The bytes for warcConcurrentTo to set.
      Returns:
      This builder for chaining.

    • hasWarcWarcinfoId

      public boolean hasWarcWarcinfoId()
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Specified by:
      hasWarcWarcinfoId in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcWarcinfoId field is set.

    • getWarcWarcinfoId

      public String getWarcWarcinfoId()
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Specified by:
      getWarcWarcinfoId in interface WarcMetadataOrBuilder
      Returns:
      The warcWarcinfoId.

    • getWarcWarcinfoIdBytes

      public com.google.protobuf.ByteString getWarcWarcinfoIdBytes()
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Specified by:
      getWarcWarcinfoIdBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcWarcinfoId.

    • setWarcWarcinfoId

      public WarcMetadata.Builder setWarcWarcinfoId(String value)
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Parameters:
      value - The warcWarcinfoId to set.
      Returns:
      This builder for chaining.

    • clearWarcWarcinfoId

      public WarcMetadata.Builder clearWarcWarcinfoId()
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Returns:
      This builder for chaining.

    • setWarcWarcinfoIdBytes

      public WarcMetadata.Builder setWarcWarcinfoIdBytes(com.google.protobuf.ByteString value)
       WARC record ID of the warcinfo record for this crawl
 WARC-Warcinfo-ID
      optional string warc_warcinfo_id = 12 [json_name = "warcWarcinfoId"];
      Parameters:
      value - The bytes for warcWarcinfoId to set.
      Returns:
      This builder for chaining.

    • hasWarcIpAddress

      public boolean hasWarcIpAddress()
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Specified by:
      hasWarcIpAddress in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcIpAddress field is set.

    • getWarcIpAddress

      public String getWarcIpAddress()
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Specified by:
      getWarcIpAddress in interface WarcMetadataOrBuilder
      Returns:
      The warcIpAddress.

    • getWarcIpAddressBytes

      public com.google.protobuf.ByteString getWarcIpAddressBytes()
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Specified by:
      getWarcIpAddressBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcIpAddress.

    • setWarcIpAddress

      public WarcMetadata.Builder setWarcIpAddress(String value)
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Parameters:
      value - The warcIpAddress to set.
      Returns:
      This builder for chaining.

    • clearWarcIpAddress

      public WarcMetadata.Builder clearWarcIpAddress()
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Returns:
      This builder for chaining.

    • setWarcIpAddressBytes

      public WarcMetadata.Builder setWarcIpAddressBytes(com.google.protobuf.ByteString value)
       IP address of the server that provided this resource
 WARC-IP-Address
      optional string warc_ip_address = 13 [json_name = "warcIpAddress"];
      Parameters:
      value - The bytes for warcIpAddress to set.
      Returns:
      This builder for chaining.

    • hasWarcBlockDigest

      public boolean hasWarcBlockDigest()
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Specified by:
      hasWarcBlockDigest in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcBlockDigest field is set.

    • getWarcBlockDigest

      public String getWarcBlockDigest()
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Specified by:
      getWarcBlockDigest in interface WarcMetadataOrBuilder
      Returns:
      The warcBlockDigest.

    • getWarcBlockDigestBytes

      public com.google.protobuf.ByteString getWarcBlockDigestBytes()
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Specified by:
      getWarcBlockDigestBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcBlockDigest.

    • setWarcBlockDigest

      public WarcMetadata.Builder setWarcBlockDigest(String value)
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Parameters:
      value - The warcBlockDigest to set.
      Returns:
      This builder for chaining.

    • clearWarcBlockDigest

      public WarcMetadata.Builder clearWarcBlockDigest()
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Returns:
      This builder for chaining.

    • setWarcBlockDigestBytes

      public WarcMetadata.Builder setWarcBlockDigestBytes(com.google.protobuf.ByteString value)
       Block digest (hash) of the payload
 WARC-Block-Digest
      optional string warc_block_digest = 14 [json_name = "warcBlockDigest"];
      Parameters:
      value - The bytes for warcBlockDigest to set.
      Returns:
      This builder for chaining.

    • hasWarcPayloadDigest

      public boolean hasWarcPayloadDigest()
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Specified by:
      hasWarcPayloadDigest in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcPayloadDigest field is set.

    • getWarcPayloadDigest

      public String getWarcPayloadDigest()
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Specified by:
      getWarcPayloadDigest in interface WarcMetadataOrBuilder
      Returns:
      The warcPayloadDigest.

    • getWarcPayloadDigestBytes

      public com.google.protobuf.ByteString getWarcPayloadDigestBytes()
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Specified by:
      getWarcPayloadDigestBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcPayloadDigest.

    • setWarcPayloadDigest

      public WarcMetadata.Builder setWarcPayloadDigest(String value)
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Parameters:
      value - The warcPayloadDigest to set.
      Returns:
      This builder for chaining.

    • clearWarcPayloadDigest

      public WarcMetadata.Builder clearWarcPayloadDigest()
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Returns:
      This builder for chaining.

    • setWarcPayloadDigestBytes

      public WarcMetadata.Builder setWarcPayloadDigestBytes(com.google.protobuf.ByteString value)
       Payload digest (hash) of the actual content
 WARC-Payload-Digest
      optional string warc_payload_digest = 15 [json_name = "warcPayloadDigest"];
      Parameters:
      value - The bytes for warcPayloadDigest to set.
      Returns:
      This builder for chaining.

    • hasWarcTruncated

      public boolean hasWarcTruncated()
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Specified by:
      hasWarcTruncated in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcTruncated field is set.

    • getWarcTruncated

      public String getWarcTruncated()
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Specified by:
      getWarcTruncated in interface WarcMetadataOrBuilder
      Returns:
      The warcTruncated.

    • getWarcTruncatedBytes

      public com.google.protobuf.ByteString getWarcTruncatedBytes()
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Specified by:
      getWarcTruncatedBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcTruncated.

    • setWarcTruncated

      public WarcMetadata.Builder setWarcTruncated(String value)
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Parameters:
      value - The warcTruncated to set.
      Returns:
      This builder for chaining.

    • clearWarcTruncated

      public WarcMetadata.Builder clearWarcTruncated()
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Returns:
      This builder for chaining.

    • setWarcTruncatedBytes

      public WarcMetadata.Builder setWarcTruncatedBytes(com.google.protobuf.ByteString value)
       Truncation reason if record was truncated
 WARC-Truncated
      optional string warc_truncated = 16 [json_name = "warcTruncated"];
      Parameters:
      value - The bytes for warcTruncated to set.
      Returns:
      This builder for chaining.

    • hasWarcIdentifiedPayloadType

      public boolean hasWarcIdentifiedPayloadType()
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Specified by:
      hasWarcIdentifiedPayloadType in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcIdentifiedPayloadType field is set.

    • getWarcIdentifiedPayloadType

      public String getWarcIdentifiedPayloadType()
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Specified by:
      getWarcIdentifiedPayloadType in interface WarcMetadataOrBuilder
      Returns:
      The warcIdentifiedPayloadType.

    • getWarcIdentifiedPayloadTypeBytes

      public com.google.protobuf.ByteString getWarcIdentifiedPayloadTypeBytes()
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Specified by:
      getWarcIdentifiedPayloadTypeBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcIdentifiedPayloadType.

    • setWarcIdentifiedPayloadType

      public WarcMetadata.Builder setWarcIdentifiedPayloadType(String value)
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Parameters:
      value - The warcIdentifiedPayloadType to set.
      Returns:
      This builder for chaining.

    • clearWarcIdentifiedPayloadType

      public WarcMetadata.Builder clearWarcIdentifiedPayloadType()
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Returns:
      This builder for chaining.

    • setWarcIdentifiedPayloadTypeBytes

      public WarcMetadata.Builder setWarcIdentifiedPayloadTypeBytes(com.google.protobuf.ByteString value)
       Identified payload type (may differ from Content-Type)
 WARC-Identified-Payload-Type
      optional string warc_identified_payload_type = 17 [json_name = "warcIdentifiedPayloadType"];
      Parameters:
      value - The bytes for warcIdentifiedPayloadType to set.
      Returns:
      This builder for chaining.

    • hasHttpStatusCode

      public boolean hasHttpStatusCode()
       HTTP status code (200, 404, 500, etc.)
 HTTP status
      optional int32 http_status_code = 18 [json_name = "httpStatusCode"];
      Specified by:
      hasHttpStatusCode in interface WarcMetadataOrBuilder
      Returns:
      Whether the httpStatusCode field is set.

    • getHttpStatusCode

      public int getHttpStatusCode()
       HTTP status code (200, 404, 500, etc.)
 HTTP status
      optional int32 http_status_code = 18 [json_name = "httpStatusCode"];
      Specified by:
      getHttpStatusCode in interface WarcMetadataOrBuilder
      Returns:
      The httpStatusCode.

    • setHttpStatusCode

      public WarcMetadata.Builder setHttpStatusCode(int value)
       HTTP status code (200, 404, 500, etc.)
 HTTP status
      optional int32 http_status_code = 18 [json_name = "httpStatusCode"];
      Parameters:
      value - The httpStatusCode to set.
      Returns:
      This builder for chaining.

    • clearHttpStatusCode

      public WarcMetadata.Builder clearHttpStatusCode()
       HTTP status code (200, 404, 500, etc.)
 HTTP status
      optional int32 http_status_code = 18 [json_name = "httpStatusCode"];
      Returns:
      This builder for chaining.

    • hasHttpStatusReason

      public boolean hasHttpStatusReason()
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Specified by:
      hasHttpStatusReason in interface WarcMetadataOrBuilder
      Returns:
      Whether the httpStatusReason field is set.

    • getHttpStatusReason

      public String getHttpStatusReason()
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Specified by:
      getHttpStatusReason in interface WarcMetadataOrBuilder
      Returns:
      The httpStatusReason.

    • getHttpStatusReasonBytes

      public com.google.protobuf.ByteString getHttpStatusReasonBytes()
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Specified by:
      getHttpStatusReasonBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for httpStatusReason.

    • setHttpStatusReason

      public WarcMetadata.Builder setHttpStatusReason(String value)
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Parameters:
      value - The httpStatusReason to set.
      Returns:
      This builder for chaining.

    • clearHttpStatusReason

      public WarcMetadata.Builder clearHttpStatusReason()
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Returns:
      This builder for chaining.

    • setHttpStatusReasonBytes

      public WarcMetadata.Builder setHttpStatusReasonBytes(com.google.protobuf.ByteString value)
       HTTP status reason phrase ("OK", "Not Found", etc.)
 HTTP reason phrase
      optional string http_status_reason = 19 [json_name = "httpStatusReason"];
      Parameters:
      value - The bytes for httpStatusReason to set.
      Returns:
      This builder for chaining.

    • getHttpHeadersList

      public List<WarcHttpHeader> getHttpHeadersList()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];
      Specified by:
      getHttpHeadersList in interface WarcMetadataOrBuilder

    • getHttpHeadersCount

      public int getHttpHeadersCount()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];
      Specified by:
      getHttpHeadersCount in interface WarcMetadataOrBuilder

    • getHttpHeaders

      public WarcHttpHeader getHttpHeaders(int index)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];
      Specified by:
      getHttpHeaders in interface WarcMetadataOrBuilder

    • setHttpHeaders

      public WarcMetadata.Builder setHttpHeaders(int index, WarcHttpHeader value)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • setHttpHeaders

      public WarcMetadata.Builder setHttpHeaders(int index, WarcHttpHeader.Builder builderForValue)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addHttpHeaders

      public WarcMetadata.Builder addHttpHeaders(WarcHttpHeader value)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addHttpHeaders

      public WarcMetadata.Builder addHttpHeaders(int index, WarcHttpHeader value)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addHttpHeaders

      public WarcMetadata.Builder addHttpHeaders(WarcHttpHeader.Builder builderForValue)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addHttpHeaders

      public WarcMetadata.Builder addHttpHeaders(int index, WarcHttpHeader.Builder builderForValue)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addAllHttpHeaders

      public WarcMetadata.Builder addAllHttpHeaders(Iterable<? extends WarcHttpHeader> values)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • clearHttpHeaders

      public WarcMetadata.Builder clearHttpHeaders()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • removeHttpHeaders

      public WarcMetadata.Builder removeHttpHeaders(int index)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • getHttpHeadersBuilder

      public WarcHttpHeader.Builder getHttpHeadersBuilder(int index)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • getHttpHeadersOrBuilder

      public WarcHttpHeaderOrBuilder getHttpHeadersOrBuilder(int index)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];
      Specified by:
      getHttpHeadersOrBuilder in interface WarcMetadataOrBuilder

    • getHttpHeadersOrBuilderList

      public List<? extends WarcHttpHeaderOrBuilder> getHttpHeadersOrBuilderList()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];
      Specified by:
      getHttpHeadersOrBuilderList in interface WarcMetadataOrBuilder

    • addHttpHeadersBuilder

      public WarcHttpHeader.Builder addHttpHeadersBuilder()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • addHttpHeadersBuilder

      public WarcHttpHeader.Builder addHttpHeadersBuilder(int index)
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • getHttpHeadersBuilderList

      public List<WarcHttpHeader.Builder> getHttpHeadersBuilderList()
       HTTP response headers
      repeated .ai.pipestream.parsed.data.warc.v1.WarcHttpHeader http_headers = 20 [json_name = "httpHeaders"];

    • hasWarcCreatedBy

      public boolean hasWarcCreatedBy()
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Specified by:
      hasWarcCreatedBy in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcCreatedBy field is set.

    • getWarcCreatedBy

      public String getWarcCreatedBy()
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Specified by:
      getWarcCreatedBy in interface WarcMetadataOrBuilder
      Returns:
      The warcCreatedBy.

    • getWarcCreatedByBytes

      public com.google.protobuf.ByteString getWarcCreatedByBytes()
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Specified by:
      getWarcCreatedByBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcCreatedBy.

    • setWarcCreatedBy

      public WarcMetadata.Builder setWarcCreatedBy(String value)
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Parameters:
      value - The warcCreatedBy to set.
      Returns:
      This builder for chaining.

    • clearWarcCreatedBy

      public WarcMetadata.Builder clearWarcCreatedBy()
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Returns:
      This builder for chaining.

    • setWarcCreatedByBytes

      public WarcMetadata.Builder setWarcCreatedByBytes(com.google.protobuf.ByteString value)
       Software/crawler that created this WARC file
 Software info
      optional string warc_created_by = 21 [json_name = "warcCreatedBy"];
      Parameters:
      value - The bytes for warcCreatedBy to set.
      Returns:
      This builder for chaining.

    • hasWarcFormatVersion

      public boolean hasWarcFormatVersion()
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Specified by:
      hasWarcFormatVersion in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcFormatVersion field is set.

    • getWarcFormatVersion

      public String getWarcFormatVersion()
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Specified by:
      getWarcFormatVersion in interface WarcMetadataOrBuilder
      Returns:
      The warcFormatVersion.

    • getWarcFormatVersionBytes

      public com.google.protobuf.ByteString getWarcFormatVersionBytes()
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Specified by:
      getWarcFormatVersionBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcFormatVersion.

    • setWarcFormatVersion

      public WarcMetadata.Builder setWarcFormatVersion(String value)
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Parameters:
      value - The warcFormatVersion to set.
      Returns:
      This builder for chaining.

    • clearWarcFormatVersion

      public WarcMetadata.Builder clearWarcFormatVersion()
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Returns:
      This builder for chaining.

    • setWarcFormatVersionBytes

      public WarcMetadata.Builder setWarcFormatVersionBytes(com.google.protobuf.ByteString value)
       Version of the WARC format specification used
 WARC format version
      optional string warc_format_version = 22 [json_name = "warcFormatVersion"];
      Parameters:
      value - The bytes for warcFormatVersion to set.
      Returns:
      This builder for chaining.

    • hasWarcCollection

      public boolean hasWarcCollection()
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Specified by:
      hasWarcCollection in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcCollection field is set.

    • getWarcCollection

      public String getWarcCollection()
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Specified by:
      getWarcCollection in interface WarcMetadataOrBuilder
      Returns:
      The warcCollection.

    • getWarcCollectionBytes

      public com.google.protobuf.ByteString getWarcCollectionBytes()
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Specified by:
      getWarcCollectionBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcCollection.

    • setWarcCollection

      public WarcMetadata.Builder setWarcCollection(String value)
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Parameters:
      value - The warcCollection to set.
      Returns:
      This builder for chaining.

    • clearWarcCollection

      public WarcMetadata.Builder clearWarcCollection()
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Returns:
      This builder for chaining.

    • setWarcCollectionBytes

      public WarcMetadata.Builder setWarcCollectionBytes(com.google.protobuf.ByteString value)
       Crawl or collection identifier
 Collection name
      optional string warc_collection = 23 [json_name = "warcCollection"];
      Parameters:
      value - The bytes for warcCollection to set.
      Returns:
      This builder for chaining.

    • hasWarcCrawlId

      public boolean hasWarcCrawlId()
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Specified by:
      hasWarcCrawlId in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcCrawlId field is set.

    • getWarcCrawlId

      public String getWarcCrawlId()
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Specified by:
      getWarcCrawlId in interface WarcMetadataOrBuilder
      Returns:
      The warcCrawlId.

    • getWarcCrawlIdBytes

      public com.google.protobuf.ByteString getWarcCrawlIdBytes()
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Specified by:
      getWarcCrawlIdBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcCrawlId.

    • setWarcCrawlId

      public WarcMetadata.Builder setWarcCrawlId(String value)
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Parameters:
      value - The warcCrawlId to set.
      Returns:
      This builder for chaining.

    • clearWarcCrawlId

      public WarcMetadata.Builder clearWarcCrawlId()
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Returns:
      This builder for chaining.

    • setWarcCrawlIdBytes

      public WarcMetadata.Builder setWarcCrawlIdBytes(com.google.protobuf.ByteString value)
       Crawl job or session identifier
 Crawl identifier
      optional string warc_crawl_id = 24 [json_name = "warcCrawlId"];
      Parameters:
      value - The bytes for warcCrawlId to set.
      Returns:
      This builder for chaining.

    • hasWarcRobotPolicy

      public boolean hasWarcRobotPolicy()
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Specified by:
      hasWarcRobotPolicy in interface WarcMetadataOrBuilder
      Returns:
      Whether the warcRobotPolicy field is set.

    • getWarcRobotPolicy

      public String getWarcRobotPolicy()
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Specified by:
      getWarcRobotPolicy in interface WarcMetadataOrBuilder
      Returns:
      The warcRobotPolicy.

    • getWarcRobotPolicyBytes

      public com.google.protobuf.ByteString getWarcRobotPolicyBytes()
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Specified by:
      getWarcRobotPolicyBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for warcRobotPolicy.

    • setWarcRobotPolicy

      public WarcMetadata.Builder setWarcRobotPolicy(String value)
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Parameters:
      value - The warcRobotPolicy to set.
      Returns:
      This builder for chaining.

    • clearWarcRobotPolicy

      public WarcMetadata.Builder clearWarcRobotPolicy()
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Returns:
      This builder for chaining.

    • setWarcRobotPolicyBytes

      public WarcMetadata.Builder setWarcRobotPolicyBytes(com.google.protobuf.ByteString value)
       Robot policy information (robots.txt compliance)
 Robot policy
      optional string warc_robot_policy = 25 [json_name = "warcRobotPolicy"];
      Parameters:
      value - The bytes for warcRobotPolicy to set.
      Returns:
      This builder for chaining.

    • hasFetchTimestamp

      public boolean hasFetchTimestamp()
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];
      Specified by:
      hasFetchTimestamp in interface WarcMetadataOrBuilder
      Returns:
      Whether the fetchTimestamp field is set.

    • getFetchTimestamp

      public com.google.protobuf.Timestamp getFetchTimestamp()
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];
      Specified by:
      getFetchTimestamp in interface WarcMetadataOrBuilder
      Returns:
      The fetchTimestamp.

    • setFetchTimestamp

      public WarcMetadata.Builder setFetchTimestamp(com.google.protobuf.Timestamp value)
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];

    • setFetchTimestamp

      public WarcMetadata.Builder setFetchTimestamp(com.google.protobuf.Timestamp.Builder builderForValue)
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];

    • mergeFetchTimestamp

      public WarcMetadata.Builder mergeFetchTimestamp(com.google.protobuf.Timestamp value)
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];

    • clearFetchTimestamp

      public WarcMetadata.Builder clearFetchTimestamp()
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];

    • getFetchTimestampBuilder

      public com.google.protobuf.Timestamp.Builder getFetchTimestampBuilder()
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];

    • getFetchTimestampOrBuilder

      public com.google.protobuf.TimestampOrBuilder getFetchTimestampOrBuilder()
       Fetch timestamp (may differ from WARC-Date)
      optional .google.protobuf.Timestamp fetch_timestamp = 26 [json_name = "fetchTimestamp"];
      Specified by:
      getFetchTimestampOrBuilder in interface WarcMetadataOrBuilder

    • hasContentLanguage

      public boolean hasContentLanguage()
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Specified by:
      hasContentLanguage in interface WarcMetadataOrBuilder
      Returns:
      Whether the contentLanguage field is set.

    • getContentLanguage

      public String getContentLanguage()
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Specified by:
      getContentLanguage in interface WarcMetadataOrBuilder
      Returns:
      The contentLanguage.

    • getContentLanguageBytes

      public com.google.protobuf.ByteString getContentLanguageBytes()
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Specified by:
      getContentLanguageBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for contentLanguage.

    • setContentLanguage

      public WarcMetadata.Builder setContentLanguage(String value)
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Parameters:
      value - The contentLanguage to set.
      Returns:
      This builder for chaining.

    • clearContentLanguage

      public WarcMetadata.Builder clearContentLanguage()
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Returns:
      This builder for chaining.

    • setContentLanguageBytes

      public WarcMetadata.Builder setContentLanguageBytes(com.google.protobuf.ByteString value)
       Detected language of the content
      optional string content_language = 27 [json_name = "contentLanguage"];
      Parameters:
      value - The bytes for contentLanguage to set.
      Returns:
      This builder for chaining.

    • hasContentEncoding

      public boolean hasContentEncoding()
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Specified by:
      hasContentEncoding in interface WarcMetadataOrBuilder
      Returns:
      Whether the contentEncoding field is set.

    • getContentEncoding

      public String getContentEncoding()
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Specified by:
      getContentEncoding in interface WarcMetadataOrBuilder
      Returns:
      The contentEncoding.

    • getContentEncodingBytes

      public com.google.protobuf.ByteString getContentEncodingBytes()
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Specified by:
      getContentEncodingBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for contentEncoding.

    • setContentEncoding

      public WarcMetadata.Builder setContentEncoding(String value)
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Parameters:
      value - The contentEncoding to set.
      Returns:
      This builder for chaining.

    • clearContentEncoding

      public WarcMetadata.Builder clearContentEncoding()
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Returns:
      This builder for chaining.

    • setContentEncodingBytes

      public WarcMetadata.Builder setContentEncodingBytes(com.google.protobuf.ByteString value)
       Character encoding of the content
      optional string content_encoding = 28 [json_name = "contentEncoding"];
      Parameters:
      value - The bytes for contentEncoding to set.
      Returns:
      This builder for chaining.

    • hasEstimatedWordCount

      public boolean hasEstimatedWordCount()
       Estimated word count of textual content
      optional int64 estimated_word_count = 29 [json_name = "estimatedWordCount"];
      Specified by:
      hasEstimatedWordCount in interface WarcMetadataOrBuilder
      Returns:
      Whether the estimatedWordCount field is set.

    • getEstimatedWordCount

      public long getEstimatedWordCount()
       Estimated word count of textual content
      optional int64 estimated_word_count = 29 [json_name = "estimatedWordCount"];
      Specified by:
      getEstimatedWordCount in interface WarcMetadataOrBuilder
      Returns:
      The estimatedWordCount.

    • setEstimatedWordCount

      public WarcMetadata.Builder setEstimatedWordCount(long value)
       Estimated word count of textual content
      optional int64 estimated_word_count = 29 [json_name = "estimatedWordCount"];
      Parameters:
      value - The estimatedWordCount to set.
      Returns:
      This builder for chaining.

    • clearEstimatedWordCount

      public WarcMetadata.Builder clearEstimatedWordCount()
       Estimated word count of textual content
      optional int64 estimated_word_count = 29 [json_name = "estimatedWordCount"];
      Returns:
      This builder for chaining.

    • hasEstimatedCharacterCount

      public boolean hasEstimatedCharacterCount()
       Estimated character count of textual content
      optional int64 estimated_character_count = 30 [json_name = "estimatedCharacterCount"];
      Specified by:
      hasEstimatedCharacterCount in interface WarcMetadataOrBuilder
      Returns:
      Whether the estimatedCharacterCount field is set.

    • getEstimatedCharacterCount

      public long getEstimatedCharacterCount()
       Estimated character count of textual content
      optional int64 estimated_character_count = 30 [json_name = "estimatedCharacterCount"];
      Specified by:
      getEstimatedCharacterCount in interface WarcMetadataOrBuilder
      Returns:
      The estimatedCharacterCount.

    • setEstimatedCharacterCount

      public WarcMetadata.Builder setEstimatedCharacterCount(long value)
       Estimated character count of textual content
      optional int64 estimated_character_count = 30 [json_name = "estimatedCharacterCount"];
      Parameters:
      value - The estimatedCharacterCount to set.
      Returns:
      This builder for chaining.

    • clearEstimatedCharacterCount

      public WarcMetadata.Builder clearEstimatedCharacterCount()
       Estimated character count of textual content
      optional int64 estimated_character_count = 30 [json_name = "estimatedCharacterCount"];
      Returns:
      This builder for chaining.

    • hasIsTruncated

      public boolean hasIsTruncated()
       Whether the content appears to be truncated
      optional bool is_truncated = 31 [json_name = "isTruncated"];
      Specified by:
      hasIsTruncated in interface WarcMetadataOrBuilder
      Returns:
      Whether the isTruncated field is set.

    • getIsTruncated

      public boolean getIsTruncated()
       Whether the content appears to be truncated
      optional bool is_truncated = 31 [json_name = "isTruncated"];
      Specified by:
      getIsTruncated in interface WarcMetadataOrBuilder
      Returns:
      The isTruncated.

    • setIsTruncated

      public WarcMetadata.Builder setIsTruncated(boolean value)
       Whether the content appears to be truncated
      optional bool is_truncated = 31 [json_name = "isTruncated"];
      Parameters:
      value - The isTruncated to set.
      Returns:
      This builder for chaining.

    • clearIsTruncated

      public WarcMetadata.Builder clearIsTruncated()
       Whether the content appears to be truncated
      optional bool is_truncated = 31 [json_name = "isTruncated"];
      Returns:
      This builder for chaining.

    • hasCompressionMethod

      public boolean hasCompressionMethod()
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Specified by:
      hasCompressionMethod in interface WarcMetadataOrBuilder
      Returns:
      Whether the compressionMethod field is set.

    • getCompressionMethod

      public String getCompressionMethod()
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Specified by:
      getCompressionMethod in interface WarcMetadataOrBuilder
      Returns:
      The compressionMethod.

    • getCompressionMethodBytes

      public com.google.protobuf.ByteString getCompressionMethodBytes()
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Specified by:
      getCompressionMethodBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for compressionMethod.

    • setCompressionMethod

      public WarcMetadata.Builder setCompressionMethod(String value)
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Parameters:
      value - The compressionMethod to set.
      Returns:
      This builder for chaining.

    • clearCompressionMethod

      public WarcMetadata.Builder clearCompressionMethod()
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Returns:
      This builder for chaining.

    • setCompressionMethodBytes

      public WarcMetadata.Builder setCompressionMethodBytes(com.google.protobuf.ByteString value)
       Compression method used (if any)
      optional string compression_method = 32 [json_name = "compressionMethod"];
      Parameters:
      value - The bytes for compressionMethod to set.
      Returns:
      This builder for chaining.

    • hasHttpMethod

      public boolean hasHttpMethod()
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Specified by:
      hasHttpMethod in interface WarcMetadataOrBuilder
      Returns:
      Whether the httpMethod field is set.

    • getHttpMethod

      public String getHttpMethod()
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Specified by:
      getHttpMethod in interface WarcMetadataOrBuilder
      Returns:
      The httpMethod.

    • getHttpMethodBytes

      public com.google.protobuf.ByteString getHttpMethodBytes()
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Specified by:
      getHttpMethodBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for httpMethod.

    • setHttpMethod

      public WarcMetadata.Builder setHttpMethod(String value)
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Parameters:
      value - The httpMethod to set.
      Returns:
      This builder for chaining.

    • clearHttpMethod

      public WarcMetadata.Builder clearHttpMethod()
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Returns:
      This builder for chaining.

    • setHttpMethodBytes

      public WarcMetadata.Builder setHttpMethodBytes(com.google.protobuf.ByteString value)
       HTTP method used for the request (GET, POST, etc.)
      optional string http_method = 33 [json_name = "httpMethod"];
      Parameters:
      value - The bytes for httpMethod to set.
      Returns:
      This builder for chaining.

    • hasHttpVersion

      public boolean hasHttpVersion()
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Specified by:
      hasHttpVersion in interface WarcMetadataOrBuilder
      Returns:
      Whether the httpVersion field is set.

    • getHttpVersion

      public String getHttpVersion()
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Specified by:
      getHttpVersion in interface WarcMetadataOrBuilder
      Returns:
      The httpVersion.

    • getHttpVersionBytes

      public com.google.protobuf.ByteString getHttpVersionBytes()
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Specified by:
      getHttpVersionBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for httpVersion.

    • setHttpVersion

      public WarcMetadata.Builder setHttpVersion(String value)
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Parameters:
      value - The httpVersion to set.
      Returns:
      This builder for chaining.

    • clearHttpVersion

      public WarcMetadata.Builder clearHttpVersion()
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Returns:
      This builder for chaining.

    • setHttpVersionBytes

      public WarcMetadata.Builder setHttpVersionBytes(com.google.protobuf.ByteString value)
       HTTP version (1.0, 1.1, 2.0)
      optional string http_version = 34 [json_name = "httpVersion"];
      Parameters:
      value - The bytes for httpVersion to set.
      Returns:
      This builder for chaining.

    • getRedirectChainList

      public List<WarcRedirect> getRedirectChainList()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];
      Specified by:
      getRedirectChainList in interface WarcMetadataOrBuilder

    • getRedirectChainCount

      public int getRedirectChainCount()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];
      Specified by:
      getRedirectChainCount in interface WarcMetadataOrBuilder

    • getRedirectChain

      public WarcRedirect getRedirectChain(int index)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];
      Specified by:
      getRedirectChain in interface WarcMetadataOrBuilder

    • setRedirectChain

      public WarcMetadata.Builder setRedirectChain(int index, WarcRedirect value)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • setRedirectChain

      public WarcMetadata.Builder setRedirectChain(int index, WarcRedirect.Builder builderForValue)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addRedirectChain

      public WarcMetadata.Builder addRedirectChain(WarcRedirect value)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addRedirectChain

      public WarcMetadata.Builder addRedirectChain(int index, WarcRedirect value)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addRedirectChain

      public WarcMetadata.Builder addRedirectChain(WarcRedirect.Builder builderForValue)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addRedirectChain

      public WarcMetadata.Builder addRedirectChain(int index, WarcRedirect.Builder builderForValue)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addAllRedirectChain

      public WarcMetadata.Builder addAllRedirectChain(Iterable<? extends WarcRedirect> values)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • clearRedirectChain

      public WarcMetadata.Builder clearRedirectChain()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • removeRedirectChain

      public WarcMetadata.Builder removeRedirectChain(int index)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • getRedirectChainBuilder

      public WarcRedirect.Builder getRedirectChainBuilder(int index)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • getRedirectChainOrBuilder

      public WarcRedirectOrBuilder getRedirectChainOrBuilder(int index)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];
      Specified by:
      getRedirectChainOrBuilder in interface WarcMetadataOrBuilder

    • getRedirectChainOrBuilderList

      public List<? extends WarcRedirectOrBuilder> getRedirectChainOrBuilderList()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];
      Specified by:
      getRedirectChainOrBuilderList in interface WarcMetadataOrBuilder

    • addRedirectChainBuilder

      public WarcRedirect.Builder addRedirectChainBuilder()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • addRedirectChainBuilder

      public WarcRedirect.Builder addRedirectChainBuilder(int index)
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • getRedirectChainBuilderList

      public List<WarcRedirect.Builder> getRedirectChainBuilderList()
       Redirect chain information
      repeated .ai.pipestream.parsed.data.warc.v1.WarcRedirect redirect_chain = 35 [json_name = "redirectChain"];

    • getCookiesList

      public List<WarcCookie> getCookiesList()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];
      Specified by:
      getCookiesList in interface WarcMetadataOrBuilder

    • getCookiesCount

      public int getCookiesCount()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];
      Specified by:
      getCookiesCount in interface WarcMetadataOrBuilder

    • getCookies

      public WarcCookie getCookies(int index)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];
      Specified by:
      getCookies in interface WarcMetadataOrBuilder

    • setCookies

      public WarcMetadata.Builder setCookies(int index, WarcCookie value)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • setCookies

      public WarcMetadata.Builder setCookies(int index, WarcCookie.Builder builderForValue)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addCookies

      public WarcMetadata.Builder addCookies(WarcCookie value)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addCookies

      public WarcMetadata.Builder addCookies(int index, WarcCookie value)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addCookies

      public WarcMetadata.Builder addCookies(WarcCookie.Builder builderForValue)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addCookies

      public WarcMetadata.Builder addCookies(int index, WarcCookie.Builder builderForValue)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addAllCookies

      public WarcMetadata.Builder addAllCookies(Iterable<? extends WarcCookie> values)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • clearCookies

      public WarcMetadata.Builder clearCookies()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • removeCookies

      public WarcMetadata.Builder removeCookies(int index)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • getCookiesBuilder

      public WarcCookie.Builder getCookiesBuilder(int index)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • getCookiesOrBuilder

      public WarcCookieOrBuilder getCookiesOrBuilder(int index)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];
      Specified by:
      getCookiesOrBuilder in interface WarcMetadataOrBuilder

    • getCookiesOrBuilderList

      public List<? extends WarcCookieOrBuilder> getCookiesOrBuilderList()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];
      Specified by:
      getCookiesOrBuilderList in interface WarcMetadataOrBuilder

    • addCookiesBuilder

      public WarcCookie.Builder addCookiesBuilder()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • addCookiesBuilder

      public WarcCookie.Builder addCookiesBuilder(int index)
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • getCookiesBuilderList

      public List<WarcCookie.Builder> getCookiesBuilderList()
       Cookies associated with this request/response
      repeated .ai.pipestream.parsed.data.warc.v1.WarcCookie cookies = 36 [json_name = "cookies"];

    • hasReferrerUrl

      public boolean hasReferrerUrl()
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Specified by:
      hasReferrerUrl in interface WarcMetadataOrBuilder
      Returns:
      Whether the referrerUrl field is set.

    • getReferrerUrl

      public String getReferrerUrl()
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Specified by:
      getReferrerUrl in interface WarcMetadataOrBuilder
      Returns:
      The referrerUrl.

    • getReferrerUrlBytes

      public com.google.protobuf.ByteString getReferrerUrlBytes()
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Specified by:
      getReferrerUrlBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for referrerUrl.

    • setReferrerUrl

      public WarcMetadata.Builder setReferrerUrl(String value)
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Parameters:
      value - The referrerUrl to set.
      Returns:
      This builder for chaining.

    • clearReferrerUrl

      public WarcMetadata.Builder clearReferrerUrl()
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Returns:
      This builder for chaining.

    • setReferrerUrlBytes

      public WarcMetadata.Builder setReferrerUrlBytes(com.google.protobuf.ByteString value)
       Referrer URL (if available)
      optional string referrer_url = 37 [json_name = "referrerUrl"];
      Parameters:
      value - The bytes for referrerUrl to set.
      Returns:
      This builder for chaining.

    • hasUserAgent

      public boolean hasUserAgent()
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Specified by:
      hasUserAgent in interface WarcMetadataOrBuilder
      Returns:
      Whether the userAgent field is set.

    • getUserAgent

      public String getUserAgent()
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Specified by:
      getUserAgent in interface WarcMetadataOrBuilder
      Returns:
      The userAgent.

    • getUserAgentBytes

      public com.google.protobuf.ByteString getUserAgentBytes()
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Specified by:
      getUserAgentBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for userAgent.

    • setUserAgent

      public WarcMetadata.Builder setUserAgent(String value)
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Parameters:
      value - The userAgent to set.
      Returns:
      This builder for chaining.

    • clearUserAgent

      public WarcMetadata.Builder clearUserAgent()
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Returns:
      This builder for chaining.

    • setUserAgentBytes

      public WarcMetadata.Builder setUserAgentBytes(com.google.protobuf.ByteString value)
       User agent string used for the request
      optional string user_agent = 38 [json_name = "userAgent"];
      Parameters:
      value - The bytes for userAgent to set.
      Returns:
      This builder for chaining.

    • hasRecordPosition

      public boolean hasRecordPosition()
       Position of this record within the WARC file
      optional int64 record_position = 39 [json_name = "recordPosition"];
      Specified by:
      hasRecordPosition in interface WarcMetadataOrBuilder
      Returns:
      Whether the recordPosition field is set.

    • getRecordPosition

      public long getRecordPosition()
       Position of this record within the WARC file
      optional int64 record_position = 39 [json_name = "recordPosition"];
      Specified by:
      getRecordPosition in interface WarcMetadataOrBuilder
      Returns:
      The recordPosition.

    • setRecordPosition

      public WarcMetadata.Builder setRecordPosition(long value)
       Position of this record within the WARC file
      optional int64 record_position = 39 [json_name = "recordPosition"];
      Parameters:
      value - The recordPosition to set.
      Returns:
      This builder for chaining.

    • clearRecordPosition

      public WarcMetadata.Builder clearRecordPosition()
       Position of this record within the WARC file
      optional int64 record_position = 39 [json_name = "recordPosition"];
      Returns:
      This builder for chaining.

    • hasRecordSize

      public boolean hasRecordSize()
       Size of the complete WARC record (headers + payload)
      optional int64 record_size = 40 [json_name = "recordSize"];
      Specified by:
      hasRecordSize in interface WarcMetadataOrBuilder
      Returns:
      Whether the recordSize field is set.

    • getRecordSize

      public long getRecordSize()
       Size of the complete WARC record (headers + payload)
      optional int64 record_size = 40 [json_name = "recordSize"];
      Specified by:
      getRecordSize in interface WarcMetadataOrBuilder
      Returns:
      The recordSize.

    • setRecordSize

      public WarcMetadata.Builder setRecordSize(long value)
       Size of the complete WARC record (headers + payload)
      optional int64 record_size = 40 [json_name = "recordSize"];
      Parameters:
      value - The recordSize to set.
      Returns:
      This builder for chaining.

    • clearRecordSize

      public WarcMetadata.Builder clearRecordSize()
       Size of the complete WARC record (headers + payload)
      optional int64 record_size = 40 [json_name = "recordSize"];
      Returns:
      This builder for chaining.

    • hasTotalRecordsInFile

      public boolean hasTotalRecordsInFile()
       Number of records in the WARC file
      optional int32 total_records_in_file = 41 [json_name = "totalRecordsInFile"];
      Specified by:
      hasTotalRecordsInFile in interface WarcMetadataOrBuilder
      Returns:
      Whether the totalRecordsInFile field is set.

    • getTotalRecordsInFile

      public int getTotalRecordsInFile()
       Number of records in the WARC file
      optional int32 total_records_in_file = 41 [json_name = "totalRecordsInFile"];
      Specified by:
      getTotalRecordsInFile in interface WarcMetadataOrBuilder
      Returns:
      The totalRecordsInFile.

    • setTotalRecordsInFile

      public WarcMetadata.Builder setTotalRecordsInFile(int value)
       Number of records in the WARC file
      optional int32 total_records_in_file = 41 [json_name = "totalRecordsInFile"];
      Parameters:
      value - The totalRecordsInFile to set.
      Returns:
      This builder for chaining.

    • clearTotalRecordsInFile

      public WarcMetadata.Builder clearTotalRecordsInFile()
       Number of records in the WARC file
      optional int32 total_records_in_file = 41 [json_name = "totalRecordsInFile"];
      Returns:
      This builder for chaining.

    • hasRecordIndex

      public boolean hasRecordIndex()
       Index of this record within the file (0-based)
      optional int32 record_index = 42 [json_name = "recordIndex"];
      Specified by:
      hasRecordIndex in interface WarcMetadataOrBuilder
      Returns:
      Whether the recordIndex field is set.

    • getRecordIndex

      public int getRecordIndex()
       Index of this record within the file (0-based)
      optional int32 record_index = 42 [json_name = "recordIndex"];
      Specified by:
      getRecordIndex in interface WarcMetadataOrBuilder
      Returns:
      The recordIndex.

    • setRecordIndex

      public WarcMetadata.Builder setRecordIndex(int value)
       Index of this record within the file (0-based)
      optional int32 record_index = 42 [json_name = "recordIndex"];
      Parameters:
      value - The recordIndex to set.
      Returns:
      This builder for chaining.

    • clearRecordIndex

      public WarcMetadata.Builder clearRecordIndex()
       Index of this record within the file (0-based)
      optional int32 record_index = 42 [json_name = "recordIndex"];
      Returns:
      This builder for chaining.

    • hasHasMetadataRecords

      public boolean hasHasMetadataRecords()
       Whether this record has associated metadata records
      optional bool has_metadata_records = 43 [json_name = "hasMetadataRecords"];
      Specified by:
      hasHasMetadataRecords in interface WarcMetadataOrBuilder
      Returns:
      Whether the hasMetadataRecords field is set.

    • getHasMetadataRecords

      public boolean getHasMetadataRecords()
       Whether this record has associated metadata records
      optional bool has_metadata_records = 43 [json_name = "hasMetadataRecords"];
      Specified by:
      getHasMetadataRecords in interface WarcMetadataOrBuilder
      Returns:
      The hasMetadataRecords.

    • setHasMetadataRecords

      public WarcMetadata.Builder setHasMetadataRecords(boolean value)
       Whether this record has associated metadata records
      optional bool has_metadata_records = 43 [json_name = "hasMetadataRecords"];
      Parameters:
      value - The hasMetadataRecords to set.
      Returns:
      This builder for chaining.

    • clearHasMetadataRecords

      public WarcMetadata.Builder clearHasMetadataRecords()
       Whether this record has associated metadata records
      optional bool has_metadata_records = 43 [json_name = "hasMetadataRecords"];
      Returns:
      This builder for chaining.

    • hasHasRequestRecords

      public boolean hasHasRequestRecords()
       Whether this record has associated request records
      optional bool has_request_records = 44 [json_name = "hasRequestRecords"];
      Specified by:
      hasHasRequestRecords in interface WarcMetadataOrBuilder
      Returns:
      Whether the hasRequestRecords field is set.

    • getHasRequestRecords

      public boolean getHasRequestRecords()
       Whether this record has associated request records
      optional bool has_request_records = 44 [json_name = "hasRequestRecords"];
      Specified by:
      getHasRequestRecords in interface WarcMetadataOrBuilder
      Returns:
      The hasRequestRecords.

    • setHasRequestRecords

      public WarcMetadata.Builder setHasRequestRecords(boolean value)
       Whether this record has associated request records
      optional bool has_request_records = 44 [json_name = "hasRequestRecords"];
      Parameters:
      value - The hasRequestRecords to set.
      Returns:
      This builder for chaining.

    • clearHasRequestRecords

      public WarcMetadata.Builder clearHasRequestRecords()
       Whether this record has associated request records
      optional bool has_request_records = 44 [json_name = "hasRequestRecords"];
      Returns:
      This builder for chaining.

    • getValidationErrorsList

      public com.google.protobuf.ProtocolStringList getValidationErrorsList()
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Specified by:
      getValidationErrorsList in interface WarcMetadataOrBuilder
      Returns:
      A list containing the validationErrors.

    • getValidationErrorsCount

      public int getValidationErrorsCount()
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Specified by:
      getValidationErrorsCount in interface WarcMetadataOrBuilder
      Returns:
      The count of validationErrors.

    • getValidationErrors

      public String getValidationErrors(int index)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Specified by:
      getValidationErrors in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the element to return.
      Returns:
      The validationErrors at the given index.

    • getValidationErrorsBytes

      public com.google.protobuf.ByteString getValidationErrorsBytes(int index)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Specified by:
      getValidationErrorsBytes in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the validationErrors at the given index.

    • setValidationErrors

      public WarcMetadata.Builder setValidationErrors(int index, String value)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Parameters:
      index - The index to set the value at.
      value - The validationErrors to set.
      Returns:
      This builder for chaining.

    • addValidationErrors

      public WarcMetadata.Builder addValidationErrors(String value)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Parameters:
      value - The validationErrors to add.
      Returns:
      This builder for chaining.

    • addAllValidationErrors

      public WarcMetadata.Builder addAllValidationErrors(Iterable<String> values)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Parameters:
      values - The validationErrors to add.
      Returns:
      This builder for chaining.

    • clearValidationErrors

      public WarcMetadata.Builder clearValidationErrors()
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Returns:
      This builder for chaining.

    • addValidationErrorsBytes

      public WarcMetadata.Builder addValidationErrorsBytes(com.google.protobuf.ByteString value)
       Validation errors found in the WARC record
      repeated string validation_errors = 45 [json_name = "validationErrors"];
      Parameters:
      value - The bytes of the validationErrors to add.
      Returns:
      This builder for chaining.

    • getValidationWarningsList

      public com.google.protobuf.ProtocolStringList getValidationWarningsList()
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Specified by:
      getValidationWarningsList in interface WarcMetadataOrBuilder
      Returns:
      A list containing the validationWarnings.

    • getValidationWarningsCount

      public int getValidationWarningsCount()
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Specified by:
      getValidationWarningsCount in interface WarcMetadataOrBuilder
      Returns:
      The count of validationWarnings.

    • getValidationWarnings

      public String getValidationWarnings(int index)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Specified by:
      getValidationWarnings in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the element to return.
      Returns:
      The validationWarnings at the given index.

    • getValidationWarningsBytes

      public com.google.protobuf.ByteString getValidationWarningsBytes(int index)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Specified by:
      getValidationWarningsBytes in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the validationWarnings at the given index.

    • setValidationWarnings

      public WarcMetadata.Builder setValidationWarnings(int index, String value)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Parameters:
      index - The index to set the value at.
      value - The validationWarnings to set.
      Returns:
      This builder for chaining.

    • addValidationWarnings

      public WarcMetadata.Builder addValidationWarnings(String value)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Parameters:
      value - The validationWarnings to add.
      Returns:
      This builder for chaining.

    • addAllValidationWarnings

      public WarcMetadata.Builder addAllValidationWarnings(Iterable<String> values)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Parameters:
      values - The validationWarnings to add.
      Returns:
      This builder for chaining.

    • clearValidationWarnings

      public WarcMetadata.Builder clearValidationWarnings()
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Returns:
      This builder for chaining.

    • addValidationWarningsBytes

      public WarcMetadata.Builder addValidationWarningsBytes(com.google.protobuf.ByteString value)
       Validation warnings found in the WARC record
      repeated string validation_warnings = 46 [json_name = "validationWarnings"];
      Parameters:
      value - The bytes of the validationWarnings to add.
      Returns:
      This builder for chaining.

    • hasCompletenessScore

      public boolean hasCompletenessScore()
       Completeness score (0.0 to 1.0) indicating how complete the capture is
      optional double completeness_score = 47 [json_name = "completenessScore"];
      Specified by:
      hasCompletenessScore in interface WarcMetadataOrBuilder
      Returns:
      Whether the completenessScore field is set.

    • getCompletenessScore

      public double getCompletenessScore()
       Completeness score (0.0 to 1.0) indicating how complete the capture is
      optional double completeness_score = 47 [json_name = "completenessScore"];
      Specified by:
      getCompletenessScore in interface WarcMetadataOrBuilder
      Returns:
      The completenessScore.

    • setCompletenessScore

      public WarcMetadata.Builder setCompletenessScore(double value)
       Completeness score (0.0 to 1.0) indicating how complete the capture is
      optional double completeness_score = 47 [json_name = "completenessScore"];
      Parameters:
      value - The completenessScore to set.
      Returns:
      This builder for chaining.

    • clearCompletenessScore

      public WarcMetadata.Builder clearCompletenessScore()
       Completeness score (0.0 to 1.0) indicating how complete the capture is
      optional double completeness_score = 47 [json_name = "completenessScore"];
      Returns:
      This builder for chaining.

    • hasChecksumVerified

      public boolean hasChecksumVerified()
       Whether the content matches expected checksums
      optional bool checksum_verified = 48 [json_name = "checksumVerified"];
      Specified by:
      hasChecksumVerified in interface WarcMetadataOrBuilder
      Returns:
      Whether the checksumVerified field is set.

    • getChecksumVerified

      public boolean getChecksumVerified()
       Whether the content matches expected checksums
      optional bool checksum_verified = 48 [json_name = "checksumVerified"];
      Specified by:
      getChecksumVerified in interface WarcMetadataOrBuilder
      Returns:
      The checksumVerified.

    • setChecksumVerified

      public WarcMetadata.Builder setChecksumVerified(boolean value)
       Whether the content matches expected checksums
      optional bool checksum_verified = 48 [json_name = "checksumVerified"];
      Parameters:
      value - The checksumVerified to set.
      Returns:
      This builder for chaining.

    • clearChecksumVerified

      public WarcMetadata.Builder clearChecksumVerified()
       Whether the content matches expected checksums
      optional bool checksum_verified = 48 [json_name = "checksumVerified"];
      Returns:
      This builder for chaining.

    • hasArchiveInstitution

      public boolean hasArchiveInstitution()
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Specified by:
      hasArchiveInstitution in interface WarcMetadataOrBuilder
      Returns:
      Whether the archiveInstitution field is set.

    • getArchiveInstitution

      public String getArchiveInstitution()
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Specified by:
      getArchiveInstitution in interface WarcMetadataOrBuilder
      Returns:
      The archiveInstitution.

    • getArchiveInstitutionBytes

      public com.google.protobuf.ByteString getArchiveInstitutionBytes()
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Specified by:
      getArchiveInstitutionBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for archiveInstitution.

    • setArchiveInstitution

      public WarcMetadata.Builder setArchiveInstitution(String value)
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Parameters:
      value - The archiveInstitution to set.
      Returns:
      This builder for chaining.

    • clearArchiveInstitution

      public WarcMetadata.Builder clearArchiveInstitution()
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Returns:
      This builder for chaining.

    • setArchiveInstitutionBytes

      public WarcMetadata.Builder setArchiveInstitutionBytes(com.google.protobuf.ByteString value)
       Institution or organization that created the archive
      optional string archive_institution = 49 [json_name = "archiveInstitution"];
      Parameters:
      value - The bytes for archiveInstitution to set.
      Returns:
      This builder for chaining.

    • hasArchiveCollectionName

      public boolean hasArchiveCollectionName()
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Specified by:
      hasArchiveCollectionName in interface WarcMetadataOrBuilder
      Returns:
      Whether the archiveCollectionName field is set.

    • getArchiveCollectionName

      public String getArchiveCollectionName()
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Specified by:
      getArchiveCollectionName in interface WarcMetadataOrBuilder
      Returns:
      The archiveCollectionName.

    • getArchiveCollectionNameBytes

      public com.google.protobuf.ByteString getArchiveCollectionNameBytes()
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Specified by:
      getArchiveCollectionNameBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for archiveCollectionName.

    • setArchiveCollectionName

      public WarcMetadata.Builder setArchiveCollectionName(String value)
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Parameters:
      value - The archiveCollectionName to set.
      Returns:
      This builder for chaining.

    • clearArchiveCollectionName

      public WarcMetadata.Builder clearArchiveCollectionName()
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Returns:
      This builder for chaining.

    • setArchiveCollectionNameBytes

      public WarcMetadata.Builder setArchiveCollectionNameBytes(com.google.protobuf.ByteString value)
       Archive collection or series name
      optional string archive_collection_name = 50 [json_name = "archiveCollectionName"];
      Parameters:
      value - The bytes for archiveCollectionName to set.
      Returns:
      This builder for chaining.

    • hasAccessRights

      public boolean hasAccessRights()
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Specified by:
      hasAccessRights in interface WarcMetadataOrBuilder
      Returns:
      Whether the accessRights field is set.

    • getAccessRights

      public String getAccessRights()
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Specified by:
      getAccessRights in interface WarcMetadataOrBuilder
      Returns:
      The accessRights.

    • getAccessRightsBytes

      public com.google.protobuf.ByteString getAccessRightsBytes()
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Specified by:
      getAccessRightsBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for accessRights.

    • setAccessRights

      public WarcMetadata.Builder setAccessRights(String value)
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Parameters:
      value - The accessRights to set.
      Returns:
      This builder for chaining.

    • clearAccessRights

      public WarcMetadata.Builder clearAccessRights()
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Returns:
      This builder for chaining.

    • setAccessRightsBytes

      public WarcMetadata.Builder setAccessRightsBytes(com.google.protobuf.ByteString value)
       Access restrictions or rights information
      optional string access_rights = 51 [json_name = "accessRights"];
      Parameters:
      value - The bytes for accessRights to set.
      Returns:
      This builder for chaining.

    • getPreservationActionsList

      public com.google.protobuf.ProtocolStringList getPreservationActionsList()
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Specified by:
      getPreservationActionsList in interface WarcMetadataOrBuilder
      Returns:
      A list containing the preservationActions.

    • getPreservationActionsCount

      public int getPreservationActionsCount()
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Specified by:
      getPreservationActionsCount in interface WarcMetadataOrBuilder
      Returns:
      The count of preservationActions.

    • getPreservationActions

      public String getPreservationActions(int index)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Specified by:
      getPreservationActions in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the element to return.
      Returns:
      The preservationActions at the given index.

    • getPreservationActionsBytes

      public com.google.protobuf.ByteString getPreservationActionsBytes(int index)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Specified by:
      getPreservationActionsBytes in interface WarcMetadataOrBuilder
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the preservationActions at the given index.

    • setPreservationActions

      public WarcMetadata.Builder setPreservationActions(int index, String value)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Parameters:
      index - The index to set the value at.
      value - The preservationActions to set.
      Returns:
      This builder for chaining.

    • addPreservationActions

      public WarcMetadata.Builder addPreservationActions(String value)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Parameters:
      value - The preservationActions to add.
      Returns:
      This builder for chaining.

    • addAllPreservationActions

      public WarcMetadata.Builder addAllPreservationActions(Iterable<String> values)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Parameters:
      values - The preservationActions to add.
      Returns:
      This builder for chaining.

    • clearPreservationActions

      public WarcMetadata.Builder clearPreservationActions()
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Returns:
      This builder for chaining.

    • addPreservationActionsBytes

      public WarcMetadata.Builder addPreservationActionsBytes(com.google.protobuf.ByteString value)
       Preservation actions taken on this record
      repeated string preservation_actions = 52 [json_name = "preservationActions"];
      Parameters:
      value - The bytes of the preservationActions to add.
      Returns:
      This builder for chaining.

    • getMigrationHistoryList

      public List<WarcMigration> getMigrationHistoryList()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];
      Specified by:
      getMigrationHistoryList in interface WarcMetadataOrBuilder

    • getMigrationHistoryCount

      public int getMigrationHistoryCount()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];
      Specified by:
      getMigrationHistoryCount in interface WarcMetadataOrBuilder

    • getMigrationHistory

      public WarcMigration getMigrationHistory(int index)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];
      Specified by:
      getMigrationHistory in interface WarcMetadataOrBuilder

    • setMigrationHistory

      public WarcMetadata.Builder setMigrationHistory(int index, WarcMigration value)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • setMigrationHistory

      public WarcMetadata.Builder setMigrationHistory(int index, WarcMigration.Builder builderForValue)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addMigrationHistory

      public WarcMetadata.Builder addMigrationHistory(WarcMigration value)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addMigrationHistory

      public WarcMetadata.Builder addMigrationHistory(int index, WarcMigration value)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addMigrationHistory

      public WarcMetadata.Builder addMigrationHistory(WarcMigration.Builder builderForValue)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addMigrationHistory

      public WarcMetadata.Builder addMigrationHistory(int index, WarcMigration.Builder builderForValue)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addAllMigrationHistory

      public WarcMetadata.Builder addAllMigrationHistory(Iterable<? extends WarcMigration> values)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • clearMigrationHistory

      public WarcMetadata.Builder clearMigrationHistory()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • removeMigrationHistory

      public WarcMetadata.Builder removeMigrationHistory(int index)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • getMigrationHistoryBuilder

      public WarcMigration.Builder getMigrationHistoryBuilder(int index)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • getMigrationHistoryOrBuilder

      public WarcMigrationOrBuilder getMigrationHistoryOrBuilder(int index)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];
      Specified by:
      getMigrationHistoryOrBuilder in interface WarcMetadataOrBuilder

    • getMigrationHistoryOrBuilderList

      public List<? extends WarcMigrationOrBuilder> getMigrationHistoryOrBuilderList()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];
      Specified by:
      getMigrationHistoryOrBuilderList in interface WarcMetadataOrBuilder

    • addMigrationHistoryBuilder

      public WarcMigration.Builder addMigrationHistoryBuilder()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • addMigrationHistoryBuilder

      public WarcMigration.Builder addMigrationHistoryBuilder(int index)
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • getMigrationHistoryBuilderList

      public List<WarcMigration.Builder> getMigrationHistoryBuilderList()
       Migration history if the record has been migrated
      repeated .ai.pipestream.parsed.data.warc.v1.WarcMigration migration_history = 53 [json_name = "migrationHistory"];

    • hasDetectedMimeType

      public boolean hasDetectedMimeType()
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Specified by:
      hasDetectedMimeType in interface WarcMetadataOrBuilder
      Returns:
      Whether the detectedMimeType field is set.

    • getDetectedMimeType

      public String getDetectedMimeType()
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Specified by:
      getDetectedMimeType in interface WarcMetadataOrBuilder
      Returns:
      The detectedMimeType.

    • getDetectedMimeTypeBytes

      public com.google.protobuf.ByteString getDetectedMimeTypeBytes()
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Specified by:
      getDetectedMimeTypeBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for detectedMimeType.

    • setDetectedMimeType

      public WarcMetadata.Builder setDetectedMimeType(String value)
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Parameters:
      value - The detectedMimeType to set.
      Returns:
      This builder for chaining.

    • clearDetectedMimeType

      public WarcMetadata.Builder clearDetectedMimeType()
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Returns:
      This builder for chaining.

    • setDetectedMimeTypeBytes

      public WarcMetadata.Builder setDetectedMimeTypeBytes(com.google.protobuf.ByteString value)
       MIME type as detected by content analysis
      optional string detected_mime_type = 54 [json_name = "detectedMimeType"];
      Parameters:
      value - The bytes for detectedMimeType to set.
      Returns:
      This builder for chaining.

    • hasFormatVersion

      public boolean hasFormatVersion()
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Specified by:
      hasFormatVersion in interface WarcMetadataOrBuilder
      Returns:
      Whether the formatVersion field is set.

    • getFormatVersion

      public String getFormatVersion()
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Specified by:
      getFormatVersion in interface WarcMetadataOrBuilder
      Returns:
      The formatVersion.

    • getFormatVersionBytes

      public com.google.protobuf.ByteString getFormatVersionBytes()
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Specified by:
      getFormatVersionBytes in interface WarcMetadataOrBuilder
      Returns:
      The bytes for formatVersion.

    • setFormatVersion

      public WarcMetadata.Builder setFormatVersion(String value)
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Parameters:
      value - The formatVersion to set.
      Returns:
      This builder for chaining.

    • clearFormatVersion

      public WarcMetadata.Builder clearFormatVersion()
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Returns:
      This builder for chaining.

    • setFormatVersionBytes

      public WarcMetadata.Builder setFormatVersionBytes(com.google.protobuf.ByteString value)
       File format version (if applicable)
      optional string format_version = 55 [json_name = "formatVersion"];
      Parameters:
      value - The bytes for formatVersion to set.
      Returns:
      This builder for chaining.

    • getTechnicalPropertiesList

      public List<WarcTechnicalProperty> getTechnicalPropertiesList()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];
      Specified by:
      getTechnicalPropertiesList in interface WarcMetadataOrBuilder

    • getTechnicalPropertiesCount

      public int getTechnicalPropertiesCount()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];
      Specified by:
      getTechnicalPropertiesCount in interface WarcMetadataOrBuilder

    • getTechnicalProperties

      public WarcTechnicalProperty getTechnicalProperties(int index)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];
      Specified by:
      getTechnicalProperties in interface WarcMetadataOrBuilder

    • setTechnicalProperties

      public WarcMetadata.Builder setTechnicalProperties(int index, WarcTechnicalProperty value)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • setTechnicalProperties

      public WarcMetadata.Builder setTechnicalProperties(int index, WarcTechnicalProperty.Builder builderForValue)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addTechnicalProperties

      public WarcMetadata.Builder addTechnicalProperties(WarcTechnicalProperty value)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addTechnicalProperties

      public WarcMetadata.Builder addTechnicalProperties(int index, WarcTechnicalProperty value)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addTechnicalProperties

      public WarcMetadata.Builder addTechnicalProperties(WarcTechnicalProperty.Builder builderForValue)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addTechnicalProperties

      public WarcMetadata.Builder addTechnicalProperties(int index, WarcTechnicalProperty.Builder builderForValue)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addAllTechnicalProperties

      public WarcMetadata.Builder addAllTechnicalProperties(Iterable<? extends WarcTechnicalProperty> values)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • clearTechnicalProperties

      public WarcMetadata.Builder clearTechnicalProperties()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • removeTechnicalProperties

      public WarcMetadata.Builder removeTechnicalProperties(int index)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • getTechnicalPropertiesBuilder

      public WarcTechnicalProperty.Builder getTechnicalPropertiesBuilder(int index)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • getTechnicalPropertiesOrBuilder

      public WarcTechnicalPropertyOrBuilder getTechnicalPropertiesOrBuilder(int index)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];
      Specified by:
      getTechnicalPropertiesOrBuilder in interface WarcMetadataOrBuilder

    • getTechnicalPropertiesOrBuilderList

      public List<? extends WarcTechnicalPropertyOrBuilder> getTechnicalPropertiesOrBuilderList()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];
      Specified by:
      getTechnicalPropertiesOrBuilderList in interface WarcMetadataOrBuilder

    • addTechnicalPropertiesBuilder

      public WarcTechnicalProperty.Builder addTechnicalPropertiesBuilder()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • addTechnicalPropertiesBuilder

      public WarcTechnicalProperty.Builder addTechnicalPropertiesBuilder(int index)
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • getTechnicalPropertiesBuilderList

      public List<WarcTechnicalProperty.Builder> getTechnicalPropertiesBuilderList()
       Technical properties specific to the content type
      repeated .ai.pipestream.parsed.data.warc.v1.WarcTechnicalProperty technical_properties = 56 [json_name = "technicalProperties"];

    • getEmbeddedResourcesList

      public List<WarcEmbeddedResource> getEmbeddedResourcesList()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];
      Specified by:
      getEmbeddedResourcesList in interface WarcMetadataOrBuilder

    • getEmbeddedResourcesCount

      public int getEmbeddedResourcesCount()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];
      Specified by:
      getEmbeddedResourcesCount in interface WarcMetadataOrBuilder

    • getEmbeddedResources

      public WarcEmbeddedResource getEmbeddedResources(int index)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];
      Specified by:
      getEmbeddedResources in interface WarcMetadataOrBuilder

    • setEmbeddedResources

      public WarcMetadata.Builder setEmbeddedResources(int index, WarcEmbeddedResource value)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • setEmbeddedResources

      public WarcMetadata.Builder setEmbeddedResources(int index, WarcEmbeddedResource.Builder builderForValue)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addEmbeddedResources

      public WarcMetadata.Builder addEmbeddedResources(WarcEmbeddedResource value)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addEmbeddedResources

      public WarcMetadata.Builder addEmbeddedResources(int index, WarcEmbeddedResource value)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addEmbeddedResources

      public WarcMetadata.Builder addEmbeddedResources(WarcEmbeddedResource.Builder builderForValue)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addEmbeddedResources

      public WarcMetadata.Builder addEmbeddedResources(int index, WarcEmbeddedResource.Builder builderForValue)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addAllEmbeddedResources

      public WarcMetadata.Builder addAllEmbeddedResources(Iterable<? extends WarcEmbeddedResource> values)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • clearEmbeddedResources

      public WarcMetadata.Builder clearEmbeddedResources()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • removeEmbeddedResources

      public WarcMetadata.Builder removeEmbeddedResources(int index)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • getEmbeddedResourcesBuilder

      public WarcEmbeddedResource.Builder getEmbeddedResourcesBuilder(int index)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • getEmbeddedResourcesOrBuilder

      public WarcEmbeddedResourceOrBuilder getEmbeddedResourcesOrBuilder(int index)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];
      Specified by:
      getEmbeddedResourcesOrBuilder in interface WarcMetadataOrBuilder

    • getEmbeddedResourcesOrBuilderList

      public List<? extends WarcEmbeddedResourceOrBuilder> getEmbeddedResourcesOrBuilderList()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];
      Specified by:
      getEmbeddedResourcesOrBuilderList in interface WarcMetadataOrBuilder

    • addEmbeddedResourcesBuilder

      public WarcEmbeddedResource.Builder addEmbeddedResourcesBuilder()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • addEmbeddedResourcesBuilder

      public WarcEmbeddedResource.Builder addEmbeddedResourcesBuilder(int index)
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • getEmbeddedResourcesBuilderList

      public List<WarcEmbeddedResource.Builder> getEmbeddedResourcesBuilderList()
       Embedded resources found within this record
      repeated .ai.pipestream.parsed.data.warc.v1.WarcEmbeddedResource embedded_resources = 57 [json_name = "embeddedResources"];

    • hasAdditionalMetadata

      public boolean hasAdditionalMetadata()
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];
      Specified by:
      hasAdditionalMetadata in interface WarcMetadataOrBuilder
      Returns:
      Whether the additionalMetadata field is set.

    • getAdditionalMetadata

      public com.google.protobuf.Struct getAdditionalMetadata()
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];
      Specified by:
      getAdditionalMetadata in interface WarcMetadataOrBuilder
      Returns:
      The additionalMetadata.

    • setAdditionalMetadata

      public WarcMetadata.Builder setAdditionalMetadata(com.google.protobuf.Struct value)
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];

    • setAdditionalMetadata

      public WarcMetadata.Builder setAdditionalMetadata(com.google.protobuf.Struct.Builder builderForValue)
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];

    • mergeAdditionalMetadata

      public WarcMetadata.Builder mergeAdditionalMetadata(com.google.protobuf.Struct value)
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];

    • clearAdditionalMetadata

      public WarcMetadata.Builder clearAdditionalMetadata()
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];

    • getAdditionalMetadataBuilder

      public com.google.protobuf.Struct.Builder getAdditionalMetadataBuilder()
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];

    • getAdditionalMetadataOrBuilder

      public com.google.protobuf.StructOrBuilder getAdditionalMetadataOrBuilder()
       === Catch-all for unmapped WARC-specific metadata ===
      .google.protobuf.Struct additional_metadata = 200 [json_name = "additionalMetadata"];
      Specified by:
      getAdditionalMetadataOrBuilder in interface WarcMetadataOrBuilder

    • hasBaseFields

      public boolean hasBaseFields()
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];
      Specified by:
      hasBaseFields in interface WarcMetadataOrBuilder
      Returns:
      Whether the baseFields field is set.

    • getBaseFields

      public TikaBaseFields getBaseFields()
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];
      Specified by:
      getBaseFields in interface WarcMetadataOrBuilder
      Returns:
      The baseFields.

    • setBaseFields

      public WarcMetadata.Builder setBaseFields(TikaBaseFields value)
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];

    • setBaseFields

      public WarcMetadata.Builder setBaseFields(TikaBaseFields.Builder builderForValue)
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];

    • mergeBaseFields

      public WarcMetadata.Builder mergeBaseFields(TikaBaseFields value)
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];

    • clearBaseFields

      public WarcMetadata.Builder clearBaseFields()
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];

    • getBaseFieldsBuilder

      public TikaBaseFields.Builder getBaseFieldsBuilder()
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];

    • getBaseFieldsOrBuilder

      public TikaBaseFieldsOrBuilder getBaseFieldsOrBuilder()
       Base Tika fields common to all document types
      .ai.pipestream.parsed.data.tika.base.v1.TikaBaseFields base_fields = 201 [json_name = "baseFields"];
      Specified by:
      getBaseFieldsOrBuilder in interface WarcMetadataOrBuilder