A
B
C
D
E
F
G
H
I
J
L
M
N
O
P
Q
R
S
T
U
V
W
S
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Scan webpages in the storage whose url start with urlPrefix
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scheduleOn(java.util.concurrent.ScheduledExecutorService) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
- Specifies the executor to use while scheduling reporting of metrics.
- ScopedUrlNormalizer - class in ai.platon.pulsar.skeleton.workflow.filter
- Interface used to convert URLs to normal form and optionally perform substitutions
- ScopedUrlNormalizerKt - class in ai.platon.pulsar.skeleton.workflow.filter
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- SequentialBrowserProfileGenerator - class in ai.platon.pulsar.browser.privacy
- serialize() - function in ai.platon.pulsar.common.urls.AbstractUrl
- serializeTo(kotlin.text.StringBuilder) - function in ai.platon.pulsar.common.urls.Hyperlink
- ServerSideEvent - class in ai.platon.pulsar.skeleton.event
- Server-side event data structure.
- ServerSideEventHandlers - class in ai.platon.pulsar.skeleton.event
- Server-side event handlers for capturing and broadcasting events during the page lifecycle.
- ServiceUnavailableException - class in ai.platon.pulsar.skeleton.common
- setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAliases(java.util.Map) - function in ai.platon.pulsar.skeleton.workflow.parse.ParserConfig
- setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setArgs(java.util.Map) - function in ai.platon.pulsar.persist.ParseStatus
- setArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The additional url arguments
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Authentication token for authorized access to protected resources.
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setAutoScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Number of times to scroll down the page after initial load.
- setBatchStat(ai.platon.pulsar.skeleton.workflow.fetch.BatchStat) - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchTask
- setBbsUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setBe(ai.platon.pulsar.skeleton.event.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setBe(ai.platon.pulsar.skeleton.event.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setBlogUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.event.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the browsing stage.
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.event.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the browsing stage.
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.event.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- Event handlers during the browsing stage.
- setBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default browser is chrome with pulsar implemented web driver.
- setCe(ai.platon.pulsar.skeleton.event.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setCe(ai.platon.pulsar.skeleton.event.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setCode(java.lang.Short,java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
- setCollectCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setCollectedCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.BrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.DefaultBrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.PrototypeBrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.RandomBrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.SequentialBrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.browser.privacy.SystemDefaultBrowserProfileGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.LazyConfigurable
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.Protocol
- setConf(ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.workflow.parse.PageParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.workflow.protocol.RobotRulesParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.workflow.protocol.RobotRulesParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.workflow.protocol.http.AbstractHttpProtocol
- The configuration
- setCountry(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setCountry(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setCountry(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The country of this hyperlink
- setCpuLoad(java.lang.Double) - function in ai.platon.pulsar.skeleton.CoreMetrics.Companion
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.event.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the browser stage.
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.event.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the browser stage.
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.event.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- Event handlers during the browser stage.
- setCRITICAL_CPU_THRESHOLD(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
- setCRITICAL_MEMORY_THRESHOLD_MIB(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
- setDeadline(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Absolute deadline after which the task should be discarded.
- setDeadTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setDepth(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setDepth(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The depth of this hyperlink
- setDetail(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
- A url aware object that contains the url and its related information.
- setDetailUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setDistrict(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setDistrict(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setDistrict(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The district of this hyperlink
- setDocument(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.workflow.parse.ParseResult
- setDropContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- When enabled, page content (HTML) will not be stored in the database.
- setEnableReporter(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.CoreMetrics
- setEntity(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Represents the type of content being crawled, such as an article, product, or hotel.
- setEventExceptionHandler(kotlin.jvm.functions.Function1) - function in ai.platon.pulsar.common.event.AbstractEventEmitter
- setEventHandlers(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableListenableHyperlink
- The event handler
- setEventHandlers(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.workflow.common.url.ListenableHyperlink
- The event handler
- setEventHandlers(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.workflow.common.url.ParsableHyperlink
- The PageEvent handlers of this hyperlink.
- setEventHandlers(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.workflow.common.url.StatefulListenableHyperlink
- The event handler
- setException(java.lang.Throwable) - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchResult
- setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default time to expire
- setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Absolute timestamp after which cached content should be refetched.
- setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default expiry time, some time we may need expire all pages by default, for example, in test mode
- setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Duration after which cached content is considered stale and should be refetched.
- setFailed(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
- setFetchSchedule(ai.platon.pulsar.core.api.WebPage,ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- setFetchSchedule(ai.platon.pulsar.core.api.WebPage,ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- setFetchSchedule(ai.platon.pulsar.core.api.WebPage,ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.workflow.schedule.FetchSchedule
- setFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo
- The actual latest fetch time, WebPage.
- setFieldByAnnotation(ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions.Companion
- Sets the value of a field based on its annotation name.
- setFirstCollectTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.workflow.parse.FilterResult
- setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.workflow.parse.ParseResult
- setFORBID_ALL_RULES(crawlercommons.robots.BaseRobotRules) - function in ai.platon.pulsar.skeleton.workflow.protocol.RobotRulesParser.Companion
- A BaseRobotRules object appropriate for use when the
robots.txtfile is not fetched due to a403/Forbiddenresponse; all requests are disallowed. - setGlobalCache(ai.platon.pulsar.skeleton.workflow.common.GlobalCache) - function in ai.platon.pulsar.skeleton.workflow.common.GlobalCacheFactory.Companion
- Set the global cache instance.
- setGroup(java.lang.String) - function in ai.platon.pulsar.browser.privacy.SequentialBrowserProfileGenerator
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setHostName(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setHref(java.net.URL) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
- The href is the raw url in the html without normalization, for example, a url with a timestamp query parameter added.
- setHref(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The hypertext reference, It defines the address of the document, which this time is linked from
- setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- If true, still fetch the page even if it is gone.
- setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Attempts to fetch a page even if previous fetch attempts have failed.
- setIgnoreUrlQuery(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Removes query parameters from URLs during processing.
- setIncognito(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setIndexUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setInitialDelay(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- setInteractLevel(ai.platon.pulsar.common.browser.InteractLevel) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Controls the level of interaction with web pages during crawling.
- setInterval(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- setItemExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Absolute timestamp after which item detail pages should be refetched.
- setItemExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Cache expiration duration specifically for item detail pages.
- setItemPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Page load timeout for item detail pages.
- setItemRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum number of links required for item detail pages.
- setItemRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum number of images required for item detail pages.
- setItemRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum page size required for item detail pages.
- setItemScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- JavaScript execution timeout for item detail pages.
- setItemScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Number of scroll actions for item detail pages.
- setItemScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Time interval between scrolls for item detail pages.
- setJobName(java.lang.String) - function in ai.platon.pulsar.loop.impl.StreamingTaskRunner
- The job name.
- setLabel(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- A label to categorize tasks into logical groups.
- setLabel(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- A label used to identify the session
- setLabel(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- A label used to identify the session
- setLang(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setLang(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setLang(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The language of this hyperlink
- setLastCollectedTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Lazy flush.
- setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Controls when pages are flushed to the database.
- setLe(ai.platon.pulsar.skeleton.event.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setLe(ai.platon.pulsar.skeleton.event.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- setLoadArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
- setLoadEventHandlers(ai.platon.pulsar.skeleton.event.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the loading stage.
- setLoadEventHandlers(ai.platon.pulsar.skeleton.event.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.event.AbstractPageEventHandlers
- Event handlers during the loading stage.
- setLoadEventHandlers(ai.platon.pulsar.skeleton.event.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.event.PageEventHandlers
- Event handlers during the loading stage.
- setMajorCode(java.lang.Short) - function in ai.platon.pulsar.persist.ParseStatus
- setMaxLoops(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.filter.ChainedUrlNormalizer
- setMediaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setMinorCode(java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
- setMinorCode(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
- The collector name
- setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- There are several cases to enable jit retry.
- setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Maximum number of immediate retries during a single fetch operation.
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Maximum number of fetch retries before marking a page as permanently failed.
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The maximum number of retries
- setNoNorm(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Disables URL normalization during link processing.
- setNRetries(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchTask
- setNumTasksSuccess(java.lang.Long) - function in ai.platon.pulsar.skeleton.workflow.fetch.BatchStat
- setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The order of this hyperlink in it referrer page
- setOutLinkPattern(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Regular expression pattern to filter extracted outlinks.
- setOutLinkSelector(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- CSS selector used to identify and extract links from portal/index pages.
- setPageEventHandlers(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.event.PulsarEventBus
- The page event handlers.
- setPageGoneSchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method specifies how to schedule refetching of pages marked as GONE.
- setPageGoneSchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method specifies how to schedule refetching of pages marked as GONE.
- setPageGoneSchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.FetchSchedule
- setPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Maximum time to wait for page loading to complete.
- setPageRetrySchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
- setPageRetrySchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
- setPageRetrySchedule(ai.platon.pulsar.core.api.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.FetchSchedule
- setPageViews(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setParent(ai.platon.pulsar.skeleton.workflow.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.workflow.parse.AbstractParseFilter
- The parent filter
- setParent(ai.platon.pulsar.skeleton.workflow.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.workflow.parse.AbstractParseFilter
- The parent filter
- setParent(ai.platon.pulsar.skeleton.workflow.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.workflow.parse.ParseFilter
- The parent filter
- setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Trigger the parse phase or not.
- setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Enables immediate parsing of fetched pages.
- setParseResult(ai.platon.pulsar.skeleton.workflow.parse.ParseResult) - function in ai.platon.pulsar.skeleton.workflow.parse.html.ParseContext
- setParsers(.<Error class: unknown class>) - function in ai.platon.pulsar.skeleton.workflow.parse.ParseResult
- setParsers(java.lang.String,java.util.List) - function in ai.platon.pulsar.skeleton.workflow.parse.ParserConfig
- setPersist(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Controls whether fetched pages are immediately persisted to storage.
- setPrevFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo
- The previous actual latest fetch time
- setPrevModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.ModifyInfo
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Determines task execution priority in the browser queue.
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The priority of this hyperlink
- setProxyEntry(ai.platon.pulsar.common.proxy.ProxyEntry) - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchTask
- setRawEvent(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setRawItemEvent(ai.platon.pulsar.skeleton.event.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setReadonly(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- When enabled, ensures the crawler operates in a non-destructive mode.
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The url of the referrer page
- setRefresh(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum number of anchor (link) elements required for a page to be considered complete.
- setRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum number of images required for a page to be considered complete.
- setRequireNotBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- CSS selector for an element that must contain non-blank text for valid retrieval.
- setRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Minimum acceptable page size in bytes to consider the fetch successful.
- setResource(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- When true, fetches the URL as a basic resource without browser rendering.
- setResponse(ai.platon.pulsar.skeleton.workflow.protocol.Response) - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchResult
- setResponse(ai.platon.pulsar.skeleton.workflow.protocol.Response) - function in ai.platon.pulsar.skeleton.workflow.protocol.Protocol
- setResponse(ai.platon.pulsar.skeleton.workflow.protocol.Response) - function in ai.platon.pulsar.skeleton.workflow.protocol.Protocol
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.loop.TaskRunner
- Delay policy for retry tasks
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.loop.impl.AbstractTaskRunner
- Delay policy for retry tasks
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.loop.impl.AbstractTaskRunner
- Delay policy for retry tasks
- setRunningChromeProcesses(java.lang.Integer) - function in ai.platon.pulsar.skeleton.CoreMetrics.Companion
- setScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Maximum time allowed for injected JavaScript execution before timeout.
- setScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Time interval between successive scroll actions.
- setSearchUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setServerSideEventHandlers(ai.platon.pulsar.skeleton.event.ServerSideEventHandlers) - function in ai.platon.pulsar.skeleton.event.PulsarEventBus
- The server-side event handlers for broadcasting events to external listeners.
- setSessionId(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The session id that requires the corresponding PulsarSession to handle this url.
- setSessionId(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The session id that requires the corresponding PulsarSession to handle this url.
- setStackTrace(kotlin.Array) - function in kotlin.Throwable
- setStartTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.fetch.BatchStat
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Store webpage content or not.
- setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Controls whether page content (HTML) is stored in the database.
- setSuccessOK() - function in ai.platon.pulsar.persist.ParseStatus
- setTaskId(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- A unique identifier for distinguishing between separate tasks.
- setTaskTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- A timestamp used to group related tasks into a batch.
- setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Set to be 0 if we are doing unit test or other test.
- setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Enables test mode with various verbosity levels.
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setText(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The anchor text
- setTiebaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setTopLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Maximum number of outlinks to extract and follow from a single page.
- setTotalNetworkIFsRecvBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.CoreMetrics
- The total all bytes received by the hardware last read from system
- setTotalSuccessBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.workflow.fetch.BatchStat
- setUnknownUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setUrl(java.lang.String) - function in ai.platon.pulsar.skeleton.workflow.common.url.CompletableHyperlink
- The url specification of the hyperlink, it is usually normalized, and can contain load arguments.
- setUrlPool(ai.platon.pulsar.common.collect.UrlPool) - function in ai.platon.pulsar.skeleton.workflow.common.GlobalCache
- A url pool contains many url caches, the urls added to the pool will be processed in Main loops.
- setUrls(kotlin.sequences.Sequence) - function in ai.platon.pulsar.loop.impl.StreamingTaskRunner
- The url sequence
- setUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setUrlsFromSeed(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setUrlsTooLong(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.fetch.UrlStat
- setUsedMemory(java.lang.Long) - function in ai.platon.pulsar.skeleton.CoreMetrics.Companion
- setValue(T,java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry
- setVerboseCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.message.PageLoadStatusFormatter
- setVersion(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Version identifier for the load options format.
- setWebdriverFetcher(ai.platon.pulsar.skeleton.workflow.fetch.WebDriverFetcher) - function in ai.platon.pulsar.browser.privacy.AbstractPrivacyContext
- shouldFetch(ai.platon.pulsar.core.api.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method provides information whether the page is suitable for selection in the current fetchlist.
- shouldFetch(ai.platon.pulsar.core.api.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.AbstractFetchSchedule
- This method provides information whether the page is suitable for selection in the current fetchlist.
- shouldFetch(ai.platon.pulsar.core.api.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.workflow.schedule.FetchSchedule
- shutdown() - function in ai.platon.pulsar.skeleton.context.PulsarContexts
- Closes all created contexts and shuts down Browser4.
- shutdownExecutorOnStop(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
- Specifies whether or not, the executor (used for reporting) will be stopped with same time with reporter.
- split(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions.Companion
- Split a command line into argument vector (argv).
- start() - function in ai.platon.pulsar.common.StartStopRunnable
- start() - function in ai.platon.pulsar.common.TaskLoop
- start() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.time.Duration,java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.time.Duration,java.time.Duration,kotlin.jvm.functions.Function0) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit,java.lang.Runnable) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start() - function in ai.platon.pulsar.loop.TaskLoops
- Start all loops matching the filter if not started.
- start() - function in ai.platon.pulsar.loop.impl.StreamingTaskLoop
- start() - function in ai.platon.pulsar.skeleton.CoreMetrics
- start() - function in ai.platon.pulsar.skeleton.common.metrics.MetricsSystem
- start(java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
- startsWith(java.lang.String) - function in ai.platon.pulsar.skeleton.common.metrics.MetricFilters
- startWork() - function in ai.platon.pulsar.skeleton.workflow.fetch.FetchTask
- StatefulListenableHyperlink - class in ai.platon.pulsar.skeleton.workflow.common.url
- A stateful hyperlink that has status and contains a PageEventHandlers to handle page events.
- StaticPulsarContext - class in ai.platon.pulsar.skeleton.context.support
- stats() - function in ai.platon.pulsar.skeleton.workflow.common.CaffeineExpiringCache
- stop() - function in ai.platon.pulsar.common.StartStopRunnable
- stop() - function in ai.platon.pulsar.common.TaskLoop
- stop() - function in ai.platon.pulsar.loop.TaskLoops
- Stop all loops matching the filter if started.
- stop() - function in ai.platon.pulsar.loop.impl.StreamingTaskLoop
- stop() - function in com.codahale.metrics.ScheduledReporter
- StreamingTaskLoop - class in ai.platon.pulsar.loop.impl
- StreamingTaskRunner - class in ai.platon.pulsar.loop.impl
- StreamingTaskRunner.Companion - class in ai.platon.pulsar.loop.impl.StreamingTaskRunner
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the Main loop.
- submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - subscribeWebDriver() - function in ai.platon.pulsar.browser.privacy.AbstractPrivacyContext
- success(java.lang.Integer) - function in ai.platon.pulsar.skeleton.workflow.parse.FilterResult.Companion
- success(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.workflow.parse.ParseResult.Companion
- supervised(ai.platon.pulsar.common.config.MutableConfig) - function in ai.platon.pulsar.skeleton.PulsarSettings.Companion
- Launch the browser in supervised mode.
- supervised() - function in ai.platon.pulsar.skeleton.PulsarSettings.Companion
- Launch the browser in supervised mode.
- suspendListeners() - function in ai.platon.pulsar.common.event.EventEmitter
- suspendListeners(ai.platon.pulsar.loop.impl.CrawlEvents) - function in ai.platon.pulsar.common.event.EventEmitter
- SystemDefaultBrowserProfileGenerator - class in ai.platon.pulsar.browser.privacy