A  B  C  D  E  F  G  H  I  J  L  M  N  O  P  Q  R  S  T  U  V  W  _ 

S

sanitize(org.jsoup.nodes.Document,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.JsoupUtils
 
scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.PulsarContext
Scan webpages in the storage whose url start with urlPrefix
scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.PulsarContext
 
scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
 
scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Scan pages in the storage.
scan(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.component.WebDbComponent
 
scheduleOn(java.util.concurrent.ScheduledExecutorService) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
Specifies the executor to use while scheduling reporting of metrics.
ScopedUrlNormalizer - class in ai.platon.pulsar.skeleton.crawl.filter
Interface used to convert URLs to normal form and optionally perform substitutions
ScopedUrlNormalizerKt - class in ai.platon.pulsar.skeleton.crawl.filter
 
ScoreVectorWritable - class in ai.platon.pulsar.skeleton.crawl.scoring.io
Created by vincent on 17-4-20.
ScoringFilter - class in ai.platon.pulsar.skeleton.crawl.scoring
 
ScoringFilterException - class in ai.platon.pulsar.skeleton.crawl.scoring
Specialized exception for errors during scoring.
ScoringFilters - class in ai.platon.pulsar.skeleton.crawl.scoring
 
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls down for count times.
scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls down for count times.
scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls down for count times.
scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
This method fetches an element with selector, scrolls it into view if needed.
scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
This method fetches an element with selector, scrolls it into view if needed.
scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
This method fetches an element with selector, scrolls it into view if needed.
scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls to the bottom.
scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the bottom.
scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the bottom.
scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls to the middle.
scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the middle.
scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the middle.
scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls to the middle.
scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the middle.
scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the middle.
scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls to the top.
scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the top.
scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls to the top.
scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The current page frame scrolls up for count times.
scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls up for count times.
scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current page frame scrolls up for count times.
scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Find image elements matching the CSS query.
selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find anchor elements matching the CSS query.
selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find anchor elements matching the CSS query.
selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the node's attribute values, the node is located by selector.
selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's attribute values, the node is located by selector.
selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's attribute values, the node is located by selector.
selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the node's attribute value, the node is located by selector, the attribute is attrName.
selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's attribute value, the node is located by selector, the attribute is attrName.
selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's attribute value, the node is located by selector, the attribute is attrName.
selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the node's property value, the node is located by selector, the property is attrName.
selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's property value, the node is located by selector, the property is attrName.
selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's property value, the node is located by selector, the property is attrName.
selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the node's text content, the node is located by selector.
selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's text content, the node is located by selector.
selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the node's text content, the node is located by selector.
selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Find hyperlinks in elements matching the CSS query.
selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find hyperlinks in elements matching the CSS query.
selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find hyperlinks in elements matching the CSS query.
selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Find image elements matching the CSS query.
selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find image elements matching the CSS query.
selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Find image elements matching the CSS query.
selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns the nodes' property values, the nodes are located by selector, the property is propName.
selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the nodes' property values, the nodes are located by selector, the property is propName.
selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns the nodes' property values, the nodes are located by selector, the property is propName.
selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Returns a list of text contents of all the elements matching the specified selector within the page.
selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns a list of text contents of all the elements matching the specified selector within the page.
selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Returns a list of text contents of all the elements matching the specified selector within the page.
selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
SequentialPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy
 
serialize() - function in ai.platon.pulsar.common.urls.AbstractUrl
 
serializeTo(kotlin.text.StringBuilder) - function in ai.platon.pulsar.common.urls.Hyperlink
 
ServiceUnavailableException - class in ai.platon.pulsar.skeleton.common
 
set(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
 
setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setAliases(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.parse.ParserConfig
 
setAllowLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setAnchorRegex(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
 
setArgs(java.util.Map) - function in ai.platon.pulsar.persist.ParseStatus
 
setArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The additional url arguments
setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Set the attribute of an element located by selector.
setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the attribute of an element located by selector.
setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the attribute of an element located by selector.
setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Set the attribute of all elements matching the CSS query.
setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the attribute of all elements matching the CSS query.
setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the attribute of all elements matching the CSS query.
setAuthToken(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
 
setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Authentication token for authorized access to protected resources.
setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setBadSeeds(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setBaseHref(java.net.URL) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
Sets the baseHref.
setBatchSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector
 
setBatchStat(ai.platon.pulsar.skeleton.crawl.fetch.BatchStat) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
 
setBbsUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setBe(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setBe(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setBlogUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
Event handlers during the browsing stage.
setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the browsing stage.
setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the browsing stage.
setBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
The default browser is chrome with pulsar implemented web driver.
setBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Specifies which browser engine to use for rendering pages.
setCe(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setCe(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setClassName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
 
setClickTarget(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector for elements to be clicked during page interaction.
setClosed(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
Indicate if the tab for this navigation is closed.
setCode(java.lang.Short,java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
 
setCollectCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setCollected(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
 
setCollectedCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setCollects(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.IndexWriter
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.IndexingFilter
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.LazyConfigurable
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.Protocol
 
setConf(ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.DefaultPrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrototypePrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.RandomPrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SequentialPrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SystemDefaultPrivacyAgentGenerator
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.parse.PageParser
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser
 
setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.http.AbstractHttpProtocol
The configuration
setContext(ai.platon.pulsar.skeleton.context.PulsarContext) - function in ai.platon.pulsar.skeleton.context.ContextAware
 
setCountry(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setCountry(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setCountry(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The country of this hyperlink
setCpuLoad(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
 
setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
Event handlers during the crawl stage.
setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the crawl stage.
setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the crawl stage.
setCRITICAL_CPU_THRESHOLD(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
 
setCRITICAL_MEMORY_THRESHOLD_MIB(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
 
setDeadline(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Absolute deadline after which the task should be discarded.
setDeadTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setDefaultCharEncoding(java.lang.String) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
 
setDepth(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setDepth(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The depth of this hyperlink
setDescription(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
 
setDetail(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
A url aware object that contains the url and its related information.
setDetailUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setDistrict(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setDistrict(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setDistrict(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The district of this hyperlink
setDoc(ai.platon.pulsar.skeleton.crawl.index.IndexDocument) - function in ai.platon.pulsar.skeleton.crawl.index.io.IndexDocumentWritable
 
setDocument(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
 
setDocumentReadyTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
The time when the document is ready.
setDropContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
When enabled, page content (HTML) will not be stored in the database.
setEnableReporter(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
 
setEntity(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
The entity name representing the type of content being crawled (e.g., article, product, hotel).
setEventExceptionHandler(kotlin.jvm.functions.Function1) - function in ai.platon.pulsar.common.event.AbstractEventEmitter
 
setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableListenableHyperlink
The event handler
setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.ListenableHyperlink
The event handler
setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.ParsableHyperlink
The PageEvent handlers of this hyperlink.
setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.StatefulListenableHyperlink
The event handler
setException(java.lang.Throwable) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult
 
setException(ai.platon.pulsar.skeleton.crawl.fetch.driver.JsException) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
 
setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
The default time to expire
setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Absolute timestamp after which cached content should be refetched.
setExpiredLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
The default expiry time, some time we may need expire all pages by default, for example, in test mode
setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Duration after which cached content is considered stale and should be refetched.
setFailed(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
 
setFetchLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setFetchMode(ai.platon.pulsar.persist.metadata.FetchMode) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Specifies the mechanism used to fetch web content.
setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
 
setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
 
setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
 
setFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
The actual latest fetch time, WebPage.
setFieldByAnnotation(ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions.Companion
Sets the value of a field based on its annotation name.
setFingerprint(ai.platon.pulsar.common.browser.Fingerprint) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyAgent
 
setFirstCollectTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.crawl.parse.FilterResult
 
setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
 
setFORBID_ALL_RULES(crawlercommons.robots.BaseRobotRules) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser.Companion
A BaseRobotRules object appropriate for use when the robots.txt file is not fetched due to a 403/Forbidden response; all requests are disallowed.
setFreshLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setGlobalCache(ai.platon.pulsar.skeleton.crawl.common.GlobalCache) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCacheFactory.Companion
Set the global cache instance.
setGOOD_CONTENT_TEXT_LENGTH(java.lang.Integer) - function in ai.platon.pulsar.skeleton.signature.TextProfileSignature.Companion
 
setGroup(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SequentialPrivacyAgentGenerator
 
setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.CommonOptions
 
setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.CommonOptions
 
setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setHostName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
 
setHref(java.net.URL) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
The href is the raw url in the html without normalization, for example, an url with a timestamp query parameter added.
setHref(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The hypertext reference, It defines the address of the document, which this time is linked from
setIdleTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
 
setIframe(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
The index of the iframe to focus on during page interaction.
setIGNORED_PAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
 
setIgnoreDOMFeatures(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Whether the driver should calculate the DOM features.
setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
If true, still fetch the page even if it is gone.
setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Attempts to fetch a page even if previous fetch attempts have failed.
setIgnoreUrlQuery(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Removes query parameters from URLs during processing.
setIncognito(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Enables browser incognito/private mode for page fetching.
setIndexed(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setIndexUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setInitialDelay(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
setInteractLevel(ai.platon.pulsar.common.browser.InteractLevel) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Controls the level of interaction with web pages during crawling.
setInterval(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
setItemBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Browser to use specifically for item detail pages (as opposed to index pages).
setItemExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Absolute timestamp after which item detail pages should be refetched.
setItemExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Cache expiration duration specifically for item detail pages.
setItemPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Page load timeout for item detail pages.
setItemRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum number of links required for item detail pages.
setItemRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum number of images required for item detail pages.
setItemRequireNotBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector for content validation on item detail pages.
setItemRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum page size required for item detail pages.
setItemScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
JavaScript execution timeout for item detail pages.
setItemScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Number of scroll actions for item detail pages.
setItemScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Time interval between scrolls for item detail pages.
setItemWaitNonBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector for non-blank text validation on item detail pages.
setJobName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
The job name.
setKey(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
 
setLabel(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Optional label used to categorize tasks into logical groups.
setLang(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setLang(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setLang(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The language of this hyperlink
setLastActiveTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
 
setLastActiveTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
The last active time.
setLastCollectedTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
 
setLastFailedLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setLAZY_PAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
 
setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
Lazy flush.
setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Controls when pages are flushed to the database.
setLe(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setLe(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
 
setLoadArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
 
setLoadArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
 
setLoadedSeeds(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
Event handlers during the loading stage.
setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the loading stage.
setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
Event handlers during the loading stage.
setLOG(org.slf4j.Logger) - function in ai.platon.pulsar.skeleton.crawl.index.IndexWriters
 
setLOG(org.slf4j.Logger) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.Companion
 
setLogLevel(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setLoss(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
 
setMainRequestCookies(java.util.List) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
 
setMainRequestHeaders(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
 
setMainRequestId(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
Main request is only used for HTML documents for now.
setMainResponseHeaders(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
 
setMainResponseStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
The response status of the main request
setMainResponseStatusText(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
 
setMajorCode(java.lang.Short) - function in ai.platon.pulsar.persist.ParseStatus
 
setMappedName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setMaxAnchorLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setMaxLoops(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.filter.ChainedUrlNormalizer
 
setMaxUrlLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setMediaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setMinAnchorLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setMinConfidence(int) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
 
setMinorCode(java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
 
setMinorCode(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
 
setMinUrlLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
 
setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
 
setMultiValued(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.CircularHyperlinkCollector
 
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.CircularLocalFileHyperlinkCollector
The collector name
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
 
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
The collector name
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalHyperlinkCollector
 
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector
The collector name
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
 
setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The navigate entry of the current page.
setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current navigation entry.
setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
The current navigation entry.
setNetCondition(ai.platon.pulsar.skeleton.common.options.Condition) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Deprecated network condition parameter, use interactLevel instead.
setNextPageSelector(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector to identify the "next page" link for pagination handling.
setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
There are several cases to enable jit retry.
setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Maximum number of immediate retries during a single fetch operation.
setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Maximum number of fetch retries before marking a page as permanently failed.
setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The maximum number of retries
setNoCache(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
A convenience method.
setNoFilter(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Disables URL filtering during link processing.
setNoFollow(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
A convenience method.
setNoIndex(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
A convenience method.
setNoNorm(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Disables URL normalization during link processing.
setNRetries(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
 
setNumTasksSuccess(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
 
setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
 
setOpener(ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
The opener of the current page.
setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
 
setOrder(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The order of this hyperlink in it referrer page
setOutLinkPattern(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Regular expression pattern to filter extracted outlinks.
setOutLinkSelector(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector used to identify and extract links from portal/index pages.
setPAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
 
setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
 
setPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Maximum time to wait for page loading to complete.
setPageReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
The referrer claimed by the page.
setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
 
setPageViews(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.AbstractParseFilter
The parent filter
setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.AbstractParseFilter
The parent filter
setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilter
The parent filter
setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
Trigger the parse phase or not.
setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Enables immediate parsing of fetched pages.
setParseResult(ai.platon.pulsar.skeleton.crawl.parse.ParseResult) - function in ai.platon.pulsar.skeleton.crawl.parse.html.ParseContext
 
setParsers(java.util.List) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
 
setParsers(java.lang.String,java.util.List) - function in ai.platon.pulsar.skeleton.crawl.parse.ParserConfig
 
setPersist(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Controls whether fetched pages are immediately persisted to storage.
setPrevFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
The previous actual latest fetch time
setPrevModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
 
setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
 
setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Determines task execution priority in the crawl queue.
setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The priority of this hyperlink
setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Set the property of an element located by selector.
setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the property of an element located by selector.
setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the property of an element located by selector.
setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Set the property of all elements matching the CSS query.
setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.MiniWebDriver
 
setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the property of all elements matching the CSS query.
setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Set the property of all elements matching the CSS query.
setProxy(ai.platon.pulsar.common.proxy.ProxyEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.BrowserId
 
setProxy(java.lang.String,java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.BrowserId
 
setProxyEntry(ai.platon.pulsar.common.proxy.ProxyEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
 
setRawEvent(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
 
setRawItemEvent(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
 
setReadonly(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
When enabled, ensures the crawler operates in a non-destructive mode.
setRecovered(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
 
setRecyclable(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
If a driver is recyclable, it should be closed after the task is done, and add to a standby pool, so it can be reused for other tasks.
setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
 
setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
 
setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The url of the referrer page
setRefresh(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
 
setRefresh(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
Sets refresh to the supplied value.
setRefreshHref(java.net.URL) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
Sets the refreshHref.
setRefreshTime(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
Sets the refreshTime.
setRegexMatchedLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
 
setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setReparseLinks(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Forces re-parsing of links even for previously parsed pages.
setRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum number of anchor (link) elements required for a page to be considered complete.
setRequired(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setRequired(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
 
setRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum number of images required for a page to be considered complete.
setRequireNotBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector for an element that must contain non-blank text for valid retrieval.
setRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Minimum acceptable page size in bytes to consider the fetch successful.
setResource(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
When true, fetches the URL as a basic resource without browser rendering.
setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult
 
setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol
 
setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol
 
setRestrictCss(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.Crawler
Delay policy for retry tasks
setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler
Delay policy for retry tasks
setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler
Delay policy for retry tasks
setReused(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
 
setRound(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
 
setRunningChromeProcesses(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
 
setScoreVector(ai.platon.pulsar.common.ScoreVector) - function in ai.platon.pulsar.skeleton.crawl.scoring.io.ScoreVectorWritable
 
setScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Maximum time allowed for injected JavaScript execution before timeout.
setScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Number of times to scroll down the page after initial load.
setScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Time interval between successive scroll actions.
setSearchUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setStackTrace(kotlin.Array) - function in kotlin.Throwable
 
setStartTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
 
setStatus(java.lang.Integer) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
 
setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
 
setStopped(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
Indicate if the navigation is stopped.
setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
Store webpage content or not.
setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Controls whether page content (HTML) is stored in the database.
setStored(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setSuccessOK() - function in ai.platon.pulsar.persist.ParseStatus
 
setTaskId(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Optional identifier to distinguish between separate tasks.
setTaskTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Timestamp used to identify a batch of related tasks.
setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
Set to be 0 if we are doing unit test or other test.
setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Enables test mode with various verbosity levels.
setText(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setText(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setText(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
 
setText(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The anchor text
setTiebaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setTimeouts(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
TODO: NOT IMPLEMENTED
setTimeouts(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
TODO: NOT IMPLEMENTED
setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
 
setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
 
setTopLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Maximum number of outlinks to extract and follow from a single page.
setTotalNetworkIFsRecvBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
The total all bytes received by the hardware last read from system
setTotalSuccessBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
 
setType(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
 
setUnfilteredLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
 
setUnknownUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setUnserializableValue(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
 
setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
 
setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
 
setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
 
setUrl(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
The url specification of the hyperlink, it is usually normalized, and can contain load arguments.
setUrl(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
 
setUrlContains(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setUrlNormalizer(ai.platon.pulsar.common.urls.preprocess.UrlNormalizerPipeline) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
 
setUrlNormalizer(ai.platon.pulsar.common.urls.preprocess.UrlNormalizerPipeline) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
 
setUrlPool(ai.platon.pulsar.common.collect.UrlPool) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache
A url pool contains many url caches, the urls added to the pool will be processed in crawl loops.
setUrlPostfix(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setUrlPrefix(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setUrlRegex(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
 
setUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setUrls(kotlin.sequences.Sequence) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
The url sequence
setUrlsFromSeed(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setUrlsTooLong(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
 
setUsedMemory(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
 
setUserAgentOverride(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractBrowser
 
setValue(java.lang.Integer,java.lang.Double) - function in ai.platon.pulsar.common.ScoreVector
 
setValue(java.lang.Integer,java.lang.Float) - function in ai.platon.pulsar.common.ScoreVector
 
setValue(java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.common.ScoreVector
 
setValue(java.lang.Integer) - function in ai.platon.pulsar.common.ScoreVector
 
setValue(T,java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry
 
setValue(java.lang.Object) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
 
setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
 
setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
 
setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
 
setVerboseCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.message.PageLoadStatusFormatter
 
setVersion(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
Version identifier for the load options format.
setWaitNonBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
CSS selector for an element that must contain non-blank text before proceeding.
setWebdriverFetcher(ai.platon.pulsar.skeleton.crawl.fetch.WebDriverFetcher) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext
 
setWeight(java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
 
setWeight(java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.index.IndexField
 
shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
 
shouldFetchVividPage(java.lang.String,java.time.Duration,java.time.Instant) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor
TODO: the logic is different from the one in LoadComponent
shutdown() - function in ai.platon.pulsar.skeleton.context.PulsarContexts
Close the all the created context.
shutdownExecutorOnStop(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
Specifies whether or not, the executor (used for reporting) will be stopped with same time with reporter.
Signature - class in ai.platon.pulsar.skeleton.signature
 
SignatureComparator - class in ai.platon.pulsar.skeleton.signature
 
SimpleCommandDispatcher - class in ai.platon.pulsar.skeleton.crawl.fetch.driver
Dispatches web driver commands provided in text format.
SimpleCommandDispatcher.Companion - class in ai.platon.pulsar.skeleton.crawl.fetch.driver.SimpleCommandDispatcher
 
size() - function in ai.platon.pulsar.common.ScoreVector
 
sniffCharacterEncoding(kotlin.Array) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
Given a byte[] representing an html file of an unknown encoding, read out 'charset' parameter in the meta tag from the first CHUNK_SIZE bytes.
sniffEncoding(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
 
split(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions.Companion
Split a command line into argument vector (argv).
spliterator() - function in kotlin.collections.Collection
 
SPONSORED - enum entry in ai.platon.pulsar.skeleton.common.domain.DomainSuffix.Status
 
start() - function in ai.platon.pulsar.common.CrawlLoop
 
start() - function in ai.platon.pulsar.common.StartStopRunnable
 
start() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start(java.time.Duration,java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start(java.time.Duration,java.time.Duration,kotlin.jvm.functions.Function0) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start(java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit,java.lang.Runnable) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
 
start() - function in ai.platon.pulsar.skeleton.common.metrics.MetricsSystem
 
start() - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
 
start() - function in ai.platon.pulsar.skeleton.crawl.CrawlLoops
Start all loops matching the filter if not started.
start() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawlLoop
 
start(java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
 
start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
 
startsWith(java.lang.String) - function in ai.platon.pulsar.skeleton.common.metrics.MetricFilters
 
STARTUP - enum entry in ai.platon.pulsar.skeleton.common.domain.DomainSuffix.Status
 
startWork() - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
 
startWork() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
Mark the driver as working, so it can not be used to do any another tasks.
state() - function in java.util.concurrent.CompletableFuture
 
StatefulListenableHyperlink - class in ai.platon.pulsar.skeleton.crawl.common.url
A stateful hyperlink that has status and contains a PageEventHandlers to handle page events.
StaticPulsarContext - class in ai.platon.pulsar.skeleton.context.support
 
stop() - function in ai.platon.pulsar.common.CrawlLoop
 
stop() - function in ai.platon.pulsar.common.StartStopRunnable
 
stop() - function in ai.platon.pulsar.skeleton.crawl.CrawlLoops
Stop all loops matching the filter if started.
stop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Force the page stop all navigations and RELEASES all resources.
stop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
Force the page stop all navigations and RELEASES all resources.
stop() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawlLoop
 
stop() - function in com.codahale.metrics.ScheduledReporter
 
stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
Force the page stop all navigations and RELEASES all resources.
stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
Force the page stop all navigations and RELEASES all resources.
stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
Force the page stop all navigations and RELEASES all resources.
stream() - function in kotlin.collections.Collection
 
StreamingCrawler - class in ai.platon.pulsar.skeleton.crawl.impl
 
StreamingCrawler.Companion - class in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
 
StreamingCrawlLoop - class in ai.platon.pulsar.skeleton.crawl.impl
 
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.PulsarContext
Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
No such version, it's too complicated to handle events
submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
No such version, it's too complicated to handle events
submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
No such version, it's too complicated to handle events
submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
No such version, it's too complicated to handle events
submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
Load the portal page and submit the out links specified by the -outLink option to the URL pool.
subscribeWebDriver() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext
 
success(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.FilterResult.Companion
 
success(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult.Companion
 
supervised() - function in ai.platon.pulsar.skeleton.PulsarSettings
Launch the browser in supervised mode.
suspendListeners() - function in ai.platon.pulsar.common.event.EventEmitter
 
suspendListeners(ai.platon.pulsar.skeleton.crawl.fetch.driver.BrowserEvents) - function in ai.platon.pulsar.common.event.EventEmitter
 
suspendListeners(ai.platon.pulsar.skeleton.crawl.impl.CrawlEvents) - function in ai.platon.pulsar.common.event.EventEmitter
 
synchronized(kotlin.jvm.functions.Function0) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
 
SystemDefaultPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy
 
A  B  C  D  E  F  G  H  I  J  L  M  N  O  P  Q  R  S  T  U  V  W  _