A
B
C
D
E
F
G
H
I
J
L
M
N
O
P
Q
R
S
T
U
V
W
_
S
- sanitize(org.jsoup.nodes.Document,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.JsoupUtils
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Scan webpages in the storage whose url start with urlPrefix
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,kotlin.Array) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Scan pages in the storage.
- scan(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.component.WebDbComponent
- scheduleOn(java.util.concurrent.ScheduledExecutorService) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
- Specifies the executor to use while scheduling reporting of metrics.
- ScopedUrlNormalizer - class in ai.platon.pulsar.skeleton.crawl.filter
- Interface used to convert URLs to normal form and optionally perform substitutions
- ScopedUrlNormalizerKt - class in ai.platon.pulsar.skeleton.crawl.filter
- ScoreVectorWritable - class in ai.platon.pulsar.skeleton.crawl.scoring.io
- Created by vincent on 17-4-20.
- ScoringFilter - class in ai.platon.pulsar.skeleton.crawl.scoring
- ScoringFilterException - class in ai.platon.pulsar.skeleton.crawl.scoring
- Specialized exception for errors during scoring.
- ScoringFilters - class in ai.platon.pulsar.skeleton.crawl.scoring
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrape(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrapeOutPages(java.lang.String,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
- scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls down for count times.
- scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls down for count times.
- scrollDown(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls down for count times.
- scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollDownAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- This method fetches an element with selector, scrolls it into view if needed.
- scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- This method fetches an element with selector, scrolls it into view if needed.
- scrollTo(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- This method fetches an element with selector, scrolls it into view if needed.
- scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls to the bottom.
- scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the bottom.
- scrollToBottom() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the bottom.
- scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToBottomAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls to the middle.
- scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the middle.
- scrollToMiddle(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the middle.
- scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls to the middle.
- scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the middle.
- scrollToScreen(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the middle.
- scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls to the top.
- scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the top.
- scrollToTop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls to the top.
- scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollToTopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The current page frame scrolls up for count times.
- scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls up for count times.
- scrollUp(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current page frame scrolls up for count times.
- scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- scrollUpAsync(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Find image elements matching the CSS query.
- selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find anchor elements matching the CSS query.
- selectAnchors(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find anchor elements matching the CSS query.
- selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
- selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
- selectAttributeAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the nodes' attribute values, the nodes are located by selector, the attribute is attrName.
- selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectAttributeAllAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the node's attribute values, the node is located by selector.
- selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's attribute values, the node is located by selector.
- selectAttributes(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's attribute values, the node is located by selector.
- selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstAttributeOptionalAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the node's attribute value, the node is located by selector, the attribute is attrName.
- selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's attribute value, the node is located by selector, the attribute is attrName.
- selectFirstAttributeOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's attribute value, the node is located by selector, the attribute is attrName.
- selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstAttributeOrNullAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the node's property value, the node is located by selector, the property is attrName.
- selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's property value, the node is located by selector, the property is attrName.
- selectFirstPropertyValueOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's property value, the node is located by selector, the property is attrName.
- selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstTextOptionalAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the node's text content, the node is located by selector.
- selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's text content, the node is located by selector.
- selectFirstTextOrNull(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the node's text content, the node is located by selector.
- selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectFirstTextOrNullAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Find hyperlinks in elements matching the CSS query.
- selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find hyperlinks in elements matching the CSS query.
- selectHyperlinks(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find hyperlinks in elements matching the CSS query.
- selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Find image elements matching the CSS query.
- selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find image elements matching the CSS query.
- selectImages(java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Find image elements matching the CSS query.
- selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns the nodes' property values, the nodes are located by selector, the property is propName.
- selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the nodes' property values, the nodes are located by selector, the property is propName.
- selectPropertyValueAll(java.lang.String,java.lang.String,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns the nodes' property values, the nodes are located by selector, the property is propName.
- selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Returns a list of text contents of all the elements matching the specified selector within the page.
- selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns a list of text contents of all the elements matching the specified selector within the page.
- selectTextAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Returns a list of text contents of all the elements matching the specified selector within the page.
- selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- selectTextAllAsync(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- SequentialPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy
- serialize() - function in ai.platon.pulsar.common.urls.AbstractUrl
- serializeTo(kotlin.text.StringBuilder) - function in ai.platon.pulsar.common.urls.Hyperlink
- ServiceUnavailableException - class in ai.platon.pulsar.skeleton.common
- set(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
- setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAcceptUnknownOptions(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAliases(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.parse.ParserConfig
- setAllowLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAllowParameterOverwriting(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setAnchorRegex(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setArgs(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setArgs(java.util.Map) - function in ai.platon.pulsar.persist.ParseStatus
- setArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The additional url arguments
- setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Set the attribute of an element located by selector.
- setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the attribute of an element located by selector.
- setAttribute(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the attribute of an element located by selector.
- setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Set the attribute of all elements matching the CSS query.
- setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the attribute of all elements matching the CSS query.
- setAttributeAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the attribute of all elements matching the CSS query.
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The auth token, used for authorization purpose.
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setAuthToken(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setBadSeeds(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setBaseHref(java.net.URL) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- Sets the
baseHref. - setBatchSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector
- setBatchStat(ai.platon.pulsar.skeleton.crawl.fetch.BatchStat) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
- setBbsUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setBe(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setBe(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setBlogUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- Event handlers during the browsing stage.
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the browsing stage.
- setBrowseEventHandlers(ai.platon.pulsar.skeleton.crawl.BrowseEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the browsing stage.
- setBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default browser is chrome with pulsar implemented web driver.
- setBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Specify which browser to use, google chrome is the default.
- setCe(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setCe(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setClassName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
- setClickTarget(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector for element to click.
- setClosed(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- Indicate if the tab for this navigation is closed.
- setCode(java.lang.Short,java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
- setCollectCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setCollected(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- setCollectedCount(java.lang.Integer) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setCollects(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.IndexWriter
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.IndexingFilter
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.LazyConfigurable
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.common.config.Protocol
- setConf(ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.DefaultPrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrototypePrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.RandomPrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SequentialPrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SystemDefaultPrivacyAgentGenerator
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.parse.PageParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser
- setConf(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.crawl.protocol.http.AbstractHttpProtocol
- The configuration
- setContext(ai.platon.pulsar.skeleton.context.PulsarContext) - function in ai.platon.pulsar.skeleton.context.ContextAware
- setCountry(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setCountry(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setCountry(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The country of this hyperlink
- setCpuLoad(java.lang.Double) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- Event handlers during the crawl stage.
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the crawl stage.
- setCrawlEventHandlers(ai.platon.pulsar.skeleton.crawl.CrawlEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the crawl stage.
- setCRITICAL_CPU_THRESHOLD(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
- setCRITICAL_MEMORY_THRESHOLD_MIB(java.lang.Double) - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion
- setDeadline(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The task's deadline indicates the time by which it should be completed.
- setDeadTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setDefaultCharEncoding(java.lang.String) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
- setDepth(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setDepth(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The depth of this hyperlink
- setDescription(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
- setDetail(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
- A url aware object that contains the url and its related information.
- setDetailUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setDistrict(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setDistrict(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setDistrict(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The district of this hyperlink
- setDoc(ai.platon.pulsar.skeleton.crawl.index.IndexDocument) - function in ai.platon.pulsar.skeleton.crawl.index.io.IndexDocumentWritable
- setDocument(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
- setDocumentReadyTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- The time when the document is ready.
- setDropContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If the option is set, do not persist the page content which is usually very large.
- setEnableReporter(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
- setEntity(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The entity name of the page, for example, article, product, hotel, flower, etc., it's optional.
- setEventExceptionHandler(kotlin.jvm.functions.Function1) - function in ai.platon.pulsar.common.event.AbstractEventEmitter
- setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableListenableHyperlink
- The event handler
- setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.ListenableHyperlink
- The event handler
- setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.ParsableHyperlink
- The PageEvent handlers of this hyperlink.
- setEventHandlers(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.common.url.StatefulListenableHyperlink
- The event handler
- setException(java.lang.Throwable) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult
- setException(ai.platon.pulsar.skeleton.crawl.fetch.driver.JsException) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
- setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setExpandAtSign(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default time to expire
- setExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The expiry time point.
- setExpiredLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- The default expiry time, some time we may need expire all pages by default, for example, in test mode
- setExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The expiry duration.
- setFailed(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
- setFetchLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setFetchMode(ai.platon.pulsar.persist.metadata.FetchMode) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The fetch mode.
- setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- setFetchSchedule(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
- setFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
- The actual latest fetch time, WebPage.
- setFieldByAnnotation(ai.platon.pulsar.skeleton.common.options.LoadOptions,java.lang.String,java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions.Companion
- Set the field value who has an annotation annotationName.
- setFingerprint(ai.platon.pulsar.common.browser.Fingerprint) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyAgent
- setFirstCollectTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.crawl.parse.FilterResult
- setFlowStatus(ai.platon.pulsar.common.FlowState) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
- setFORBID_ALL_RULES(crawlercommons.robots.BaseRobotRules) - function in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser.Companion
- A BaseRobotRules object appropriate for use when the
robots.txtfile is not fetched due to a403/Forbiddenresponse; all requests are disallowed. - setFreshLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setGlobalCache(ai.platon.pulsar.skeleton.crawl.common.GlobalCache) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCacheFactory.Companion
- Set the global cache instance.
- setGOOD_CONTENT_TEXT_LENGTH(java.lang.Integer) - function in ai.platon.pulsar.skeleton.signature.TextProfileSignature.Companion
- setGroup(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.SequentialPrivacyAgentGenerator
- setHardRedirect(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If false, return the original page record but the redirect target's content, otherwise, return the page record of the redirected target.
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.CommonOptions
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.CommonOptions
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setHelp(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setHostName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setHref(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setHref(java.net.URL) - function in ai.platon.pulsar.skeleton.common.urls.NormURL
- The href is the raw url in the html without normalization, for example, an url with a timestamp query parameter added.
- setHref(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The hypertext reference, It defines the address of the document, which this time is linked from
- setIdleTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- setIframe(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The iframe id to switch to.
- setIGNORED_PAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
- setIgnoreDOMFeatures(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Whether the driver should calculate the DOM features.
- setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- If true, still fetch the page even if it is gone.
- setIgnoreFailure(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Retry fetching the page even if it's failed last time.
- setIgnoreUrlQuery(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If true, remove the query parameters in the url.
- setIncognito(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Run browser in incognito mode.
- setIndexed(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setIndexUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setInitialDelay(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- setInterval(java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- setItemBrowser(ai.platon.pulsar.common.browser.BrowserType) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The browser used to visit the item pages.
- setItemExpireAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If an item page is expired, it should be fetched from the web again.
- setItemExpires(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The same as expires, but only works for item pages.
- setItemPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The same as pageLoadTimeout, but only works for item pages.
- setItemRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Re-fetch item pages with fewer anchors than the required number specified by requireAnchors.
- setItemRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Re-fetch item pages whose images is less than requireImages.
- setItemRequireNotBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Re-fetch the item pages if the required text is blank.
- setItemRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Re-fetch item pages smaller than requireSize.
- setItemScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The same as scriptTimeout, but only works for item pages.
- setItemScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The same as scrollCount, but only works for item pages.
- setItemScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The same as scrollInterval, but only works for item pages.
- setItemWaitNonBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector specified element should have a non-blank text, the system should wait until the element is filled by a non-blank text, or until it times out.
- setJobName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
- The job name.
- setKey(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
- setLabel(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The task label is optional and may be utilized to categorize tasks into groups.
- setLang(java.lang.String) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setLang(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setLang(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The language of this hyperlink
- setLastActiveTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- setLastActiveTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- The last active time.
- setLastCollectedTime(java.time.Instant) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- setLastFailedLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setLAZY_PAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
- setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Lazy flush.
- setLazyFlush(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If false, pages are flushed into database as soon as possible.
- setLe(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setLe(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- setLoadArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
- setLoadArgs(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
- setLoadedSeeds(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.PageEventHandlers
- Event handlers during the loading stage.
- setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the loading stage.
- setLoadEventHandlers(ai.platon.pulsar.skeleton.crawl.LoadEventHandlers) - function in ai.platon.pulsar.skeleton.crawl.event.AbstractPageEventHandlers
- Event handlers during the loading stage.
- setLOG(org.slf4j.Logger) - function in ai.platon.pulsar.skeleton.crawl.index.IndexWriters
- setLOG(org.slf4j.Logger) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.Companion
- setLogLevel(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setLoss(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
- setMainRequestCookies(java.util.List) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- setMainRequestHeaders(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- setMainRequestId(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- Main request is only used for HTML documents for now.
- setMainResponseHeaders(java.util.Map) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- setMainResponseStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- The response status of the main request
- setMainResponseStatusText(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- setMajorCode(java.lang.Short) - function in ai.platon.pulsar.persist.ParseStatus
- setMappedName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setMaxAnchorLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setMaxLoops(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.filter.ChainedUrlNormalizer
- setMaxUrlLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setMediaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setMinAnchorLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setMinConfidence(int) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
- setMinorCode(java.lang.Integer) - function in ai.platon.pulsar.persist.ParseStatus
- setMinorCode(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
- setMinUrlLength(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setModifiedAt(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
- setMultiValued(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.CircularHyperlinkCollector
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.CircularLocalFileHyperlinkCollector
- The collector name
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.LocalFileHyperlinkCollector
- The collector name
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalHyperlinkCollector
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector
- The collector name
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setName(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
- setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The navigate entry of the current page.
- setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current navigation entry.
- setNavigateEntry(ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- The current navigation entry.
- setNetCondition(ai.platon.pulsar.skeleton.common.options.Condition) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Indicates the network condition.
- setNextPageSelector(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector for next page anchor.
- setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- There are several cases to enable jit retry.
- setNJitRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Retry at most n times at fetch phase immediately if RETRY(1601) code return.
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Retry to fetch at most n times, if page.fetchRetries nMaxRetry, the page is marked as gone and do not fetch it again until -refresh is set to clear page.
- setNMaxRetry(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The maximum number of retries
- setNoCache(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- A convenience method.
- setNoFilter(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If true, no filter will be applied when parse links.
- setNoFollow(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- A convenience method.
- setNoIndex(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- A convenience method.
- setNoNorm(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If true, no normalizer will be applied when parse links.
- setNoRedirect(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Do not redirect.
- setNRetries(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
- setNumTasksSuccess(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
- setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setObjects(java.lang.Object) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions
- setOpener(ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- The opener of the current page.
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
- setOrder(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The order of this hyperlink in it referrer page
- setOutLinkPattern(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The pattern to select out links in the portal page.
- setOutLinkSelector(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector to extract links in portal pages.
- setPAGE_FIELDS(java.util.Set) - function in ai.platon.pulsar.skeleton.crawl.component.LoadComponent.Companion
- setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method specifies how to schedule refetching of pages marked as GONE.
- setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method specifies how to schedule refetching of pages marked as GONE.
- setPageGoneSchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
- setPageLoadTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The maximum time to wait for a page to finish.
- setPageReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- The referrer claimed by the page.
- setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
- setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
- setPageRetrySchedule(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.time.Instant,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
- setPageViews(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.AbstractParseFilter
- The parent filter
- setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.AbstractParseFilter
- The parent filter
- setParent(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilter
- The parent filter
- setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Trigger the parse phase or not.
- setParse(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If true, parse the page when it's just be fetched.
- setParseResult(ai.platon.pulsar.skeleton.crawl.parse.ParseResult) - function in ai.platon.pulsar.skeleton.crawl.parse.html.ParseContext
- setParsers(java.util.List) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult
- setParsers(java.lang.String,java.util.List) - function in ai.platon.pulsar.skeleton.crawl.parse.ParserConfig
- setPersist(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Persist fetched pages as soon as possible.
- setPrevFetchTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
- The previous actual latest fetch time
- setPrevModifiedTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.ModifyInfo
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.common.urls.UrlAware
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Represents the priority of a task, determining the order of execution.
- setPriority(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The priority of this hyperlink
- setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Set the property of an element located by selector.
- setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the property of an element located by selector.
- setProperty(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the property of an element located by selector.
- setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Set the property of all elements matching the CSS query.
- setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the property of all elements matching the CSS query.
- setPropertyAll(java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Set the property of all elements matching the CSS query.
- setProxy(ai.platon.pulsar.common.proxy.ProxyEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.BrowserId
- setProxy(java.lang.String,java.lang.String,java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.BrowserId
- setProxyEntry(ai.platon.pulsar.common.proxy.ProxyEntry) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
- setRawEvent(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setRawItemEvent(ai.platon.pulsar.skeleton.crawl.PageEventHandlers) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setReadonly(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Specify whether the load execution is read-only or not.
- setRecovered(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- setRecyclable(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- If a driver is recyclable, it should be closed after the task is done, and add to a standby pool, so it can be reused for other tasks.
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setReferrer(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setReferrer(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The url of the referrer page
- setRefresh(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- setRefresh(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- Sets
refreshto the supplied value. - setRefreshHref(java.net.URL) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- Sets the
refreshHref. - setRefreshTime(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags
- Sets the
refreshTime. - setRegexMatchedLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setRemoteAddr(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setReparseLinks(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Reparse links if the page has been parsed before.
- setRequireAnchors(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The minimum number of anchors expected in the page, if it is less than that, it will need to be re-fetched.
- setRequired(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setRequired(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.html.OpenMapFields
- setRequireImages(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The minimum number of images expected in the page, if it is less than that, it will need to be re-fetched.
- setRequireNotBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector specified element should have a non-blank text, the task should be retried if the element's text content is empty or blank.
- setRequireSize(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The minimum page size expected, if it is less than that, it will need to be re-fetched.
- setResource(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If true, fetch the url as a resource without browser rendering.
- setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult
- setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol
- setResponse(ai.platon.pulsar.skeleton.crawl.protocol.Response) - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol
- setRestrictCss(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.Crawler
- Delay policy for retry tasks
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler
- Delay policy for retry tasks
- setRetryDelayPolicy(kotlin.jvm.functions.Function2) - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler
- Delay policy for retry tasks
- setReused(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- setRound(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- setRunningChromeProcesses(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
- setScoreVector(ai.platon.pulsar.common.ScoreVector) - function in ai.platon.pulsar.skeleton.crawl.scoring.io.ScoreVectorWritable
- setScriptTimeout(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The maximum time to perform javascript injected into the browser.
- setScrollCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The number of times the page should be scrolled down after it has just been opened in a browser.
- setScrollInterval(java.time.Duration) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The interval to scroll down.
- setSearchUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setStackTrace(kotlin.Array) - function in kotlin.Throwable
- setStartTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setStatus(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- setStopped(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- Indicate if the navigation is stopped.
- setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Store webpage content or not.
- setStoreContent(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- If false, do not persist the page content which is usually very large.
- setStored(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setSuccessOK() - function in ai.platon.pulsar.persist.ParseStatus
- setTaskId(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The taskId is optional and serves to differentiate tasks if needed.
- setTaskTime(java.time.Instant) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Task time is usually used to denote the name of a batch of tasks.
- setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults
- Set to be 0 if we are doing unit test or other test.
- setTest(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The test level, 0 to disable, we will talk more in test mode.
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setText(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setText(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The anchor text
- setTiebaUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setTimeouts(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- TODO: NOT IMPLEMENTED
- setTimeouts(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- TODO: NOT IMPLEMENTED
- setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- setTimeoutsAsync(ai.platon.pulsar.browser.common.BrowserSettings) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- setTopLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- Specify how many links to extract for out pages.
- setTotalNetworkIFsRecvBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
- The total all bytes received by the hardware last read from system
- setTotalSuccessBytes(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.fetch.BatchStat
- setType(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping.MappingField
- setUnfilteredLinks(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor.Companion.Counters
- setUnknownUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setUnserializableValue(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.AbstractUrl
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.ListenableUrl
- setUrl(java.lang.String) - function in ai.platon.pulsar.common.urls.UrlAware
- setUrl(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.url.CompletableHyperlink
- The url specification of the hyperlink, it is usually normalized, and can contain load arguments.
- setUrl(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
- setUrlContains(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setUrlNormalizer(ai.platon.pulsar.common.urls.preprocess.UrlNormalizerPipeline) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
- setUrlNormalizer(ai.platon.pulsar.common.urls.preprocess.UrlNormalizerPipeline) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector
- setUrlPool(ai.platon.pulsar.common.collect.UrlPool) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache
- A url pool contains many url caches, the urls added to the pool will be processed in crawl loops.
- setUrlPostfix(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setUrlPrefix(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setUrlRegex(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LinkOptions
- setUrls(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setUrls(kotlin.sequences.Sequence) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
- The url sequence
- setUrlsFromSeed(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setUrlsTooLong(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.UrlStat
- setUsedMemory(java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics.Companion
- setUserAgentOverride(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractBrowser
- setValue(java.lang.Integer,java.lang.Double) - function in ai.platon.pulsar.common.ScoreVector
- setValue(java.lang.Integer,java.lang.Float) - function in ai.platon.pulsar.common.ScoreVector
- setValue(java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.common.ScoreVector
- setValue(java.lang.Integer) - function in ai.platon.pulsar.common.ScoreVector
- setValue(T,java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry
- setValue(java.lang.Object) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JsEvaluation
- setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
- setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
- setValue(ai.platon.pulsar.skeleton.crawl.scoring.Name,java.lang.Long) - function in ai.platon.pulsar.skeleton.crawl.scoring.NamedScoreVector
- setVerboseCount(java.lang.Integer) - function in ai.platon.pulsar.skeleton.common.message.PageLoadStatusFormatter
- setVersion(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The load option version.
- setWaitNonBlank(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.LoadOptions
- The selector specified element should have a non-blank text, the system should wait until the element is filled by a non-blank text, or until it times out.
- setWebdriverFetcher(ai.platon.pulsar.skeleton.crawl.fetch.WebDriverFetcher) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext
- setWeight(java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument
- setWeight(java.lang.Float) - function in ai.platon.pulsar.skeleton.crawl.index.IndexField
- shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method provides information whether the page is suitable for selection in the current fetchlist.
- shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.AbstractFetchSchedule
- This method provides information whether the page is suitable for selection in the current fetchlist.
- shouldFetch(ai.platon.pulsar.persist.WebPage,java.time.Instant) - function in ai.platon.pulsar.skeleton.crawl.schedule.FetchSchedule
- shouldFetchVividPage(java.lang.String,java.time.Duration,java.time.Instant) - function in ai.platon.pulsar.skeleton.common.collect.FatLinkExtractor
- TODO: the logic is different from the one in LoadComponent
- shutdown() - function in ai.platon.pulsar.skeleton.context.PulsarContexts
- Close the all the created context.
- shutdownExecutorOnStop(java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter.Builder
- Specifies whether or not, the executor (used for reporting) will be stopped with same time with reporter.
- Signature - class in ai.platon.pulsar.skeleton.signature
- SignatureComparator - class in ai.platon.pulsar.skeleton.signature
- SimpleCommandDispatcher - class in ai.platon.pulsar.skeleton.crawl.fetch.driver
- Dispatches web driver commands in text format.
- SimpleCommandDispatcher.Companion - class in ai.platon.pulsar.skeleton.crawl.fetch.driver.SimpleCommandDispatcher
- size() - function in ai.platon.pulsar.common.ScoreVector
- sniffCharacterEncoding(kotlin.Array) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
- Given a
byte[]representing an html file of an unknown encoding, read out 'charset' parameter in the meta tag from the firstCHUNK_SIZEbytes. - sniffEncoding(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.skeleton.common.EncodingDetector
- split(java.lang.String) - function in ai.platon.pulsar.skeleton.common.options.PulsarOptions.Companion
- Split a command line into argument vector (argv).
- spliterator() - function in kotlin.collections.Collection
- SPONSORED - enum entry in ai.platon.pulsar.skeleton.common.domain.DomainSuffix.Status
- start() - function in ai.platon.pulsar.common.CrawlLoop
- start() - function in ai.platon.pulsar.common.StartStopRunnable
- start() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.time.Duration,java.time.Duration) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.time.Duration,java.time.Duration,kotlin.jvm.functions.Function0) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit,java.lang.Runnable) - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- start() - function in ai.platon.pulsar.skeleton.common.metrics.MetricsSystem
- start() - function in ai.platon.pulsar.skeleton.crawl.CoreMetrics
- start() - function in ai.platon.pulsar.skeleton.crawl.CrawlLoops
- Start all loops matching the filter if not started.
- start() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawlLoop
- start(java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
- start(java.lang.Long,java.lang.Long,java.util.concurrent.TimeUnit) - function in com.codahale.metrics.ScheduledReporter
- startsWith(java.lang.String) - function in ai.platon.pulsar.skeleton.common.metrics.MetricFilters
- STARTUP - enum entry in ai.platon.pulsar.skeleton.common.domain.DomainSuffix.Status
- startWork() - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask
- startWork() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver
- Mark the driver as working, so it can not be used to do any another tasks.
- state() - function in java.util.concurrent.CompletableFuture
- StatefulListenableHyperlink - class in ai.platon.pulsar.skeleton.crawl.common.url
- A stateful hyperlink that has status and contains a PageEventHandlers to handle page events.
- StaticPulsarContext - class in ai.platon.pulsar.skeleton.context.support
- stop() - function in ai.platon.pulsar.common.CrawlLoop
- stop() - function in ai.platon.pulsar.common.StartStopRunnable
- stop() - function in ai.platon.pulsar.skeleton.crawl.CrawlLoops
- Stop all loops matching the filter if started.
- stop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Force the page stop all navigations and RELEASES all resources.
- stop() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver
- Force the page stop all navigations and RELEASES all resources.
- stop() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawlLoop
- stop() - function in com.codahale.metrics.ScheduledReporter
- stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- Force the page stop all navigations and RELEASES all resources.
- stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractJvmWebDriver
- Force the page stop all navigations and RELEASES all resources.
- stopAsync() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.JvmWebDriver
- Force the page stop all navigations and RELEASES all resources.
- stream() - function in kotlin.collections.Collection
- StreamingCrawler - class in ai.platon.pulsar.skeleton.crawl.impl
- StreamingCrawler.Companion - class in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler
- StreamingCrawlLoop - class in ai.platon.pulsar.skeleton.crawl.impl
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a url, the url will be added to the task queue, and will be executed asynchronously.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submit(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submit(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submit(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit a url to the URL pool, and it will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.PulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext
- Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.util.Collection) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submitAll(java.util.Collection,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- No such version, it's too complicated to handle events
- submitAll(java.util.Collection,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitAll(java.lang.Iterable,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Submit urls to the URL pool, and they will be subsequently processed in the crawl loop.
- submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(ai.platon.pulsar.common.urls.UrlAware,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,ai.platon.pulsar.skeleton.common.options.LoadOptions) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - submitForOutPages(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.session.PulsarSession
- Load the portal page and submit the out links specified by the
-outLinkoption to the URL pool. - subscribeWebDriver() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext
- success(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.FilterResult.Companion
- success(ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseResult.Companion
- supervised() - function in ai.platon.pulsar.skeleton.PulsarSettings
- Launch the browser in supervised mode.
- suspendListeners() - function in ai.platon.pulsar.common.event.EventEmitter
- suspendListeners(ai.platon.pulsar.skeleton.crawl.fetch.driver.BrowserEvents) - function in ai.platon.pulsar.common.event.EventEmitter
- suspendListeners(ai.platon.pulsar.skeleton.crawl.impl.CrawlEvents) - function in ai.platon.pulsar.common.event.EventEmitter
- synchronized(kotlin.jvm.functions.Function0) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry
- SystemDefaultPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy