S-index

A B C D E F G H I J K L M N O P Q R S T U V W _

S

sanitize(Document,Boolean) - function in ai.platon.pulsar.crawl.parse.html.JsoupUtils
scan(String) - function in ai.platon.pulsar.context.PulsarContext: Scan webpages in the storage whose url start with urlPrefix
scan(String,Iterable) - function in ai.platon.pulsar.context.PulsarContext
scan(String,Array) - function in ai.platon.pulsar.context.PulsarContext
scan(String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Scan pages in the storage
scan(String,Iterable) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Scan pages in the storage
scan(String,Array) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Scan pages in the storage
scan(String) - function in ai.platon.pulsar.context.support.BasicPulsarContext: Scan pages in the storage
scan(String,Iterable) - function in ai.platon.pulsar.context.support.BasicPulsarContext: Scan pages in the storage
scan(String,Array) - function in ai.platon.pulsar.context.support.BasicPulsarContext: Scan pages in the storage
scan(String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext: Scan pages in the storage
scan(String,Iterable) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext: Scan pages in the storage
scan(String,Array) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext: Scan pages in the storage
scan(String) - function in ai.platon.pulsar.context.support.StaticPulsarContext: Scan pages in the storage
scan(String,Iterable) - function in ai.platon.pulsar.context.support.StaticPulsarContext: Scan pages in the storage
scan(String,Array) - function in ai.platon.pulsar.context.support.StaticPulsarContext: Scan pages in the storage
scan(String,String) - function in ai.platon.pulsar.crawl.component.WebDbComponent
schedule() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler: Schedule a queue with the given priority and given poolId
schedule(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler: Schedule the queues with top priority
schedule(PoolId,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler: Null queue id means the queue with top priority Consume a fetch item and try to download the target web page
scheduleOn(ScheduledExecutorService) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder: Specifies the executor to use while scheduling reporting of metrics.
schedulerIds() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers
ScoreVectorWritable - class in ai.platon.pulsar.crawl.scoring.io: Created by vincent on 17-4-20.
ScoringFilter - class in ai.platon.pulsar.crawl.scoring: A contract defining behavior of scoring plugins.
ScoringFilter.Companion - class in ai.platon.pulsar.crawl.scoring.ScoringFilter
ScoringFilterException - class in ai.platon.pulsar.crawl.scoring: Specialized exception for errors during scoring.
ScoringFilters - class in ai.platon.pulsar.crawl.scoring
scrape(String,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,String,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrape(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch a webpage located by the given url, and then extract fields specified by field selectors.
scrapeOutPages(String,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.BasicPulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Iterable) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,String,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrapeOutPages(String,LoadOptions,String,Map) - function in ai.platon.pulsar.session.PulsarSession: Load or fetch out pages specified by out link selector, and then extract fields specified by field selectors from each out page.
scrollDown(Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollDown(Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
scrollTo(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollTo(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
scrollToBottom() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollToBottom() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
scrollToMiddle(Float) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollToMiddle(Float) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
scrollToTop() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollToTop() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
scrollUp(Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
scrollUp(Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
search(PoolId,Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
SeedBuilder - class in ai.platon.pulsar.crawl.inject: Created by vincent on 16-9-24.
SeedBuilder.Companion - class in ai.platon.pulsar.crawl.inject.SeedBuilder
SequentialPrivacyContextIdGenerator - class in ai.platon.pulsar.crawl.fetch.privacy
SequentialPrivacyContextIdGenerator.Companion - class in ai.platon.pulsar.crawl.fetch.privacy.SequentialPrivacyContextIdGenerator
SessionAware - class in ai.platon.pulsar.session
set(String,String) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.CommonOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.InjectOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.LinkOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.PulsarOptions
setAcceptUnknownOptions(Boolean) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setActiveContext(PulsarContext) - function in ai.platon.pulsar.context.PulsarContexts
setAdddays(Long) - function in ai.platon.pulsar.common.options.GenerateOptions
setAliases(Map) - function in ai.platon.pulsar.crawl.parse.ParserConfig
setAllow(TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin.collections/HashSet///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.util/HashSet///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.filter.BlockFilter
setAllowLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.CommonOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.InjectOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.LinkOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.PulsarOptions
setAllowParameterOverwriting(Boolean) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setAnchorRegex(String) - function in ai.platon.pulsar.common.options.LinkOptions
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The url arguments
setArgs(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setArgs(Map) - function in ai.platon.pulsar.persist.FilterResult
setArgs(Map) - function in ai.platon.pulsar.persist.ParseResult
setAuthToken(String) - function in ai.platon.pulsar.common.options.LoadOptions: The auth token, used for authorization purpose.
setAuthToken(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setAuthToken(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
setAuthToken(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setBadSeeds(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setBaseHref(URL) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: Sets the baseHref.
setBatchId(String) - function in ai.platon.pulsar.common.options.FetchOptions
setBatchId(String) - function in ai.platon.pulsar.common.options.GenerateOptions
setBatchSize(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setBatchStat(BatchStat) - function in ai.platon.pulsar.crawl.fetch.FetchTask
setBbsUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setBlockFilter(BlockFilter) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setBlogUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setBrowser(BrowserType) - function in ai.platon.pulsar.common.options.LoadOptions: Specify which browser to use, google chrome is the default.
setBrowser(BrowserType) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: The default browser is chrome with pulsar implemented web driver.
setBytesThoRate(Double) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
setClickTarget(String) - function in ai.platon.pulsar.common.options.LoadOptions: The selector for element to click.
setClosed(Boolean) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: Indicate if the tab for this navigation is closed.
setCode(Short,Integer) - function in ai.platon.pulsar.persist.FilterResult
setCode(Short,Integer) - function in ai.platon.pulsar.persist.ParseResult
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setCollectCount(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setCollected(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setCollectedCount(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setCollects(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol
setConf(ImmutableConfig) - function in ai.platon.pulsar.common.config.AbstractNativeHttpProtocol
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.protocol.HttpRobotRulesParser: Set the Configuration object
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.index.IndexingFilter
setConf(ImmutableConfig) - function in ai.platon.pulsar.common.config.Protocol
setConf(ImmutableConfig) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser: Set the Configuration object
setContains(String) - function in ai.platon.pulsar.crawl.filter.TextFilter
setContainsAny(String) - function in ai.platon.pulsar.crawl.filter.TextFilter
setContainsNone(String) - function in ai.platon.pulsar.crawl.filter.TextFilter
setContentType(String) - function in ai.platon.pulsar.crawl.parse.ParserNotFound
setContext(PulsarContext) - function in ai.platon.pulsar.context.ContextAware
setContextClassLoader(ClassLoader) - function in java.lang.IndexThread
setCountry(String) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setCountry(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setCountry(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setCountry(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setCountry(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: Required website country
setCrawlId(String) - function in ai.platon.pulsar.common.options.FetchOptions
setCrawlId(String) - function in ai.platon.pulsar.common.options.GenerateOptions
setCrawlId(String) - function in ai.platon.pulsar.common.options.InjectOptions
setDaemon(Boolean) - function in java.lang.IndexThread
setDeadline(Instant) - function in ai.platon.pulsar.common.options.LoadOptions: The deadline to finish the task, if the deadline is exceeded, the task should be discarded as soon as possible.
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setDeadTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setDefaultCharEncoding(String) - function in ai.platon.pulsar.common.EncodingDetector
setDELIMITER(String) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setDepth(Integer) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setDepth(Integer) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setDepth(Integer) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setDepth(Integer) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setDetail(UrlAware) - function in ai.platon.pulsar.common.urls.NormUrl
setDetailUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setDisallow(TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin.collections/HashSet///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.util/HashSet///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.filter.BlockFilter
setDistrict(String) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setDistrict(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setDistrict(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setDistrict(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setDistrict(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: Required website district
setDoc(IndexDocument) - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable
setDocument(FeaturedDocument) - function in ai.platon.pulsar.crawl.parse.ParseResult
setDocument(FeaturedDocument) - function in ai.platon.pulsar.crawl.parse.html.JsoupParser
setDocumentReadyTime(Instant) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: The time when the document is ready.
setEnableReporter(Boolean) - function in ai.platon.pulsar.crawl.CoreMetrics
setEndKey(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setEvent(PageEvent) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink: The event handler
setEvent(PageEvent) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink: The event handler
setEvent(PageEvent) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setEvent(PageEvent) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink: The event handler
setException(Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.CommonOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.InjectOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.LinkOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.PulsarOptions
setExpandAtSign(Boolean) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setExpireAt(Instant) - function in ai.platon.pulsar.common.options.LoadOptions: The expiry time point.
setExpireAt(Instant) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: The default time to expire
setExpiredLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setExpires(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The expiry duration.
setExpires(Duration) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: The default expiry time, some time we may need expire all pages by default, for example, in test mode
setFailed(Integer,String) - function in ai.platon.pulsar.persist.FilterResult
setFailed(Integer,String) - function in ai.platon.pulsar.persist.ParseResult
setFeederCompleted() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
setFetchInterval(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The fetch interval, used for periodically fetch tasks.
setFetchInterval(Duration) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setFetchLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setFetchMode(FetchMode) - function in ai.platon.pulsar.common.options.FetchOptions
setFetchMode(FetchMode) - function in ai.platon.pulsar.common.options.LoadOptions: The fetch mode.
setFetchPriority(Integer) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setFetchSchedule(WebPage,ModifyInfo) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: Sets the fetchInterval and fetchTime on a successfully fetched page.
setFetchSchedule(WebPage,ModifyInfo) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule: Sets the fetchInterval and fetchTime on a successfully fetched page.
setFetchSchedule(WebPage,ModifyInfo) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule: Sets the fetchInterval and fetchTime on a successfully fetched page.
setFetchSchedule(WebPage,ModifyInfo) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule: Sets the fetchInterval and fetchTime on a successfully fetched page.
setFetchSchedule(WebPage,ModifyInfo) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule: Sets the fetchInterval and fetchTime on a successfully fetched page.
setFetchTime(Instant) - function in ai.platon.pulsar.crawl.schedule.ModifyInfo: The actual latest fetch time, WebPage.
setFieldByAnnotation(LoadOptions,String,Object) - function in ai.platon.pulsar.common.options.LoadOptions.Companion: Set the field value who has an annotation annotationName.
setFingerprint(Fingerprint) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextId
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setFirstCollectTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setFlowStatus(FlowState) - function in ai.platon.pulsar.crawl.parse.FilterResult
setFlowStatus(FlowState) - function in ai.platon.pulsar.crawl.parse.ParseResult
setFORBID_ALL_RULES(BaseRobotRules) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion: A BaseRobotRules object appropriate for use when the robots.txt file is not fetched due to a 403/Forbidden response; all requests are disallowed.
setFreshLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setGOOD_CONTENT_TEXT_LENGTH(Integer) - function in ai.platon.pulsar.crawl.signature.TextProfileSignature.Companion
setHardRedirect(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If false, return the original page record but the redirect target's content, otherwise, return the page record of the redirected target.
setHost(String) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setHostName(String) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setHref(URL) - function in ai.platon.pulsar.common.urls.NormUrl
setHref(String) - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
setHref(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setHref(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setHref(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setHref(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The hypertext reference, It defines the address of the document, which this time is linked from
setHref(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setIdleTimeout(Duration) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: The idle timeout.
setIdleTimeout(Duration) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: The idle timeout.
setIframe(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The iframe id to switch to.
setIgnoreFailure(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Retry fetching the page even if it's failed last time.
setIgnoreFailure(Boolean) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: If true, still fetch the page even if it is gone.
setIgnoreUrlQuery(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If true, remove the query parameters in the url.
setIncognito(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Run browser in incognito mode.
setIndex(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setIndexed(Boolean) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setIndexerCollection(String) - function in ai.platon.pulsar.common.options.FetchOptions
setIndexerUrl(String) - function in ai.platon.pulsar.common.options.FetchOptions
setIndexerUrl(String) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setIndexingFilters(IndexingFilters) - function in ai.platon.pulsar.crawl.component.IndexComponent
setIndexJIT(Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setIndexThreadCount(Integer) - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
setIndexUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setIndexWriters(IndexWriters) - function in ai.platon.pulsar.crawl.component.IndexComponent
setInitialDelay(Duration) - function in ai.platon.pulsar.common.metrics.EnumCounterReporter
setInitialDelay(Duration) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor
setIsEnabled(Boolean) - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.CommonOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.InjectOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.LinkOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.PulsarOptions
setIsHelp(Boolean) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setIsRecovered(Boolean) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Indicate if the driver is recovered from the browser's tab list or not.
setIsRecovered(Boolean) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Indicate if the driver is recovered from the browser's tab list or not.
setIsResource(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If true, fetch the url as a resource without browser rendering.
setItemBrowser(BrowserType) - function in ai.platon.pulsar.common.options.LoadOptions: The browser used to visit the item pages.
setItemExpireAt(Instant) - function in ai.platon.pulsar.common.options.LoadOptions: If an item page is expired, it should be fetched from the web again.
setItemExpires(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The same as expires, but only works for item pages.
setItemId(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setItemPageLoadTimeout(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The same as pageLoadTimeout, but only works for item pages.
setItemRequireAnchors(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Re-fetch item pages who's anchors is less than requireAnchors.
setItemRequireImages(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Re-fetch item pages who's images is less than requireImages.
setItemRequireNotBlank(String) - function in ai.platon.pulsar.common.options.LoadOptions: Re-fetch the item pages if the required text is blank.
setItemRequireSize(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Re-fetch item pages smaller than requireSize.
setItemScriptTimeout(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The same as scriptTimeout, but only works for item pages.
setItemScrollCount(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The same as scrollCount, but only works for item pages.
setItemScrollInterval(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The same as scrollInterval, but only works for item pages.
setJobID(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setJobName(String) - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor: Initialize in setup using job conf
setJobName(String) - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
setKey(String) - function in ai.platon.pulsar.crawl.index.IndexDocument
setKeywords(Map) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setLabel(String) - function in ai.platon.pulsar.common.options.LoadOptions: The task label, it's optional and can be used to group tasks.
setLang(String) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setLang(String) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setLang(String) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setLang(String) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setLang(String) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setLang(String) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setLang(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setLang(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setLang(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setLang(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: Required website language
setLastActiveTime(Instant) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: The time of the last action.
setLastActiveTime(Instant) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: The last active time.
setLastActiveTime(Instant) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setLastCollectedTime(Instant) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setLastFailedLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setLastReportTime(Instant) - function in ai.platon.pulsar.crawl.CoreMetrics
setLastTaskFinishTime(Instant) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setLastTaskStartTime(Instant) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setLastTaskTime(Instant) - function in ai.platon.pulsar.crawl.CoreMetrics
setLazyFlush(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If false, pages are flushed into database as soon as possible.
setLazyFlush(Boolean) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: Lazy flush.
setLimit(Integer) - function in ai.platon.pulsar.common.options.FetchOptions
setLimit(Integer) - function in ai.platon.pulsar.common.options.GenerateOptions
setLimit(Integer) - function in ai.platon.pulsar.common.options.InjectOptions
setLinkOptions(LinkOptions) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setLoadArgs(String) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
setLoadArgs(String) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
setLoadArgs(String) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setLoadedSeeds(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setLocation(String) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: The location of the page, it shows in the browser window, can differ from url.
setLOG(Logger) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setLOG(Logger) - function in ai.platon.pulsar.crawl.index.IndexWriters
setLOG(Logger) - function in ai.platon.pulsar.crawl.index.IndexerMapping.Companion
setLogLevel(Integer) - function in ai.platon.pulsar.common.options.LinkOptions
setLoss(Integer) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
setMajorCode(Short) - function in ai.platon.pulsar.persist.FilterResult
setMajorCode(Short) - function in ai.platon.pulsar.persist.ParseResult
setMappedName(String) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setMAX_COUNTERS(Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setMAX_COUNTERS_IN_GROUP(Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setMAX_GROUPS(Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setMaxAnchorLength(Integer) - function in ai.platon.pulsar.common.options.LinkOptions
setMaxUrlLength(Integer) - function in ai.platon.pulsar.common.options.LinkOptions
setMediaUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setMinAnchorLength(Integer) - function in ai.platon.pulsar.common.options.LinkOptions
setMinConfidence(int) - function in ai.platon.pulsar.common.EncodingDetector
setMinorCode(Integer) - function in ai.platon.pulsar.persist.FilterResult
setMinorCode(Integer,String) - function in ai.platon.pulsar.persist.FilterResult
setMinorCode(Integer) - function in ai.platon.pulsar.persist.ParseResult
setMinorCode(Integer,String) - function in ai.platon.pulsar.persist.ParseResult
setMinUrlLength(Integer) - function in ai.platon.pulsar.common.options.LinkOptions
setModified(Integer) - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
setModifiedAt(Instant) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setModifiedAt(Instant) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
setModifiedAt(Instant) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setModifiedTime(Instant) - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
setMultiValued(Boolean) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setName(String) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector: The collector name
setName(String) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector: The collector name
setName(String) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector: The collector name
setName(String) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setName(String) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setName(String) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setName(String) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setName(String) - function in java.lang.IndexThread
setName(String) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
setNavigateEntry(NavigateEntry) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: The current navigation entry.
setNavigateEntry(NavigateEntry) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: The current navigation entry.
setNetCondition(Condition) - function in ai.platon.pulsar.common.options.LoadOptions: Indicates the network condition.
setNextPageSelector(String) - function in ai.platon.pulsar.common.options.LoadOptions: The selector for next page anchor.
setNJitRetry(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Retry at most n times at fetch phrase immediately if RETRY(1601) code return.
setNJitRetry(Integer) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: There are several cases to enable jit retry.
setNMaxRetry(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Retry to fetch at most n times, if page.fetchRetries nMaxRetry, the page is marked as gone and do not fetch it again until -refresh is set to clear page.
setNMaxRetry(Integer) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setNMaxRetry(Integer) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setNMaxRetry(Integer) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setNMaxRetry(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The maximum retry times
setNoCache(Boolean) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: A convenience method.
setNoFilter(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setNoFilter(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If true, no filter will be applied when parse links.
setNoFollow(Boolean) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: A convenience method.
setNoIndex(Boolean) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: A convenience method.
setNoNorm(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If true, no normalizer will be applied when parse links.
setNoNormalizer(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setNoRedirect(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Do not redirect.
setNotContains(String) - function in ai.platon.pulsar.crawl.filter.TextFilter
setNRetries(Integer) - function in ai.platon.pulsar.crawl.fetch.FetchTask
setNumPoolThreads(Integer) - function in ai.platon.pulsar.common.options.FetchOptions
setNumReduceTasks(Integer) - function in ai.platon.pulsar.common.options.FetchOptions: Note: in browser mode, reducer tasks/fetch threads/pool threads are not used use browser instances/active browser tabs instead
setNumTasksSuccess(Long) - function in ai.platon.pulsar.crawl.fetch.BatchStat
setObjects(Object) - function in ai.platon.pulsar.common.options.CommonOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.FetchOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.GenerateOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.InjectOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.LinkOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.LoadOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.PulsarOptions
setObjects(Object) - function in ai.platon.pulsar.common.options.CrawlOptions
setOptions(FetchOptions) - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor: Initialize in setup using job conf
setOrder(Integer) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setOrder(Integer) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setOrder(Integer) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setOrder(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The order of this hyperlink in it's referer page
setOrder(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink: The order of this hyperlink in it's referer page
setOutLinkPattern(String) - function in ai.platon.pulsar.common.options.LoadOptions: The pattern to select out links in the portal page.
setOutLinkSelector(String) - function in ai.platon.pulsar.common.options.LoadOptions: The selector to extract links in portal pages.
setPage(WebPage) - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry
setPageGoneSchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule: This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule: This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule: This method specifies how to schedule refetching of pages marked as GONE.
setPageGoneSchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule: This method specifies how to schedule refetching of pages marked as GONE.
setPageLoadTimeout(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The maximum time to wait for a page to finish.
setPageReferrer(String) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: The referer claimed by the page.
setPageRetrySchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule: This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule: This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule: This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPageRetrySchedule(WebPage,Instant,Instant,Instant) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule: This method adjusts the fetch schedule if fetching needs to be re-tried due to transient errors.
setPagesThroughputRate(Double) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
setPageViews(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setParent(ParseFilter) - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter: The parent filter
setParent(ParseFilter) - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter: The parent filter
setParent(ParseFilter) - function in ai.platon.pulsar.crawl.parse.ParseFilter: The parent filter
setParse(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setParse(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If true, parse the page when it's just be fetched.
setParse(Boolean) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: Trigger the parse phrase or not.
setParse(Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setParsers(List) - function in ai.platon.pulsar.crawl.parse.ParseResult
setParsers(String,List) - function in ai.platon.pulsar.crawl.parse.ParserConfig
setPendingFetchItems(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
setPendingStart(Instant) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
setPersist(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Persist fetched pages as soon as possible.
setPrevFetchTime(Instant) - function in ai.platon.pulsar.crawl.schedule.ModifyInfo: The previous actual latest fetch time
setPrevModifiedTime(Instant) - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The priority
setPriority(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setPriority(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setPriority(Integer) - function in java.lang.IndexThread
setProtocol(String) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setProxyEntry(ProxyEntry) - function in ai.platon.pulsar.crawl.fetch.FetchTask
setRawEvent(PageEvent) - function in ai.platon.pulsar.common.options.LoadOptions
setRawItemEvent(PageEvent) - function in ai.platon.pulsar.common.options.LoadOptions
setReadonly(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Specify if the load execution is read only or not.
setReadyFetchItems(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The url of the referer page
setReferer(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setReferrer(String) - function in ai.platon.pulsar.common.options.LoadOptions: The page referrer.
setRefresh(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions
setRefresh(Boolean) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: Sets refresh to the supplied value.
setRefreshHref(URL) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: Sets the refreshHref.
setRefreshTime(Integer) - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags: Sets the refreshTime.
setReGenerate(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setReGenerateSeeds(Boolean) - function in ai.platon.pulsar.common.options.GenerateOptions
setRegexMatchedLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setRemoteAddr(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setRemoteAddr(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
setRemoteAddr(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setReparseLinks(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: Re-parse links if the page has been parsed before.
setRequireAnchors(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The minimum number of anchors expected in the page, if it is less than that, it will need to be re-fetched.
setRequired(Boolean) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setRequired(Integer) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
setRequireImages(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The minimum number of images expected in the page, if it is less than that, it will need to be re-fetched.
setRequireNotBlank(String) - function in ai.platon.pulsar.common.options.LoadOptions: The selector specified element should have a non-blank text, the task should be retried if the element's text content is empty or blank.
setRequireSize(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The minimum page size expected, if it is less than that, it will need to be re-fetched.
setReservedUrl(String) - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry
setResponse(Response) - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol
setResponse(Response) - function in ai.platon.pulsar.crawl.protocol.AbstractHttpProtocol
setResponse(Response) - function in ai.platon.pulsar.crawl.fetch.FetchResult
setResponse(Response) - function in ai.platon.pulsar.crawl.protocol.Protocol
setRestrictCss(String) - function in ai.platon.pulsar.common.options.LinkOptions
setResume(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setRetryDelayPolicy(Function2) - function in ai.platon.pulsar.crawl.Crawler: Delay policy for retry tasks
setRetryDelayPolicy(Function2) - function in ai.platon.pulsar.crawl.impl.AbstractCrawler: Delay policy for retry tasks
setRetryDelayPolicy(Function2) - function in ai.platon.pulsar.crawl.impl.StreamingCrawler: Delay policy for retry tasks
setReversedEndKey(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setReversedStartKey(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setRound(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
setRound(Integer) - function in ai.platon.pulsar.common.options.FetchOptions
setRound(Integer) - function in ai.platon.pulsar.common.options.GenerateOptions
setRoundCollected(Integer) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
setRunningChromeProcesses(Integer) - function in ai.platon.pulsar.crawl.CoreMetrics.Companion
setScore(Integer) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setScoreVector(ScoreVector) - function in ai.platon.pulsar.crawl.scoring.io.ScoreVectorWritable
setScriptTimeout(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The maximum time to perform javascript injected into the browser.
setScrollCount(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The number of times the page should be scrolled down after it has just been opened in a browser.
setScrollInterval(Duration) - function in ai.platon.pulsar.common.options.LoadOptions: The interval to scroll down.
setSearchUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setSeeds(List) - function in ai.platon.pulsar.common.options.InjectOptions
setSkipTruncated(Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setSlashed(Boolean) - function in ai.platon.pulsar.common.options.InjectOptions
setSpecifiedGlobalCache(GlobalCache) - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory
setStackTrace(Array) - function in kotlin.IllegalBusinessPreconditionException
setStackTrace(Array) - function in kotlin.IllegalApplicationContextStateException
setStackTrace(Array) - function in kotlin.BlockedException
setStackTrace(Array) - function in kotlin.HttpException
setStackTrace(Array) - function in kotlin.WebDriverException
setStackTrace(Array) - function in kotlin.WebDriverCancellationException
setStackTrace(Array) - function in kotlin.BrowserErrorPageException
setStackTrace(Array) - function in kotlin.PrivacyContextException
setStackTrace(Array) - function in kotlin.UrlFilterException
setStackTrace(Array) - function in kotlin.IndexingException
setStackTrace(Array) - function in kotlin.ParseException
setStackTrace(Array) - function in kotlin.ParserNotFound
setStackTrace(Array) - function in kotlin.ProtocolException
setStackTrace(Array) - function in kotlin.ProtocolNotFound
setStackTrace(Array) - function in kotlin.ScoringFilterException
setStartKey(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setStartTime(Instant) - function in ai.platon.pulsar.crawl.fetch.BatchStat
setStatus(String) - function in ai.platon.pulsar.common.ReducerContext
setStatus(Integer) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setStatus(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
setStatus(Integer) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setStatus(TaskPool.Status) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
setStopped(Boolean) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry: Indicate if the navigation is stopped.
setStoreContent(Boolean) - function in ai.platon.pulsar.common.options.LoadOptions: If false, persist the page without the content which is usually very large
setStoreContent(Boolean) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: Store webpage content or not.
setStoreContent(Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setStored(Boolean) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setStrictDf(Boolean) - function in ai.platon.pulsar.common.options.FetchOptions
setSuccessOK() - function in ai.platon.pulsar.persist.FilterResult
setSuccessOK() - function in ai.platon.pulsar.persist.ParseResult
setTaskId(String) - function in ai.platon.pulsar.common.options.LoadOptions: The task id, it's optional and can be used to distinguish tasks.
setTaskTime(Instant) - function in ai.platon.pulsar.common.options.LoadOptions: The task time, we usually use task time to indicate the name of a task batch.
setTaskTime(Instant) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: The default task time.
setTest(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: The test level, 0 to disable, we will talk more in test mode.
setTest(Integer) - function in ai.platon.pulsar.common.options.LoadOptionDefaults: Set to be 0 if we are doing unit test or other test.
setText(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setText(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setText(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setText(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The anchor text of this hyperlink
setText(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink: The anchor text of this hyperlink
setTextFilter(TextFilter) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setTiebaUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setTimeouts(BrowserSettings) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
setTimeouts(BrowserSettings) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
setTopLinks(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Specify how many links to extract for out pages.
setTopN(Integer) - function in ai.platon.pulsar.common.options.GenerateOptions
setTopNAnchorGroups(Integer) - function in ai.platon.pulsar.common.options.LoadOptions: Choose the top N anchor groups for further process.
setTotalNetworkIFsRecvBytes(Long) - function in ai.platon.pulsar.crawl.CoreMetrics: The total all bytes received by the hardware last read from system
setTotalSuccessBytes(Long) - function in ai.platon.pulsar.crawl.fetch.BatchStat
setType(String) - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
setUncaughtExceptionHandler(Thread.UncaughtExceptionHandler) - function in java.lang.IndexThread
setUnfilteredLinks(Integer) - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
setUnknownUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.common.JobInitialized
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.component.GenerateComponent
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.common.IndexWriter
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.common.IndexingFilter
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
setup(ImmutableConfig) - function in ai.platon.pulsar.crawl.parse.PageParser
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink: The url of this hyperlink
setUrl(String) - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
setUrl(String) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
setUrl(String) - function in ai.platon.pulsar.crawl.index.IndexDocument
setUrl(String) - function in ai.platon.pulsar.crawl.parse.ParserNotFound
setUrlContains(String) - function in ai.platon.pulsar.common.options.LinkOptions
setUrlFilter(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
setUrlNormalizer(UrlNormalizerPipeline) - function in ai.platon.pulsar.common.collect.HyperlinkCollector
setUrlNormalizer(UrlNormalizerPipeline) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
setUrlNormalizer(UrlNormalizerPipeline) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
setUrlPool(UrlPool) - function in ai.platon.pulsar.crawl.common.GlobalCache: The url pool, hold on queues of urls to fetch
setUrlPostfix(String) - function in ai.platon.pulsar.common.options.LinkOptions
setUrlPrefix(String) - function in ai.platon.pulsar.common.options.LinkOptions
setUrlRegex(String) - function in ai.platon.pulsar.common.options.LinkOptions
setUrls(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setUrls(Sequence) - function in ai.platon.pulsar.crawl.impl.StreamingCrawler: The url sequence
setUrlsFromSeed(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setUrlsTooLong(Integer) - function in ai.platon.pulsar.crawl.fetch.UrlStat
setUsedMemory(Long) - function in ai.platon.pulsar.crawl.CoreMetrics.Companion
setValue(T,Integer) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry
setValue(Enum,Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setValue(Integer,Enum,Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
setValue(Name,Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector
setValue(Name,Long) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector
setValue(Name,Float) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector
setValue(Integer,Integer) - function in ai.platon.pulsar.common.NamedScoreVector
setValue(Integer,Float) - function in ai.platon.pulsar.common.NamedScoreVector
setValue(Integer,Double) - function in ai.platon.pulsar.common.NamedScoreVector
setValue(Integer) - function in ai.platon.pulsar.common.NamedScoreVector
setVariable(String,Object) - function in ai.platon.pulsar.session.AbstractPulsarSession: Set a variable into this session
setVariable(String,Object) - function in ai.platon.pulsar.session.BasicPulsarSession: Set a variable into this session
setVariable(String,Object) - function in ai.platon.pulsar.session.PulsarSession: Set a variable into this session
setVerbose(Integer) - function in ai.platon.pulsar.common.options.FetchOptions
setVerbose(Integer) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
setVersion(String) - function in ai.platon.pulsar.common.options.LoadOptions: The load option version.
setWaitForTimeout(Duration) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: The timeout to wait for some object.
setWaitForTimeout(Duration) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: The timeout to wait for some object.
setWaitNonBlank(String) - function in ai.platon.pulsar.common.options.LoadOptions: The selector specified element should have a non-blank text, the system should wait until the element is filled by a non-blank text, or until it times out.
setWatchInterval(Duration) - function in ai.platon.pulsar.common.metrics.EnumCounterReporter
setWatchInterval(Duration) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor
setWeight(Float) - function in ai.platon.pulsar.crawl.index.IndexDocument
setWeight(Float) - function in ai.platon.pulsar.crawl.index.IndexField
setZkHostString(String) - function in ai.platon.pulsar.common.options.FetchOptions
setZoneId(String) - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
shouldFetch(String,String,WebPage) - function in ai.platon.pulsar.crawl.component.GenerateComponent: TODO : We may move some filters to hbase query filters directly TODO : Move to CrawlFilter
shouldFetch(WebPage,Instant) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(WebPage,Instant) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule: This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(WebPage,Instant) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule: This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(WebPage,Instant) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule: This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetch(WebPage,Instant) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule: This method provides information whether the page is suitable for selection in the current fetchlist.
shouldFetchVividPage(String,Duration,Instant) - function in ai.platon.pulsar.common.collect.FatLinkExtractor: TODO: the logic is different from the one in LoadComponent
shutdown() - function in ai.platon.pulsar.context.PulsarContexts
shutdownExecutorOnStop(Boolean) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder: Specifies whether or not, the executor (used for reporting) will be stopped with same time with reporter.
Signature - class in ai.platon.pulsar.crawl.signature
SignatureComparator - class in ai.platon.pulsar.crawl.signature
size() - function in ai.platon.pulsar.common.NamedScoreVector
sniffCharacterEncoding(Array) - function in ai.platon.pulsar.common.EncodingDetector: Given a byte[] representing an html file of anunknown encoding, read out 'charset' parameter in the meta tagfrom the first CHUNK_SIZE bytes.
sniffEncoding(WebPage) - function in ai.platon.pulsar.common.EncodingDetector
split(String) - function in ai.platon.pulsar.common.options.PulsarOptions.Companion: Split a command line into argument vector (argv).
spliterator() - function in kotlin.collections.LoadingDelayQueue
spliterator() - function in kotlin.collections.PoolQueue
SPONSORED - enum entry in ai.platon.pulsar.common.domain.DomainSuffix.Status
start() - function in ai.platon.pulsar.common.metrics.AppMetrics
start(Long,TimeUnit) - function in com.codahale.metrics.CodahaleSlf4jReporter
start(Long,Long,TimeUnit,Runnable) - function in com.codahale.metrics.CodahaleSlf4jReporter
start(Long,Long,TimeUnit) - function in com.codahale.metrics.CodahaleSlf4jReporter
start() - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start(Duration,Duration) - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start(Duration,Duration,Function0) - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start(Long,TimeUnit) - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start(Long,Long,TimeUnit) - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start(Long,Long,TimeUnit,Runnable) - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter
start() - function in ai.platon.pulsar.crawl.CoreMetrics
start() - function in ai.platon.pulsar.common.CrawlLoop
start() - function in ai.platon.pulsar.crawl.CrawlLoops
start() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop
start() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop
start(ReducerContext) - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
start() - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start(Duration,Duration) - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start(Duration,Duration,Function0) - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start(Long,TimeUnit) - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start(Long,Long,TimeUnit) - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start(Long,Long,TimeUnit,Runnable) - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor
start() - function in ai.platon.pulsar.common.AbstractCrawlLoop
start() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop
start() - function in java.lang.IndexThread
startsWith(String) - function in ai.platon.pulsar.common.metrics.MetricFilters
STARTUP - enum entry in ai.platon.pulsar.common.domain.DomainSuffix.Status
startWork() - function in ai.platon.pulsar.crawl.fetch.FetchTask
startWork() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Mark the driver as working, so it can not be used to fetch another page.
startWork() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Mark the driver as working, so it can not be used to fetch another page.
StatefulListenableHyperlink - class in ai.platon.pulsar.crawl.common.url
StaticPulsarContext - class in ai.platon.pulsar.context.support
stFetched - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stGone - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stNotModified - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stop() - function in com.codahale.metrics.CodahaleSlf4jReporter
stop() - function in ai.platon.pulsar.common.CrawlLoop
stop() - function in ai.platon.pulsar.crawl.CrawlLoops
stop() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Force the page stop all navigations and RELEASES all resources.
stop() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Force the page stop all navigations and RELEASES all resources.
stop() - function in ai.platon.pulsar.common.AbstractCrawlLoop
stop() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop
stop() - function in java.lang.IndexThread
stopLoading() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
stopLoading() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
stream() - function in kotlin.collections.LoadingDelayQueue
stream() - function in kotlin.collections.PoolQueue
StreamingCrawler - class in ai.platon.pulsar.crawl.impl
StreamingCrawler.Companion - class in ai.platon.pulsar.crawl.impl.StreamingCrawler
StreamingCrawlLoop - class in ai.platon.pulsar.crawl.impl
stRedirPerm - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stRedirTemp - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stRetry - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
stUnfetched - enum entry in ai.platon.pulsar.common.metrics.CommonCounter
submit(UrlAware) - function in ai.platon.pulsar.context.PulsarContext: Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(UrlAware) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(UrlAware) - function in ai.platon.pulsar.context.support.BasicPulsarContext: Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(UrlAware) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext: Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(UrlAware) - function in ai.platon.pulsar.context.support.StaticPulsarContext: Submit a url, the url will be added to the task queue, and will be executed asynchronously.
submit(String,String) - function in ai.platon.pulsar.session.AbstractPulsarSession: Submit a url to the URL pool, the url will be processed in the crawl loop later
submit(UrlAware) - function in ai.platon.pulsar.session.AbstractPulsarSession: Submit a url to the URL pool, the url will be processed in a crawl loop later
submit(String,String) - function in ai.platon.pulsar.session.BasicPulsarSession: Submit a url to the URL pool, the url will be processed in the crawl loop later
submit(UrlAware) - function in ai.platon.pulsar.session.BasicPulsarSession: Submit a url to the URL pool, the url will be processed in a crawl loop later
submit(String,String) - function in ai.platon.pulsar.session.PulsarSession: Submit a url to the URL pool, the url will be processed in the crawl loop later
submit(UrlAware) - function in ai.platon.pulsar.session.PulsarSession: Submit a url to the URL pool, the url will be processed in a crawl loop later
submitAll(Iterable) - function in ai.platon.pulsar.context.PulsarContext: Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(Iterable) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(Iterable) - function in ai.platon.pulsar.context.support.BasicPulsarContext: Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(Iterable) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext: Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(Iterable) - function in ai.platon.pulsar.context.support.StaticPulsarContext: Submit a batch of urls, the urls are added to the task queue, and will be executed asynchronously.
submitAll(Iterable) - function in ai.platon.pulsar.session.AbstractPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Iterable,String) - function in ai.platon.pulsar.session.AbstractPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Collection) - function in ai.platon.pulsar.session.AbstractPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Iterable) - function in ai.platon.pulsar.session.BasicPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Iterable,String) - function in ai.platon.pulsar.session.BasicPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Collection) - function in ai.platon.pulsar.session.BasicPulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Iterable) - function in ai.platon.pulsar.session.PulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Iterable,String) - function in ai.platon.pulsar.session.PulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitAll(Collection) - function in ai.platon.pulsar.session.PulsarSession: Submit the urls to the URL pool, the submitted urls will be processed in a crawl loop later
submitOutPages(String,String) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
submitOutPages(String,LoadOptions) - function in ai.platon.pulsar.session.AbstractPulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
submitOutPages(String,String) - function in ai.platon.pulsar.session.BasicPulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
submitOutPages(String,LoadOptions) - function in ai.platon.pulsar.session.BasicPulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
submitOutPages(String,String) - function in ai.platon.pulsar.session.PulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
submitOutPages(String,LoadOptions) - function in ai.platon.pulsar.session.PulsarSession: Load the portal page, and then submit the specified out links to the URL pool, the out links are selected by -outLink option.
success(Integer) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
success(FeaturedDocument) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
suspend() - function in java.lang.IndexThread

A B C D E F G H I J K L M N O P Q R S T U V W _