A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
_
G
- gauge(java.lang.String,com.codahale.metrics.MetricRegistry.MetricSupplier) - function in com.codahale.metrics.MetricRegistry
- GenerateComponent - class in ai.platon.pulsar.crawl.component
- The generate component.
- GenerateComponent.Companion - class in ai.platon.pulsar.crawl.component.GenerateComponent
- GenerateComponent.Companion.Counter - class in ai.platon.pulsar.crawl.component.GenerateComponent.Companion
- generateNextId() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion
- GenerateOptions - class in ai.platon.pulsar.common.options
- generatorSortValue(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.ScoreVector) - function in ai.platon.pulsar.crawl.scoring.ScoringFilter
- This method prepares a sort value for the purpose of sorting and selecting top N scoring pages during fetchlist generation.
- generatorSortValue(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.ScoreVector) - function in ai.platon.pulsar.crawl.scoring.ScoringFilters
- Calculate a sort value for Generate.
- GENERIC - enum entry in ai.platon.pulsar.common.domain.TopLevelDomain.Type
- get(java.lang.Integer) - function in ai.platon.pulsar.common.ScoreVector
- get(java.lang.String) - function in ai.platon.pulsar.common.domain.DomainSuffixes
- Return the DomainSuffix object for the extension, if extension is a top level domain returned object will be an instance of TopLevelDomain
- get(java.lang.Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- get(java.lang.Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- get(java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get a webpage from the storage
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get a page from storage.
- get(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- get(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a page from storage.
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a page from storage.
- get(java.lang.Integer) - function in ai.platon.pulsar.crawl.common.WeakPageIndexer
- get(java.lang.String) - function in ai.platon.pulsar.crawl.component.WebDbComponent
- get(java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers
- get() - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable
- get(java.lang.String) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
- get(ai.platon.pulsar.crawl.scoring.Name) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector
- get() - function in ai.platon.pulsar.crawl.scoring.io.ScoreVectorWritable
- get(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- get(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- get(java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get a page from storage.
- get(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get a page from storage.
- get() - function in java.util.concurrent.CompletableFuture
- get() - function in java.util.concurrent.CompletableFuture
- get(java.lang.Long,java.util.concurrent.TimeUnit) - function in java.util.concurrent.CompletableFuture
- get(java.lang.Long,java.util.concurrent.TimeUnit) - function in java.util.concurrent.CompletableFuture
- getAbstract() - function in ai.platon.pulsar.crawl.CrawlLoop
- getAbstract() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getAbstract() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.PulsarOptions
- getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.PulsarOptions
- getActionTimes() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- Track the time of page actions.
- getActivateSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getActivateTimeout() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getActiveContext() - function in ai.platon.pulsar.context.PulsarContexts
- getActiveContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- getActualCriticalMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getAdddays() - function in ai.platon.pulsar.common.options.GenerateOptions
- getAliases() - function in ai.platon.pulsar.crawl.parse.ParserConfig
- getAll(java.lang.Integer) - function in ai.platon.pulsar.crawl.common.WeakPageIndexer
- getAllow() - function in ai.platon.pulsar.crawl.filter.BlockFilter
- getAllowLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.PulsarOptions
- getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.PulsarOptions
- getANCHOR_ORDER() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getAnchorRegex() - function in ai.platon.pulsar.common.options.LinkOptions
- getApiPublicOptionNames() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A list of all the names of options who are allowed with REST APIs.
- getApplicationContext() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getApplicationContext() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getArgOrElse(java.lang.String,java.lang.String) - function in ai.platon.pulsar.persist.ParseStatus
- getArgs() - function in ai.platon.pulsar.common.options.PulsarOptions
- getArgs() - function in ai.platon.pulsar.common.options.PulsarOptions
- getArgs() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getArgs() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getArgs() - function in ai.platon.pulsar.common.urls.NormUrl
- getArgs() - function in ai.platon.pulsar.common.urls.UrlAware
- getArgs() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The url arguments
- getArgs() - function in ai.platon.pulsar.persist.ParseStatus
- getArgv() - function in ai.platon.pulsar.common.options.PulsarOptions
- The argument vector
- getArgv() - function in ai.platon.pulsar.common.options.PulsarOptions
- The argument vector
- getArity0BooleanParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A list of the options who's arity is 0.
- getArity1BooleanParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A list of the options who's arity is 1.
- getAuthToken() - function in ai.platon.pulsar.common.options.LoadOptions
- The auth token, used for authorization purpose.
- getAuthToken() - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- getAuthToken() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getAuthToken() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getAutoClose() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- getAutoClose() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- getAutoClose() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- getAvailableMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getAvailableMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getAverageRecentTimeCost() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getAverageRecentTps() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getAverageTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getAverageTps() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getBadSeeds() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getBaseDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getBaseHref() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Sets the
baseHref. - getBaseURLFromTag(org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- If Node contains a BASE tag then it's HREF is returned.
- getBatchId() - function in ai.platon.pulsar.common.options.FetchOptions
- getBatchId() - function in ai.platon.pulsar.common.options.GenerateOptions
- getBatchId() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getBatchSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getBatchSize() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getBatchSize() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getBatchSize() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getBatchStat() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getBatchTaskId() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getBbsUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getBean(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.PulsarContext
- Get a bean with the specified class, throws BeansException if the bean doesn't exist
- getBean() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, throws BeansException if the bean doesn't exist
- getBean() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, throws BeansException if the bean doesn't exist
- getBean(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, throws BeansException if the bean doesn't exist
- getBean(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, throws BeansException if the bean doesn't exist
- getBeanOrNull(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.PulsarContext
- Get a bean with the specified class, returns null if the bean doesn't exist
- getBeanOrNull() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, returns null if the bean doesn't exist
- getBeanOrNull() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, returns null if the bean doesn't exist
- getBeanOrNull(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, returns null if the bean doesn't exist
- getBeanOrNull(kotlin.reflect.KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a bean with the specified class, returns null if the bean doesn't exist
- getBlockFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getBlogUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getBoost() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getBoost() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getBrowseEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getBrowseEvent() - function in ai.platon.pulsar.crawl.PageEvent
- The browse phase event handler
- getBrowseEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The browse phase event handler
- getBrowseEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The browse phase event handler
- getBrowser() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- The default browser is chrome with pulsar implemented web driver.
- getBrowser() - function in ai.platon.pulsar.common.options.LoadOptions
- Specify which browser to use, google chrome is the default.
- getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The browser of the driver.
- getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The browser of the driver.
- getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The browser of the driver.
- getBrowserSettings() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- getBrowserType() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The browser type.
- getBrowserType() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The browser type.
- getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId
- getBytesPerPage() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getBytesPerSecond() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getBytesThoRate() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
- getCACHE() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion
- getCapacity() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- The cache capacity, we assume that all items in the file are loaded into the cache
- getCapacity() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- The cache capacity, we assume that all items in the file are loaded into the cache
- getCapacity() - function in ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
- getCause() - function in kotlin.Throwable
- getChildren() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- The child filters
- getChildren() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- The child filters
- getChildren() - function in ai.platon.pulsar.crawl.parse.ParseFilter
- The child filters
- getClassName() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation
- getClassName(java.lang.String) - function in ai.platon.pulsar.crawl.parse.ParserConfig
- getClickTarget() - function in ai.platon.pulsar.common.options.LoadOptions
- The selector for element to click.
- getClosed() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- Indicate if the tab for this navigation is closed.
- getCloseSelector() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler
- getClues() - function in ai.platon.pulsar.common.EncodingDetector
- getCluesAsString() - function in ai.platon.pulsar.common.EncodingDetector
- getCMD_SPLIT_PATTERN() - function in ai.platon.pulsar.common.options.PulsarOptions.Companion
- getCodes() - function in ai.platon.pulsar.crawl.common.FetchState
- getCollectCount() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getCollected() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- getCollectedCount() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getCollector() - function in ai.platon.pulsar.common.collect.PriorityDataCollectorFormatter
- getCollectors() - function in ai.platon.pulsar.common.collect.PriorityDataCollectorsTableFormatter
- getCollectors() - function in ai.platon.pulsar.crawl.CrawlLoop
- getCollectors() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getCollectors() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getCollects() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- getCollectTime() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getColumnNumber() - function in ai.platon.pulsar.crawl.fetch.driver.JsException
- getConcurrency() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getConf() - function in ai.platon.pulsar.common.MultiSinkWriter
- getConf() - function in ai.platon.pulsar.common.config.IndexingFilter
- getConf() - function in ai.platon.pulsar.common.config.Protocol
- getConf() - function in ai.platon.pulsar.common.options.GenerateOptions
- getConf() - function in ai.platon.pulsar.common.options.LoadOptions
- getConf() - function in ai.platon.pulsar.crawl.common.GlobalCache
- getConf() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getConf() - function in ai.platon.pulsar.crawl.component.InjectComponent
- getConf() - function in ai.platon.pulsar.crawl.component.ParseComponent
- getConf() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory
- getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- getConf() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer
- getConf() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getConf() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getConf() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters
- getConf() - function in ai.platon.pulsar.crawl.index.IndexWriters
- getConf() - function in ai.platon.pulsar.crawl.index.IndexingFilters
- getConf() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getConf() - function in ai.platon.pulsar.crawl.parse.LinkFilter
- getConf() - function in ai.platon.pulsar.crawl.parse.PageParser
- getConf() - function in ai.platon.pulsar.crawl.parse.ParseFilters
- getConf() - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- getConf() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser
- Get the Configuration object
- getConf() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser
- Get the Configuration object
- getConf() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getConf() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getConf() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getConf() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getConf() - function in ai.platon.pulsar.crawl.scoring.ScoringFilters
- getConfig() - function in ai.platon.pulsar.crawl.CrawlLoop
- getConfig() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getConfig() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getConfiguration() - function in ai.platon.pulsar.common.ReducerContext
- getConfiguredUrl() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getConfiguredUrl() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getConfiguredUrl() - function in ai.platon.pulsar.common.urls.NormUrl
- getConfiguredUrl() - function in ai.platon.pulsar.common.urls.UrlAware
- getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getConfuser() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- getContains() - function in ai.platon.pulsar.crawl.filter.TextFilter
- getContainsAny() - function in ai.platon.pulsar.crawl.filter.TextFilter
- getContainsNone() - function in ai.platon.pulsar.crawl.filter.TextFilter
- getContent(java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get the content of the page from the storage
- getContent(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get the content of the page from the storage
- getContent(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get the content of the page from the storage
- getContent(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get the content of the page from the storage
- getContent(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get the content of the page from the storage
- getContent(java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get the content of the page from the storage
- getCONTENT_SCORE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get the content of the page from the storage
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get the content of the page from the storage
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get the content of the page from the storage
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get the content of the page from the storage
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get the content of the page from the storage
- getContentAsString(java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get the content of the page from the storage
- getContentPersists() - function in ai.platon.pulsar.crawl.CoreMetrics
- getContentType() - function in ai.platon.pulsar.crawl.parse.ParserNotFound
- getContext() - function in ai.platon.pulsar.context.ContextAware
- getContext() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The pulsar context
- getContext() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The pulsar context
- getContext() - function in ai.platon.pulsar.session.PulsarSession
- The pulsar context
- getContextClassLoader() - function in java.lang.Thread
- getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId
- getContextLeaks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getContextLifeCycleMonitor() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- getContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
- getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
- getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver
- getCoreMetrics() - function in ai.platon.pulsar.common.AppStatusTracker
- getCoreMetrics() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getCoreMetrics() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getCoreMetrics() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric
- getCounterReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getCounterReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getCounters() - function in ai.platon.pulsar.common.collect.FatLinkExtractor
- getCounters() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getCounters() - function in com.codahale.metrics.MetricRegistry
- getCounters(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry
- getCountry() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getCountry() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getCountry() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getCountry() - function in ai.platon.pulsar.common.urls.UrlAware
- getCountry() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- Required website country
- getCountryName() - function in ai.platon.pulsar.common.domain.TopLevelDomain
- Returns the country name if TLD is Country Code TLD
- getCpuLoad() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion
- getCrawlDelay() - function in ai.platon.pulsar.crawl.protocol.RobotRules
- Get Crawl-Delay, in milliseconds.
- getCrawler() - function in ai.platon.pulsar.crawl.CrawlLoop
- getCrawler() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getCrawler() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop
- getCrawlEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getCrawlEvent() - function in ai.platon.pulsar.crawl.PageEvent
- The crawl phase event handler
- getCrawlEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The crawl phase event handler
- getCrawlEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The crawl phase event handler
- getCrawlFilters() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getCrawlFilters() - function in ai.platon.pulsar.crawl.component.ParseComponent
- getCrawlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getCrawlFilters() - function in ai.platon.pulsar.crawl.parse.PageParser
- getCrawlId() - function in ai.platon.pulsar.common.options.FetchOptions
- getCrawlId() - function in ai.platon.pulsar.common.options.GenerateOptions
- getCrawlId() - function in ai.platon.pulsar.common.options.InjectOptions
- getCrawlLoops() - function in ai.platon.pulsar.context.PulsarContext
- The main loops
- getCrawlLoops() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The main loops
- getCrawlLoops() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The main loops
- getCrawlLoops() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default main loop
- getCrawlLoops() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getCrawlPool() - function in ai.platon.pulsar.context.PulsarContext
- The url pool to fetch
- getCrawlPool() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The url pool to fetch
- getCrawlPool() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The url pool to fetch
- getCREATE_TIME() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getCreatedAt() - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- getCreatedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getCreatedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getCreatedTime() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getCreateTime() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getCreateTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The time when the object is created.
- getCRITICAL_CPU_THRESHOLD() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getCriticalMemoryMiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getCsvReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getCsvReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getCurrentKey() - function in ai.platon.pulsar.common.ReducerContext
- getCurrentValue() - function in ai.platon.pulsar.common.ReducerContext
- getDailyCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric
- getDailyCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry
- getData() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- The associated data.
- getData() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The associated data.
- getData() - function in ai.platon.pulsar.crawl.fetch.driver.Browser
- The associated data.
- getData() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The associated data.
- getData() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The associated data.
- getDb() - function in ai.platon.pulsar.crawl.component.LoadComponent.LazyFieldLoader
- getDbGetCount() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion
- getDeadline() - function in ai.platon.pulsar.common.options.LoadOptions
- The deadline to finish the task, if the deadline is exceeded, the task should be discarded as soon as possible.
- getDeadline() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getDeadline() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getDeadline() - function in ai.platon.pulsar.common.urls.UrlAware
- getDeadline() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getDeadTime() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getDeadTime() - function in ai.platon.pulsar.common.options.LoadOptions
- getDeadTime() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getDeadTime() - function in ai.platon.pulsar.common.urls.UrlAware
- getDeadUrls() - function in ai.platon.pulsar.crawl.CoreMetrics
- getDEFAULT() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion
- getDEFAULT() - function in ai.platon.pulsar.common.options.LinkOptions.Companion
- getDEFAULT() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- The default option.
- getDEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion
- Represent the default browser.
- getDEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion
- The default privacy agent opens browser with the default data dir, the default data dir will not be removed after the browser closes.
- getDEFAULT_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getDEFAULT_FINGERPRINT() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion
- getDEFAULT_SCORE_ENTRIES() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getDEFAULT_SEED_OPTIONS() - function in ai.platon.pulsar.common.options.LinkOptions.Companion
- getDefaultArgsMap() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A map of all default options.
- getDefaultBatchId() - function in ai.platon.pulsar.common.options.FetchOptions.Companion
- getDefaultCharEncoding() - function in ai.platon.pulsar.common.EncodingDetector
- getDefaultMetricRegistry() - function in ai.platon.pulsar.common.metrics.AppMetrics.Companion
- getDefaultMetricRegistry() - function in ai.platon.pulsar.common.metrics.MetricsSystem.Companion
- getDefaultParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A map of all default options.
- getDelayCache() - function in ai.platon.pulsar.common.collect.LoadingDelayQueue
- getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getDELIMITER() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getDepth() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getDepth() - function in ai.platon.pulsar.common.urls.Hyperlink
- getDescription() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation
- getDetail() - function in ai.platon.pulsar.common.urls.NormUrl
- getDETAIL_PAGE_URL_PATTERNS() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- getDetailUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getDigits() - function in ai.platon.pulsar.common.ScoreVector
- getDimension() - function in ai.platon.pulsar.common.ScoreVector
- getDisallow() - function in ai.platon.pulsar.crawl.filter.BlockFilter
- getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId
- getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getDisplay() - function in ai.platon.pulsar.session.AbstractPulsarSession
- A short descriptive display text.
- getDisplay() - function in ai.platon.pulsar.session.AbstractPulsarSession
- A short descriptive display text.
- getDisplay() - function in ai.platon.pulsar.session.PulsarSession
- A short descriptive display text.
- getDISTANCE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getDistrict() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getDistrict() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getDistrict() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getDistrict() - function in ai.platon.pulsar.common.urls.UrlAware
- getDistrict() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- Required website district
- getDoc() - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable
- getDocument() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor
- getDocument() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor
- getDocument() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getDocument() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser
- getDocument() - function in ai.platon.pulsar.crawl.parse.html.ParseContext
- getDocumentCache() - function in ai.platon.pulsar.crawl.common.GlobalCache
- The global document cache, a document will be removed automatically if it's expired or the cache is full.
- getDocumentCache() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getDocumentCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global document cache
- getDocumentCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global document cache
- getDocumentCache() - function in ai.platon.pulsar.session.PulsarSession
- The global document cache
- getDocumentCacheHits() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion
- getDocumentReadyTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The time when the document is ready.
- getDomain() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getDomain() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getDomain() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getDomainName(java.net.URL) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the domain name of the url.
- getDomainName(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the domain name of the url.
- getDomainName(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- getDomainSuffix(ai.platon.pulsar.common.domain.DomainSuffixes,java.net.URL) - function in ai.platon.pulsar.crawl.common.URLUtil
- getDomainSuffix(ai.platon.pulsar.common.domain.DomainSuffixes,java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the DomainSuffix corresponding to the last public part of the hostname
- getDomainSuffix(java.net.URL) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the DomainSuffix corresponding to the last public part of the hostname
- getDomainSuffix(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the DomainSuffix corresponding to the last public part of the hostname
- getDriver() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverException
- getDriver() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverException
- getDrivers() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- The created drivers by this browser.
- getDrivers() - function in ai.platon.pulsar.crawl.fetch.driver.Browser
- The created drivers by this browser.
- getDropContent() - function in ai.platon.pulsar.common.options.LoadOptions
- If the option is set, do not persist the page content which is usually very large.
- getElapsedSeconds() - function in ai.platon.pulsar.crawl.CoreMetrics
- getElapsedTime() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getElapsedTime() - function in ai.platon.pulsar.crawl.CoreMetrics
- getElapsedTime() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getElapsedTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getEnableReporter() - function in ai.platon.pulsar.crawl.CoreMetrics
- getEndKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getEntity() - function in ai.platon.pulsar.common.options.LoadOptions
- The entity name of the page, for example, article, product, hotel, flower, etc, it's optional.
- getEntries() - function in ai.platon.pulsar.common.ScoreVector
- getEnumCounterRegistry() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry
- getEnumCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry
- getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getEstimatedSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
- getEstimatedSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- getEstimatedSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
- getEstimatedSize() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getEvent() - function in ai.platon.pulsar.common.options.LoadOptions
- getEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getEvent() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink
- The event handler
- getEvent() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink
- The event handler
- getEvent() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl
- getEvent() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
- getEvent() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
- The event handler
- getEventExceptionHandler() - function in ai.platon.pulsar.common.event.AbstractEventEmitter
- getException() - function in ai.platon.pulsar.crawl.fetch.FetchResult
- getException() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation
- getExecutor() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- getExpandAtSign() - function in ai.platon.pulsar.common.options.PulsarOptions
- getExpandAtSign() - function in ai.platon.pulsar.common.options.PulsarOptions
- getExpireAt() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- The default time to expire
- getExpireAt() - function in ai.platon.pulsar.common.options.LoadOptions
- The expiry time point.
- getExpiredLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getExpires() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getExpires() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- The default expiry time, some time we may need expire all pages by default, for example, in test mode
- getExpires() - function in ai.platon.pulsar.common.options.LoadOptions
- The expiry duration.
- getExpireTime() - function in ai.platon.pulsar.crawl.protocol.RobotRules
- Get expire time
- getExternalSize() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getFailedHosts() - function in ai.platon.pulsar.crawl.CoreMetrics
- getFailedUrls() - function in ai.platon.pulsar.crawl.CoreMetrics
- getFailureRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getFailureRateThreshold() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getFatLink() - function in ai.platon.pulsar.common.collect.PageFatLink
- getFatLinks() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- Track the status of this batch, we need a notice when the batch is finished
- getFatLinks() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- Track the status of this batch, we need a notice when the batch is finished
- getFetchComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getFetchComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getFetchComponent() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default fetch component
- getFetchComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getFetchComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getFetchConcurrency() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getFetchingCache() - function in ai.platon.pulsar.crawl.common.GlobalCache
- Fetching cache holds the URLs being fetched.
- getFetchInterval() - function in ai.platon.pulsar.common.options.LoadOptions
- The fetch interval, used for periodically fetch tasks.
- getFetchInterval() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getFetchLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getFetchMode() - function in ai.platon.pulsar.common.options.FetchOptions
- getFetchMode() - function in ai.platon.pulsar.common.options.LoadOptions
- The fetch mode.
- getFetchPriority() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getFetchSchedule() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getFetchSchedule() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics
- The total bytes of page content of all success web pages
- getFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics
- getFetchTaskTimeout() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getFetchTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
- The actual latest fetch time, WebPage.
- getField(java.lang.CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFieldNames() - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFields() - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFieldValue(java.lang.CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFieldValueAsString(java.lang.CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFieldValues(java.lang.CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument
- getFileName() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getFileName() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getFilterReport() - function in ai.platon.pulsar.crawl.parse.LinkFilter
- getFilters() - function in ai.platon.pulsar.crawl.CrawlLoops.Companion
- getFilters() - function in ai.platon.pulsar.crawl.parse.FilterResult
- getFingerprint() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getFingerprint() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getFingerprint() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getFinishedFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics
- getFinishedFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics
- getFinishes() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getFinishTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getFinishTimes() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getFirst() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers
- getFirstCollectTime() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getFlowStatus() - function in ai.platon.pulsar.crawl.parse.FilterResult
- getFlowStatus() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getFORBID_ALL_RULES() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion
- A BaseRobotRules object appropriate for use when the
robots.txtfile is not fetched due to a403/Forbiddenresponse; all requests are disallowed. - getFreeDiskSpaces() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getFreeMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getFreeMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getFreshLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getGauges() - function in com.codahale.metrics.MetricRegistry
- getGauges(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry
- getGeneralTags() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Returns all collected values of the general meta tags.
- getGenerator() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory
- getGenerators() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory
- getGlobalCache() - function in ai.platon.pulsar.context.PulsarContext
- The global cache
- getGlobalCache() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The global cache
- getGlobalCache() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The global cache
- getGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory
- getGlobalCache() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- getGlobalCache() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getGlobalCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global cache
- getGlobalCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global cache
- getGlobalCache() - function in ai.platon.pulsar.session.PulsarSession
- The global cache
- getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default global cache
- getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.ParseComponent
- getGlobalCacheFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession
- getGlobalCacheFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession
- getGlobalCacheFactory() - function in ai.platon.pulsar.session.PulsarSession
- getGlobalCounters() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion
- getGlobalCounters() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion
- getGlobalMetrics() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getGOOD_CONTENT_TEXT_LENGTH() - function in ai.platon.pulsar.crawl.signature.TextProfileSignature.Companion
- getGraphiteReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGraphiteReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGraphiteServer() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGraphiteServer() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGraphiteServerPort() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGraphiteServerPort() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getGroup(T) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getGroup(java.lang.Class) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getGroup(T) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion
- getGroup(java.lang.Class) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion
- getGroupMode() - function in ai.platon.pulsar.crawl.CoreMetrics
- getGroupMode() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- Host group mode : can be by ip, by host or by domain
- getHardRedirect() - function in ai.platon.pulsar.common.options.LoadOptions
- If false, return the original page record but the redirect target's content, otherwise, return the page record of the redirected target.
- getHeader(java.lang.String) - function in ai.platon.pulsar.crawl.protocol.Response
- The value of a named header.
- getHeader(java.lang.String) - function in ai.platon.pulsar.crawl.protocol.Response
- The value of a named header.
- getHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- getHeaders() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput
- getHeaders() - function in ai.platon.pulsar.crawl.protocol.Response
- getHeaders() - function in ai.platon.pulsar.crawl.protocol.Response
- getHelpList() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- getHistogramContentBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getHistograms() - function in com.codahale.metrics.MetricRegistry
- getHistograms(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry
- getHistory() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory
- Navigate history is small, so search is very fast in a list.
- getHost(java.net.URL,ai.platon.pulsar.crawl.common.URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHost(java.net.URL,java.lang.String,ai.platon.pulsar.crawl.common.URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHost(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHost(java.lang.String,ai.platon.pulsar.crawl.common.URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHost(java.lang.String,java.lang.String,ai.platon.pulsar.crawl.common.URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHost() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getHost() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getHost() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getHost() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId
- getHostBatches(java.net.URL) - function in ai.platon.pulsar.crawl.common.URLUtil
- Partitions of the hostname of the url by ".
- getHostBatches(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Partitions of the hostname of the url by ".
- getHostName(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the lowercased hostname for the url or null if the url is not well formed.
- getHostName(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- getHostName() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getHourlyCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric
- getHourlyCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry
- getHref() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getHref() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getHref() - function in ai.platon.pulsar.common.urls.NormUrl
- getHref() - function in ai.platon.pulsar.common.urls.UrlAware
- getHref() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The hypertext reference, It defines the address of the document, which this time is linked from
- getHref() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getHrefSpec() - function in ai.platon.pulsar.common.urls.NormUrl
- getHttpCode() - function in ai.platon.pulsar.crawl.protocol.Response
- getHttpCode() - function in ai.platon.pulsar.crawl.protocol.Response
- getHttpEquivTags() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Returns all collected values of the "http-equiv" meta tags.
- getHttpStatusCode() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- Request not made
- getHypeLinks() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getHyperlinks() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getHyperlinks() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getId() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getId() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getId() - function in ai.platon.pulsar.context.PulsarContext
- The context id
- getId() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The context id
- getId() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The context id
- getId() - function in ai.platon.pulsar.crawl.CrawlLoop
- getId() - function in ai.platon.pulsar.crawl.Crawler
- The crawl id
- getId() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getId() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop
- getId() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getId() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- The unique browser id
- getId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The unique driver id.
- getId() - function in ai.platon.pulsar.crawl.fetch.driver.Browser
- The unique browser id
- getId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The unique driver id.
- getId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The unique driver id.
- getId() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getId() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- The crawl id
- getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- The crawl id
- getId() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- getId() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- getId() - function in ai.platon.pulsar.crawl.parse.ParseFilter
- getId() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The session id.
- getId() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The session id.
- getId() - function in ai.platon.pulsar.session.PulsarSession
- The session id
- getId() - function in java.lang.Thread
- getId0() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getIdelTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getIdent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent
- getIdent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId
- getIdleTime() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink
- getIdleTime() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The idle timeout.
- getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The idle timeout.
- getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The idle timeout.
- getIframe() - function in ai.platon.pulsar.common.options.LoadOptions
- The iframe id to switch to.
- getIGNORED_PAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion
- getIgnoredPageCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getIgnoreFailure() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- If true, still fetch the page even if it is gone.
- getIgnoreFailure() - function in ai.platon.pulsar.common.options.LoadOptions
- Retry fetching the page even if it's failed last time.
- getIgnoreUrlQuery() - function in ai.platon.pulsar.common.options.LoadOptions
- If true, remove the query parameters in the url.
- getIllegalState() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion
- getImmutableConfig() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory
- getImmutableConfig() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getImmutableConfig() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getImmutableConfig() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getImmutableConfig() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getIncognito() - function in ai.platon.pulsar.common.options.LoadOptions
- Run browser in incognito mode.
- getIndex(java.lang.Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- Get counter indexSearch over small vector is very fast, even faster than small tree.
- getIndex() - function in ai.platon.pulsar.common.options.FetchOptions
- getINDEX_PAGE_URL_PATTERNS() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- The follow patterns are simple rule to indicate a url's category, this is a very simple solution, and the result is not accurate
- getIndexed() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getIndexedPageCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getIndexerCollection() - function in ai.platon.pulsar.common.options.FetchOptions
- getIndexerUrl() - function in ai.platon.pulsar.common.options.FetchOptions
- getIndexerUrl() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getIndexingFilters() - function in ai.platon.pulsar.crawl.component.IndexComponent
- getIndexingFilters() - function in ai.platon.pulsar.crawl.index.IndexingFilters
- getIndexJIT() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getIndexServerHost() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- Index server
- getIndexServerPort() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getIndexThreadCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getIndexUnchecked(java.lang.Integer,java.lang.Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getIndexUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getIndexWriters() - function in ai.platon.pulsar.crawl.component.IndexComponent
- getIndexWriters() - function in ai.platon.pulsar.crawl.index.IndexWriters
- getInitialDelay() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- getInitialDelay() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getInitialDelay() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getInitNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- The total all bytes received by the hardware at the application startup
- getInjectComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getInjectComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getInjectComponent() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default injection component
- getInjectComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getInstance() - function in ai.platon.pulsar.common.domain.DomainSuffixes
- Singleton instance, lazy instantination
- getInstanceSequencer() - function in ai.platon.pulsar.context.support.AbstractPulsarContext.Companion
- getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion
- getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion
- getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver.Companion
- getInstanceSequencer() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter.Companion
- getInterval() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor
- getItemBrowser() - function in ai.platon.pulsar.common.options.LoadOptions
- The browser used to visit the item pages.
- getItemEvent() - function in ai.platon.pulsar.common.options.LoadOptions
- getItemExpireAt() - function in ai.platon.pulsar.common.options.LoadOptions
- If an item page is expired, it should be fetched from the web again.
- getItemExpires() - function in ai.platon.pulsar.common.options.LoadOptions
- The same as expires, but only works for item pages.
- getItemId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getItemId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getItemPageLoadTimeout() - function in ai.platon.pulsar.common.options.LoadOptions
- The same as pageLoadTimeout, but only works for item pages.
- getItemRequireAnchors() - function in ai.platon.pulsar.common.options.LoadOptions
- Re-fetch item pages whos anchors is less than requireAnchors.
- getItemRequireImages() - function in ai.platon.pulsar.common.options.LoadOptions
- Re-fetch item pages who's images is less than requireImages.
- getItemRequireNotBlank() - function in ai.platon.pulsar.common.options.LoadOptions
- Re-fetch the item pages if the required text is blank.
- getItemRequireSize() - function in ai.platon.pulsar.common.options.LoadOptions
- Re-fetch item pages smaller than requireSize.
- getItemScriptTimeout() - function in ai.platon.pulsar.common.options.LoadOptions
- The same as scriptTimeout, but only works for item pages.
- getItemScrollCount() - function in ai.platon.pulsar.common.options.LoadOptions
- The same as scrollCount, but only works for item pages.
- getItemScrollInterval() - function in ai.platon.pulsar.common.options.LoadOptions
- The same as scrollInterval, but only works for item pages.
- getJitIndexer() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getJobId() - function in ai.platon.pulsar.common.ReducerContext
- getJobID() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getJobName() - function in ai.platon.pulsar.common.ReducerContext
- getJobName() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
- Initialize in setup using job conf
- getJobName() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- The job name.
- getKey() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getKey() - function in ai.platon.pulsar.crawl.index.IndexDocument
- getKeyMap() - function in ai.platon.pulsar.crawl.index.IndexerMapping
- getKeywords() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getLabel() - function in ai.platon.pulsar.common.options.LoadOptions
- The task label, it's optional and can be used to group tasks.
- getLabel() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getLabel() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getLabel() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getLabel() - function in ai.platon.pulsar.common.urls.UrlAware
- getLabel() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getLabels() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getLang() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getLang() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getLang() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getLang() - function in ai.platon.pulsar.common.urls.UrlAware
- getLang() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- Required website language
- getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The time of the last action.
- getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The last active time.
- getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The time of the last action.
- getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The time of the last action.
- getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getLastCollectedTime() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector
- getLastFailedLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getLastReportTime() - function in ai.platon.pulsar.crawl.CoreMetrics
- getLastTaskFinishTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getLastTaskStartTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getLastTaskTime() - function in ai.platon.pulsar.crawl.CoreMetrics
- getLAZY_PAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion
- getLazyFlush() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- Lazy flush.
- getLazyFlush() - function in ai.platon.pulsar.common.options.LoadOptions
- If false, pages are flushed into database as soon as possible.
- getLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getLength() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput
- getLength() - function in ai.platon.pulsar.crawl.protocol.Response
- getLength() - function in ai.platon.pulsar.crawl.protocol.Response
- getLimit() - function in ai.platon.pulsar.common.options.FetchOptions
- getLimit() - function in ai.platon.pulsar.common.options.GenerateOptions
- getLimit() - function in ai.platon.pulsar.common.options.InjectOptions
- getLineNumber() - function in ai.platon.pulsar.crawl.fetch.driver.JsException
- getLinkFilter() - function in ai.platon.pulsar.crawl.parse.PageParser
- getLinkOptions() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getListeners() - function in ai.platon.pulsar.common.event.AbstractEventEmitter
- getListeners() - function in ai.platon.pulsar.common.event.AbstractEventEmitter
- getLoadArgs() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getLoadArgs() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getLoadComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getLoadComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getLoadComponent() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default load component
- getLoadComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getLoadedSeeds() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getLoadEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getLoadEvent() - function in ai.platon.pulsar.crawl.PageEvent
- The load phase event handler
- getLoadEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The load phase event handler
- getLoadEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent
- The load phase event handler
- getLocalizedMessage() - function in kotlin.Throwable
- getLocation() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The location of the page, it shows in the browser window, can differ from url.
- getLOG() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getLOG() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getLOG() - function in ai.platon.pulsar.crawl.component.IndexComponent.Companion
- getLOG() - function in ai.platon.pulsar.crawl.component.InjectComponent.Companion
- getLOG() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getLOG() - function in ai.platon.pulsar.crawl.component.WebDbComponent.Companion
- getLOG() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers.Companion
- getLOG() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue.Companion
- getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlFilters.Companion
- getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters
- getLOG() - function in ai.platon.pulsar.crawl.index.IndexWriter.Companion
- getLOG() - function in ai.platon.pulsar.crawl.index.IndexWriters
- getLOG() - function in ai.platon.pulsar.crawl.index.IndexerMapping.Companion
- getLOG() - function in ai.platon.pulsar.crawl.index.IndexingFilters.Companion
- getLOG() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer.Companion
- getLOG() - function in ai.platon.pulsar.crawl.inject.SeedBuilder.Companion
- getLOG() - function in ai.platon.pulsar.crawl.parse.LinkFilter.Companion
- getLOG() - function in ai.platon.pulsar.crawl.parse.PageParser.Companion
- getLOG() - function in ai.platon.pulsar.crawl.parse.ParserConfigReader.Companion
- getLOG() - function in ai.platon.pulsar.crawl.parse.ParserFactory.Companion
- getLOG() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser
- getLog() - function in ai.platon.pulsar.crawl.protocol.Protocol.Companion
- getLOG() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion
- getLOG() - function in ai.platon.pulsar.crawl.protocol.http.HttpRobotRulesParser.Companion
- getLOG() - function in ai.platon.pulsar.crawl.scoring.ScoringFilter.Companion
- getLoginUrl() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getLogLevel() - function in ai.platon.pulsar.common.options.LinkOptions
- getLoops() - function in ai.platon.pulsar.crawl.CrawlLoops
- getLoss() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
- getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainRequestId() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getMajorCode() - function in ai.platon.pulsar.persist.ParseStatus
- getMajorName() - function in ai.platon.pulsar.persist.ParseStatus
- getMap() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
- getMappedName() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getMAX_COUNTERS() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getMAX_COUNTERS_IN_GROUP() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getMAX_GROUPS() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getMaxAnchorLength() - function in ai.platon.pulsar.common.options.LinkOptions
- getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.FetchSchedule
- getMaxHostFailureEvents() - function in ai.platon.pulsar.crawl.CoreMetrics
- getMaximumWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMaxReversedKeyRange() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getMaxUrlLength() - function in ai.platon.pulsar.common.options.LinkOptions
- getMEDIA_PAGE_URL_PATTERN() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- getMEDIA_URL_SUFFIXES() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- TODO : use suffix-urlfilter instead
- getMediaUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getMemoryInfo() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getMessage() - function in kotlin.Throwable
- getMessageWriter() - function in ai.platon.pulsar.common.AppStatusTracker
- getMessageWriter() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getMessageWriter() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getMessageWriter() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getMessageWriter() - function in ai.platon.pulsar.crawl.parse.PageParser
- getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getMetadata(org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- getMeter() - function in ai.platon.pulsar.common.metrics.MultiMetric
- getMeterContentBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getMeterContentMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getMeterFinishes() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMeters() - function in com.codahale.metrics.MetricRegistry
- getMeters(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry
- getMeterSmallPages() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMeterSuccesses() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMeterTasks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMeterTotalNetworkIFsRecvMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getMetrics() - function in ai.platon.pulsar.common.AppStatusTracker
- getMetrics() - function in com.codahale.metrics.MetricRegistry
- getMimeType(java.io.File) - function in ai.platon.pulsar.common.MimeTypeResolver
- Facade interface to Tika's underlying getMimeType method.
- getMimeType(java.lang.String) - function in ai.platon.pulsar.common.MimeTypeResolver
- Facade interface to Tika's underlying getMimeType method.
- getMinAnchorLength() - function in ai.platon.pulsar.common.options.LinkOptions
- getMinConfidence() - function in ai.platon.pulsar.common.EncodingDetector
- getMinimumThroughput() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMinorCode() - function in ai.platon.pulsar.persist.ParseStatus
- getMinorLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getMinorName() - function in ai.platon.pulsar.persist.ParseStatus
- getMinorWarningFactor() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getMinUrlLength() - function in ai.platon.pulsar.common.options.LinkOptions
- getModified() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
- getModifiedAt() - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- getModifiedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getModifiedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getModifiedOptions() - function in ai.platon.pulsar.common.options.LoadOptions
- getModifiedParams() - function in ai.platon.pulsar.common.options.LoadOptions
- getModifiedTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
- getMODIFY_TIME() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getMovedUrls() - function in ai.platon.pulsar.crawl.CoreMetrics
- getMultiValued() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getName() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
- getName() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
- The collector name
- getName() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- getName() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- The collector name
- getName() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
- getName() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- The collector name
- getName() - function in ai.platon.pulsar.common.lang.AbstractPFunction
- getName() - function in ai.platon.pulsar.common.lang.AbstractPHandler
- getName() - function in ai.platon.pulsar.common.lang.PFunction
- getName() - function in ai.platon.pulsar.common.message.Record
- getName(java.lang.Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getName() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getName() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getName() - function in ai.platon.pulsar.crawl.CrawlLoop
- getName() - function in ai.platon.pulsar.crawl.Crawler
- The crawl name
- getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers
- getName() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The driver name.
- getName() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The driver name.
- getName() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The driver name.
- getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- The crawl name
- getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- The crawl name
- getName() - function in ai.platon.pulsar.crawl.index.IndexWriter
- getName() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getName() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
- getName() - function in ai.platon.pulsar.persist.ParseStatus
- getName() - function in java.lang.Thread
- getName() - function in kotlin.BrowserEvents
- getName() - function in kotlin.CloseStrategy
- getName() - function in kotlin.CodahaleSlf4jReporter.LoggingLevel
- getName() - function in kotlin.CommonCounter
- getName() - function in kotlin.Condition
- getName() - function in kotlin.CrawlEvents
- getName() - function in kotlin.FetchTask.State
- getName() - function in kotlin.GenerateComponent.Companion.Counter
- getName() - function in kotlin.ItemExtractor
- getName() - function in kotlin.Name
- getName() - function in kotlin.PageParser.Counter
- getName() - function in kotlin.TaskPool.Status
- getName() - function in kotlin.TaskScheduler.Companion.Counter
- getName() - function in kotlin.URLUtil.GroupMode
- getName() - function in kotlin.UpdateComponent.Companion.Counter
- getName() - function in kotlin.WebDriver.State
- getNames() - function in com.codahale.metrics.MetricRegistry
- getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The current navigation entry.
- getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The current navigation entry.
- getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The current navigation entry.
- getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- The navigation history.
- getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The navigation history.
- getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.Browser
- The navigation history.
- getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The navigation history.
- getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The navigation history.
- getNetCondition() - function in ai.platon.pulsar.common.options.LoadOptions
- Indicates the network condition.
- getNetError() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- getNetErrorName() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- getNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getNetworkIFsRecvBytesPerPage() - function in ai.platon.pulsar.crawl.CoreMetrics
- getNetworkIFsRecvBytesPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics
- getNextPageSelector() - function in ai.platon.pulsar.common.options.LoadOptions
- The selector for next page anchor.
- getNIL() - function in ai.platon.pulsar.common.urls.NormUrl.Companion
- getNIL() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion
- getNJitRetry() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- There are several cases to enable jit retry.
- getNJitRetry() - function in ai.platon.pulsar.common.options.LoadOptions
- Retry at most n times at fetch phase immediately if RETRY(1601) code return.
- getNMaxRetry() - function in ai.platon.pulsar.common.options.LoadOptions
- Retry to fetch at most n times, if page.fetchRetries nMaxRetry, the page is marked as gone and do not fetch it again until -refresh is set to clear page.
- getNMaxRetry() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getNMaxRetry() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getNMaxRetry() - function in ai.platon.pulsar.common.urls.UrlAware
- getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The maximum retry times
- getNoCache() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- A convenience method.
- getNoFilter() - function in ai.platon.pulsar.common.options.GenerateOptions
- getNoFilter() - function in ai.platon.pulsar.common.options.LoadOptions
- If true, no filter will be applied when parse links.
- getNoFollow() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- A convenience method.
- getNoIndex() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- A convenience method.
- getNoNorm() - function in ai.platon.pulsar.common.options.LoadOptions
- If true, no normalizer will be applied when parse links.
- getNoNormalizer() - function in ai.platon.pulsar.common.options.GenerateOptions
- getNoProxy() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- Do not use proxy
- getNoRedirect() - function in ai.platon.pulsar.common.options.LoadOptions
- Do not redirect.
- getNormalizer() - function in ai.platon.pulsar.common.collect.FatLinkExtractor
- getNormalizer() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor
- getNotContains() - function in ai.platon.pulsar.crawl.filter.TextFilter
- getNow(T) - function in java.util.concurrent.CompletableFuture
- getNow(T) - function in java.util.concurrent.CompletableFuture
- getNRetries() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getNumberOfDependents() - function in java.util.concurrent.CompletableFuture
- getNumFinishedTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- getNumHtmlParsed() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser.Companion
- getNumHtmlParses() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser.Companion
- getNumJsoupParsed() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser.Companion
- getNumJsoupParses() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser.Companion
- getNumMaxActiveTabs() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getNumParsed() - function in ai.platon.pulsar.crawl.component.ParseComponent.Companion
- getNumParses() - function in ai.platon.pulsar.crawl.component.ParseComponent.Companion
- getNumPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- getNumPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getNumPoolThreads() - function in ai.platon.pulsar.common.options.FetchOptions
- getNumPrivacyContexts() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- getNumReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- Task counters
- getNumReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getNumReduceTasks() - function in ai.platon.pulsar.common.options.FetchOptions
- Note: in browser mode, reducer tasks/fetch threads/pool threads are not used use browser instances/active browser tabs instead
- getNumRunningTasks() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion
- getNumSlowTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getNumTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- getNumTasksSuccess() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getNumTotalFinishedTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent
- getOnDataExtracted() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnDataExtracted() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnDataExtracted() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnDidInteract() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnDidInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnDidInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnDidScroll() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnDidScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnDidScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.BrowseEvent
- Fire when the document is actually ready.
- getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- Fire when the document is actually ready.
- getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- Fire when the document is actually ready.
- getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.BrowseEvent
- getONE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getOnFeatureComputed() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnFeatureComputed() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnFeatureComputed() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.CrawlEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnLoad() - function in ai.platon.pulsar.crawl.CrawlEvent
- getOnLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.CrawlEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnNavigated() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnNavigated() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnNavigated() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.CrawlEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnParse() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink
- getOnParsed() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnTabStopped() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnTabStopped() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnTabStopped() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillExtractData() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnWillExtractData() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillExtractData() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillFetch() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent
- getOnWillInteract() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.CrawlEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillNavigate() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillNavigate() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillNavigate() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillParse() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnWillParse() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillParse() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.LoadEvent
- getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent
- getOnWillScroll() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillStopTab() - function in ai.platon.pulsar.crawl.BrowseEvent
- getOnWillStopTab() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOnWillStopTab() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent
- getOptionFields() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A list of all option fields.
- getOptionFieldsMap() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A map of all option fields.
- getOptionNames() - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- A list of all the option names.
- getOptionNames(java.lang.String) - function in ai.platon.pulsar.common.options.LoadOptions.Companion
- Get all the available option names for field fieldName.
- getOptions() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getOptions() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt
- getOptions() - function in ai.platon.pulsar.common.urls.NormUrl
- getOptions() - function in ai.platon.pulsar.crawl.common.FetchEntry
- getOptions() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
- Initialize in setup using job conf
- getOrder() - function in ai.platon.pulsar.common.urls.Hyperlink
- getOrder() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The order of this hyperlink in its referrer page
- getOrder() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The order of this hyperlink in its referrer page
- getOrdinal() - function in kotlin.BrowserEvents
- getOrdinal() - function in kotlin.CloseStrategy
- getOrdinal() - function in kotlin.CodahaleSlf4jReporter.LoggingLevel
- getOrdinal() - function in kotlin.CommonCounter
- getOrdinal() - function in kotlin.Condition
- getOrdinal() - function in kotlin.CrawlEvents
- getOrdinal() - function in kotlin.FetchTask.State
- getOrdinal() - function in kotlin.GenerateComponent.Companion.Counter
- getOrdinal() - function in kotlin.ItemExtractor
- getOrdinal() - function in kotlin.Name
- getOrdinal() - function in kotlin.PageParser.Counter
- getOrdinal() - function in kotlin.TaskPool.Status
- getOrdinal() - function in kotlin.TaskScheduler.Companion.Counter
- getOrdinal() - function in kotlin.URLUtil.GroupMode
- getOrdinal() - function in kotlin.UpdateComponent.Companion.Counter
- getOrdinal() - function in kotlin.WebDriver.State
- getOrNull(java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get a webpage from the storage
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.PulsarContext
- Get a page from storage.
- getOrNull(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- getOrNull(java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Get a webpage from the storage
- getOrNull(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- getOrNull(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a page from storage.
- getOrNull(java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get a page from storage.
- getOrNull(java.lang.String,java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get a page from storage.
- getOutLinkPattern() - function in ai.platon.pulsar.common.options.LoadOptions
- The pattern to select out links in the portal page.
- getOutLinkSelector() - function in ai.platon.pulsar.common.options.LoadOptions
- The selector to extract links in portal pages.
- getOutLinkSelectorOrNull() - function in ai.platon.pulsar.common.options.LoadOptions
- getOutOfWorkTimeout() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- The out of work timeout.
- getPadding() - function in ai.platon.pulsar.common.message.Record
- getPage() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor
- getPage() - function in ai.platon.pulsar.common.collect.PageFatLink
- getPage() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor
- getPage() - function in ai.platon.pulsar.common.message.FetchStatusFormatter
- getPage() - function in ai.platon.pulsar.crawl.common.FetchEntry
- getPage() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getPage() - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry
- getPage() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getPage() - function in ai.platon.pulsar.crawl.parse.html.ParseContext
- getPage() - function in ai.platon.pulsar.crawl.protocol.Response
- getPage() - function in ai.platon.pulsar.crawl.protocol.Response
- getPAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion
- getPageAnchors() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPageCache() - function in ai.platon.pulsar.crawl.common.GlobalCache
- The global page cache, a page will be removed automatically if it's expired or the cache is full.
- getPageCache() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getPageCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global page cache
- getPageCache() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The global page cache
- getPageCache() - function in ai.platon.pulsar.session.PulsarSession
- The global page cache
- getPageCacheHits() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion
- getPageCacheHits() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion
- getPageCategory(java.lang.String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- getPageDatum() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput
- getPageDatum() - function in ai.platon.pulsar.crawl.protocol.Response
- getPageDatum() - function in ai.platon.pulsar.crawl.protocol.Response
- getPageHeights() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPageId() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The page id, 0 means there is no WebPage.
- getPageImages() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPageLoadTimeout() - function in ai.platon.pulsar.common.options.LoadOptions
- The maximum time to wait for a page to finish.
- getPageNumbers() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPageParser() - function in ai.platon.pulsar.crawl.component.ParseComponent
- getPageParser() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getPageReferrer() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The referrer claimed by the page.
- getPages() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter
- getPageSmallTexts() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPagesPerSecond() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getPagesThroughputRate() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
- getPageText(kotlin.text.StringBuilder,org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- This is a convinience method, equivalent to .
- getPageText(kotlin.text.StringBuilder,org.w3c.dom.Node,java.lang.Boolean) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- This method takes a StringBuilder and a DOM Node, and will append all the content text found beneath the DOM node to the
StringBuilder. - getPageText(org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- getPageTitle(org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser
- getPageType() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getPageUrl() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The page url which can be used to retrieve the WebPage from database.
- getPageViews() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getParams() - function in ai.platon.pulsar.common.config.FetchSchedule
- getParams() - function in ai.platon.pulsar.common.config.IndexWriter
- getParams() - function in ai.platon.pulsar.common.config.IndexingFilter
- getParams() - function in ai.platon.pulsar.common.config.Parameterized
- getParams() - function in ai.platon.pulsar.common.config.ParseFilter
- getParams() - function in ai.platon.pulsar.common.config.Parser
- getParams() - function in ai.platon.pulsar.common.config.ScoringFilter
- getParams() - function in ai.platon.pulsar.common.options.InjectOptions
- getParams() - function in ai.platon.pulsar.common.options.LinkOptions
- getParams() - function in ai.platon.pulsar.common.options.LoadOptions
- Convert the LoadOptions to be a Params.
- getParams() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getParams() - function in ai.platon.pulsar.crawl.CoreMetrics
- getParams() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getParams() - function in ai.platon.pulsar.crawl.component.InjectComponent
- getParams() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getParams() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop
- getParams() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
- getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getParams() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer
- getParams() - function in ai.platon.pulsar.crawl.inject.SeedBuilder
- getParams() - function in ai.platon.pulsar.crawl.parse.LinkFilter
- getParams() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser
- getParams() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getParams() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- getParams() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule
- getParams() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule
- getParams() - function in ai.platon.pulsar.crawl.scoring.ScoringFilters
- getParent() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- The parent filter
- getParent() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- The parent filter
- getParent() - function in ai.platon.pulsar.crawl.parse.ParseFilter
- The parent filter
- getParentId() - function in ai.platon.pulsar.crawl.parse.ParseFilter
- getParentId() - function in ai.platon.pulsar.crawl.parse.ParseFilter
- getParse() - function in ai.platon.pulsar.common.options.FetchOptions
- getParse() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- Trigger the parse phase or not.
- getParse() - function in ai.platon.pulsar.common.options.LoadOptions
- If true, parse the page when it's just be fetched.
- getParse() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getParseComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getParseComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getParseComponent() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default parse component
- getParseComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getParseComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getParseFilters() - function in ai.platon.pulsar.crawl.parse.ParseFilters
- getParseResult() - function in ai.platon.pulsar.crawl.parse.html.ParseContext
- getParserFactory() - function in ai.platon.pulsar.crawl.parse.PageParser
- getParsers() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getParsers() - function in ai.platon.pulsar.crawl.parse.ParserConfig
- getParsers(java.lang.String) - function in ai.platon.pulsar.crawl.parse.ParserConfig
- getParsers(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.parse.ParserFactory
- Function returns an array of Parsers for a given content type.
- getPassword() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getPasswordSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getPath(java.lang.String) - function in ai.platon.pulsar.common.MultiSinkWriter
- getPath() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- The path of the file source
- getPath() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- The path of the file source
- getPendingFetchItems() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
- getPendingStart() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getPendingTask(java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion
- getPermanentContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- life cycle of the permanent context is relatively long.
- getPersist() - function in ai.platon.pulsar.common.options.LoadOptions
- Persist fetched pages as soon as possible.
- getPersistContentMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPersists() - function in ai.platon.pulsar.crawl.CoreMetrics
- getPoolId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getPoolPendingTimeout() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- Once timeout, the pending items should be put to the ready pool again.
- getPostfix() - function in ai.platon.pulsar.common.message.Record
- getPrefix() - function in ai.platon.pulsar.common.message.Record
- getPrevFetchTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
- The previous actual latest fetch time
- getPrevModifiedTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo
- getPriority() - function in ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
- getPriority() - function in ai.platon.pulsar.common.lang.AbstractPFunction
- getPriority() - function in ai.platon.pulsar.common.lang.AbstractPHandler
- getPriority() - function in ai.platon.pulsar.common.lang.PFunction
- getPriority() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getPriority() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getPriority() - function in ai.platon.pulsar.common.urls.UrlAware
- getPriority() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The priority
- getPriority() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId
- getPRIORITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getPriority() - function in java.lang.Thread
- getPRIVACY_CONTEXT_IDLE_TIMEOUT_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getPrivacyAgent() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getPrivacyAgent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getPrivacyContextIdGenerator() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- getPrivacyLeakMinorWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getPrivacyLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId
- getProtocol(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory
- TODO: configurable, using major protocol/sub protocol is a good idea Using major protocol/sub protocol is a good idea, for example: selenium:http://www.baidu.
- getProtocol(ai.platon.pulsar.persist.metadata.FetchMode) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory
- getProtocol(java.lang.String) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory
- Returns the appropriate Protocol implementation for a url.
- getProtocolFactory() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getProtocolFactory() - function in ai.platon.pulsar.crawl.component.FetchComponent
- getProtocolOutput(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolOutput(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolOutput(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolOutputDeferred(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolOutputDeferred(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolOutputDeferred(ai.platon.pulsar.persist.WebPage,kotlin.coroutines.Continuation) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Returns the ProtocolOutput for a fetch list entry.
- getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput
- getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.Response
- getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.Response
- getPROTOTYPE() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion
- Represent the prototype browser.
- getPROTOTYPE() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion
- The prototype privacy agent opens browser with the prototype data dir.
- getPROTOTYPE_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getPROTOTYPE_DATA_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getProxies() - function in ai.platon.pulsar.crawl.CoreMetrics
- getProxyEntry() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getPulsarEnvironment() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getPulsarEnvironment() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getQuery(java.lang.String) - function in ai.platon.pulsar.crawl.common.URLUtil
- Returns the path for the url.
- getRANDOM() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion
- getRANDOM() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion
- getRANDOM_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getRawEvent() - function in ai.platon.pulsar.common.options.LoadOptions
- getRawItemEvent() - function in ai.platon.pulsar.common.options.LoadOptions
- getReadableState() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getReadonly() - function in ai.platon.pulsar.common.options.LoadOptions
- Specify if the load execution is read only or not.
- getReadyFetchItems() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status
- getRealTimeNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- getREF_EXTRACT_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getREF_FETCH_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getREF_INDEX_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getREF_PARSE_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getReferer() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getReferer() - function in ai.platon.pulsar.common.urls.UrlAware
- getReferrer() - function in ai.platon.pulsar.common.options.LoadOptions
- The page referrer.
- getReferrer() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getReferrer() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getReferrer() - function in ai.platon.pulsar.common.urls.NormUrl
- getReferrer() - function in ai.platon.pulsar.common.urls.UrlAware
- getReferrer() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The url of the referrer page
- getReflectedGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory
- getRefresh() - function in ai.platon.pulsar.common.options.LoadOptions
- Refresh the fetch state of a page, clear the retry counters.
- getRefresh() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Sets
refreshto the supplied value. - getRefreshCodes() - function in ai.platon.pulsar.crawl.common.FetchState
- getRefreshHref() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Sets the
refreshHref. - getRefreshTime() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags
- Sets the
refreshTime. - getReg() - function in ai.platon.pulsar.common.metrics.AppMetrics.Companion
- getReg() - function in ai.platon.pulsar.common.metrics.MetricsSystem.Companion
- getReGenerate() - function in ai.platon.pulsar.common.options.GenerateOptions
- getReGenerateSeeds() - function in ai.platon.pulsar.common.options.GenerateOptions
- getRegexMatchedLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getRegisteredCounters() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getRemoteAddr() - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- getRemoteAddr() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getRemoteAddr() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getReparseLinks() - function in ai.platon.pulsar.common.options.LoadOptions
- Re-parse links if the page has been parsed before.
- getReport() - function in ai.platon.pulsar.common.options.LinkOptions
- getReport() - function in ai.platon.pulsar.crawl.CrawlLoop
- getReport() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getReport() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getReport() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- getReportDir() - function in ai.platon.pulsar.common.MultiSinkWriter
- getRequireAnchors() - function in ai.platon.pulsar.common.options.LoadOptions
- The minimum number of anchors expected in the page, if it is less than that, it will need to be re-fetched.
- getRequired() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getRequired() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields
- getRequireImages() - function in ai.platon.pulsar.common.options.LoadOptions
- The minimum number of images expected in the page, if it is less than that, it will need to be re-fetched.
- getRequireNotBlank() - function in ai.platon.pulsar.common.options.LoadOptions
- The selector specified element should have a non-blank text, the task should be retried if the element's text content is empty or blank.
- getRequireSize() - function in ai.platon.pulsar.common.options.LoadOptions
- The minimum page size expected, if it is less than that, it will need to be re-fetched.
- getReservedUrl() - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry
- getResponse() - function in ai.platon.pulsar.crawl.fetch.FetchResult
- getResponse(ai.platon.pulsar.persist.WebPage,boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getResponse(ai.platon.pulsar.persist.WebPage,java.lang.Boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getResponse(java.lang.String,ai.platon.pulsar.persist.WebPage,boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol
- getResponseDeferred(ai.platon.pulsar.persist.WebPage,boolean,kotlin.coroutines.Continuation) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getResponseDeferred(ai.platon.pulsar.persist.WebPage,java.lang.Boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getResponses(java.util.Collection,ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.Protocol
- getResponses(java.util.Collection,ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getResponses(java.util.Collection,ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getRestrictCss() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor
- getRestrictCss() - function in ai.platon.pulsar.common.options.LinkOptions
- getResume() - function in ai.platon.pulsar.common.options.FetchOptions
- getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.Crawler
- Delay policy for retry tasks
- getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- Delay policy for retry tasks
- getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- Delay policy for retry tasks
- getReversedEndKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getReversedKeyRanges() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getReversedStartKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getRobotRules(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol
- Retrieve robot rules applicable for this url.
- getRobotRules(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Retrieve robot rules applicable for this url.
- getRobotRules(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- Retrieve robot rules applicable for this url.
- getRobotRulesSet(ai.platon.pulsar.crawl.protocol.Protocol,java.net.URL) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser
- getRobotRulesSet(ai.platon.pulsar.crawl.protocol.Protocol,java.lang.String) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser
- getRobotRulesSet(ai.platon.pulsar.crawl.protocol.Protocol,java.lang.String) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser
- getRobotRulesSet(ai.platon.pulsar.crawl.protocol.Protocol,java.net.URL) - function in ai.platon.pulsar.crawl.protocol.http.HttpRobotRulesParser
- Get the rules from robots.
- getRound() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getRound() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters
- getRound() - function in ai.platon.pulsar.common.options.FetchOptions
- getRound() - function in ai.platon.pulsar.common.options.GenerateOptions
- getRoundCollected() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getRpa() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent
- getRpa() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent
- getRpa() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent
- getRunningChromeProcesses() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion
- getScope() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer
- getScope() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getScore() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getScoreVector() - function in ai.platon.pulsar.crawl.scoring.io.ScoreVectorWritable
- getScoringFilters() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getScriptLoader() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- getScriptTimeout() - function in ai.platon.pulsar.common.options.LoadOptions
- The maximum time to perform javascript injected into the browser.
- getScrollCount() - function in ai.platon.pulsar.common.options.LoadOptions
- The number of times the page should be scrolled down after it has just been opened in a browser.
- getScrollInterval() - function in ai.platon.pulsar.common.options.LoadOptions
- The interval to scroll down.
- getSEARCH_PAGE_URL_PATTERN() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- getSearchUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getSeed() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
- getSeeds() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- The urls of portal pages from where hyper links are extracted from
- getSeeds() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- The urls of portal pages from where hyper links are extracted from
- getSeeds() - function in ai.platon.pulsar.common.options.InjectOptions
- getSelector() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor
- getSequence() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getSession() - function in ai.platon.pulsar.common.collect.FatLinkExtractor
- getSession() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- The pulsar session to use
- getSession() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- The pulsar session to use
- getSession() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- getSession() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler
- getSession() - function in ai.platon.pulsar.session.SessionAware
- getSessionBean() - function in ai.platon.pulsar.session.AbstractPulsarSession
- getSessionBean() - function in ai.platon.pulsar.session.AbstractPulsarSession
- getSessionBeanFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The scoped bean factory: for each volatileConfig object, there is a bean factory
- getSessionBeanFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The scoped bean factory: for each volatileConfig object, there is a bean factory
- getSessionBeanFactory() - function in ai.platon.pulsar.session.PulsarSession
- The scoped bean factory: for each volatileConfig object, there is a bean factory
- getSessionConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The session scope volatile config, every setting is supposed to be changed at any time and any place
- getSessionConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession
- The session scope volatile config, every setting is supposed to be changed at any time and any place
- getSessionConfig() - function in ai.platon.pulsar.session.PulsarSession
- The session scope volatile config, every setting is supposed to be changed at any time and any place
- getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- getSessions() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- All open sessions
- getSessions() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- All open sessions
- getShouldBreak() - function in ai.platon.pulsar.crawl.parse.FilterResult
- getShouldBreak() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getShouldContinue() - function in ai.platon.pulsar.crawl.parse.FilterResult
- getShouldContinue() - function in ai.platon.pulsar.crawl.parse.ParseResult
- getSignature() - function in ai.platon.pulsar.crawl.parse.PageParser
- getSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector
- getSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- getSize() - function in ai.platon.pulsar.common.collect.LoadingDelayQueue
- getSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
- getSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector
- getSize() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction0
- getSize() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction1
- getSize() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction2
- getSize() - function in ai.platon.pulsar.common.lang.AbstractChainedPDFunction2
- getSize() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
- getSize() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory
- getSkipTruncated() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getSlashed() - function in ai.platon.pulsar.common.options.InjectOptions
- getSlf4jReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getSlf4jReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem
- getSmallPageRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getSmallPages() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getSource() - function in ai.platon.pulsar.common.EncodingDetector.EncodingClue
- getSpec() - function in ai.platon.pulsar.common.urls.NormUrl
- getSpecifiedGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory
- getStackTrace() - function in java.lang.Thread
- getStackTrace() - function in kotlin.Throwable
- getStartKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getStartTime() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getStartTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getStartTime() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter
- getStartTime() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The start time
- getStartTime() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- The start time
- getStartTime() - function in ai.platon.pulsar.crawl.CoreMetrics
- The start time of the program process
- getStartTime() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getStartTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getStartTimes() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getState() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getState() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The driver status.
- getState() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The driver status.
- getState() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The driver status.
- getState() - function in java.lang.Thread
- getStatus() - function in ai.platon.pulsar.common.ReducerContext
- getStatus() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getStatus() - function in ai.platon.pulsar.common.domain.DomainSuffix
- getStatus(java.lang.Boolean) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getStatus(java.util.Set,java.lang.Boolean) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry
- getStatus() - function in ai.platon.pulsar.common.urls.StatefulHyperlink
- getStatus() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getStatus() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getStatus() - function in ai.platon.pulsar.crawl.fetch.FetchResult
- getStatus() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- If a fetch queue is inactive, the queue does not accept any tasks, nor serve any requests, but still hold pending tasks, waiting to finish
- getStatusTracker() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getStopped() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- Indicate if the navigation is stopped.
- getStoreContent() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- Store webpage content or not.
- getStoreContent() - function in ai.platon.pulsar.common.options.LoadOptions
- If false, do not persist the page content which is usually very large.
- getStoreContent() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getStored() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getStream() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- getStrictDf() - function in ai.platon.pulsar.common.options.FetchOptions
- getStringValues() - function in ai.platon.pulsar.crawl.index.IndexField
- getSubmitSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getSuccess() - function in ai.platon.pulsar.crawl.fetch.driver.NetworkResourceResponse
- getSuccesses() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getSuccessFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics
- getSuccessFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics
- getSuccessRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext
- getSupportedMimeTypes() - function in ai.platon.pulsar.crawl.parse.ParserConfig
- getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- Indicates whether the driver supports javascript.
- getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- Indicates whether the driver supports javascript.
- getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- Indicates whether the driver supports javascript.
- getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.Protocol
- getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
- getSuppressed() - function in kotlin.Throwable
- getSymbols() - function in ai.platon.pulsar.crawl.common.FetchState
- getSYSTEM_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion
- getSYSTEM_DEFAULT_CONTEXT_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getSystemCpuLoad() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getSystemInfo() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getSystemLoadAverage() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getTask() - function in ai.platon.pulsar.crawl.fetch.FetchResult
- getTaskId() - function in ai.platon.pulsar.common.options.LoadOptions
- The task id, it's optional and can be used to distinguish tasks.
- getTasks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics
- getTasksMonitor() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- getTaskTime() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- The default task time.
- getTaskTime() - function in ai.platon.pulsar.common.options.LoadOptions
- The task time, we usually use task time to indicate the name of a task batch.
- getTemporaryContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- The life cycle of the temporary context is very short.
- getTest() - function in ai.platon.pulsar.common.options.LoadOptionDefaults
- Set to be 0 if we are doing unit test or other test.
- getTest() - function in ai.platon.pulsar.common.options.LoadOptions
- The test level, 0 to disable, we will talk more in test mode.
- getText() - function in ai.platon.pulsar.common.urls.Hyperlink
- getText() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The anchor text of this hyperlink
- getText() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The anchor text of this hyperlink
- getText() - function in ai.platon.pulsar.crawl.fetch.driver.JsException
- getTextFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getThreadGroup() - function in java.lang.Thread
- getTiebaUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getTimeout() - function in ai.platon.pulsar.crawl.parse.Parser
- getTimeout() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser
- Optimized for html content To parse non-html content, the parser might run into an endless loop, run it in a separate coroutine to protect the process
- getTimeoutUrls() - function in ai.platon.pulsar.crawl.CoreMetrics
- Tracking hosts who are failed to fetch tasks.
- getTimePerPage() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getTimeReport() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- getTimeReport() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
- getTimers() - function in com.codahale.metrics.MetricRegistry
- getTimers(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry
- getTopLinks() - function in ai.platon.pulsar.common.options.LoadOptions
- Specify how many links to extract for out pages.
- getTopN() - function in ai.platon.pulsar.common.options.GenerateOptions
- getTopNAnchorGroups() - function in ai.platon.pulsar.common.options.LoadOptions
- Choose the top N anchor groups for further process.
- getTotalMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getTotalMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getTotalNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics
- The total all bytes received by the hardware last read from system
- getTotalSuccessBytes() - function in ai.platon.pulsar.crawl.fetch.BatchStat
- getToURL() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getToURL() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getToURL() - function in ai.platon.pulsar.common.urls.UrlAware
- getToURL() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getToURLOrNull() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getToURLOrNull() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getToURLOrNull() - function in ai.platon.pulsar.common.urls.UrlAware
- getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- getTraceInfo() - function in ai.platon.pulsar.crawl.component.ParseComponent
- getType() - function in ai.platon.pulsar.common.domain.TopLevelDomain
- getType() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField
- getUncaughtExceptionHandler() - function in java.lang.Thread
- getUnfilteredLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters
- getUnknownUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getUnmodifiedConfig() - function in ai.platon.pulsar.context.PulsarContext
- An immutable config loaded from the config file at startup, and never changes
- getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- An immutable config loaded from the config file at startup, and never changes
- getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- An immutable config loaded from the config file at startup, and never changes
- getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default unmodified config
- getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getUnmodifiedConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession
- An immutable config which is loaded from the config file at process startup, and never changes
- getUnmodifiedConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession
- An immutable config which is loaded from the config file at process startup, and never changes
- getUnmodifiedConfig() - function in ai.platon.pulsar.session.PulsarSession
- An immutable config which is loaded from the config file at process startup, and never changes
- getUnparsableTypes() - function in ai.platon.pulsar.crawl.parse.PageParser
- getUnreachableHosts() - function in ai.platon.pulsar.crawl.CoreMetrics
- Tracking unreachable hosts
- getUnserializableValue() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation
- getUpdateComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUpdateComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUpdateComponent() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default update component
- getUpdateComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getUpdateComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getUrl() - function in ai.platon.pulsar.common.urls.AbstractUrl
- getUrl() - function in ai.platon.pulsar.common.urls.ListenableUrl
- getUrl() - function in ai.platon.pulsar.common.urls.NormUrl
- getUrl() - function in ai.platon.pulsar.common.urls.UrlAware
- getUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink
- The url of this hyperlink
- getUrl() - function in ai.platon.pulsar.crawl.component.LoadComponent.LazyFieldLoader
- getUrl() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getUrl() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getUrl() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key
- getUrl() - function in ai.platon.pulsar.crawl.fetch.driver.JsException
- getUrl() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry
- The url to navigate to.
- getUrl() - function in ai.platon.pulsar.crawl.index.IndexDocument
- getUrl() - function in ai.platon.pulsar.crawl.parse.ParserNotFound
- getUrl() - function in ai.platon.pulsar.crawl.protocol.ProtocolNotFound
- getUrl() - function in ai.platon.pulsar.crawl.protocol.Response
- getUrl() - function in ai.platon.pulsar.crawl.protocol.Response
- getUrlContains() - function in ai.platon.pulsar.common.options.LinkOptions
- getUrlFeeder() - function in ai.platon.pulsar.crawl.CrawlLoop
- getUrlFeeder() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop
- The fetch iterable from which all fetch tasks are taken
- getUrlFeeder() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop
- The fetch iterable from which all fetch tasks are taken
- getUrlFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- getUrlFilters() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getUrlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getUrlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters
- getUrlNormalizer() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- getUrlNormalizer() - function in ai.platon.pulsar.common.collect.HyperlinkCollector
- getUrlNormalizer() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizer() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizer() - function in ai.platon.pulsar.context.support.ContextDefaults
- Url default normalizer
- getUrlNormalizer() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getUrlNormalizerOrNull() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizerOrNull() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizers() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizers() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getUrlNormalizers() - function in ai.platon.pulsar.context.support.ContextDefaults
- Url default normalizers
- getUrlNormalizers() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getUrlNormalizers() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getURLNormalizers(java.lang.String) - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer
- TODO : scoped normalizer not implemented
- getUrlNormalizers() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer
- getUrlNormalizers() - function in ai.platon.pulsar.crawl.filter.CrawlFilters
- getUrlPattern() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor
- getUrlPool() - function in ai.platon.pulsar.crawl.common.GlobalCache
- A url pool contains many url caches, the urls added to the pool will be processed in crawl loops.
- getUrlPostfix() - function in ai.platon.pulsar.common.options.LinkOptions
- getUrlPrefix() - function in ai.platon.pulsar.common.options.LinkOptions
- getUrlRegex() - function in ai.platon.pulsar.common.options.LinkOptions
- getUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getUrls() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler
- The url sequence
- getUrlsFromSeed() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getUrlStatistics() - function in ai.platon.pulsar.crawl.CoreMetrics
- Tracking statistics for each host
- getUrlsTooLong() - function in ai.platon.pulsar.crawl.fetch.UrlStat
- getUrlString() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask
- getUsedMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
- getUsedMemory() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion
- getUSER_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion
- Represent the real user's default browser.
- getUSER_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion
- The user default privacy agent opens browser just like real users do every day.
- getUSER_DEFAULT_CONTEXT_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getUSER_DEFAULT_DATA_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion
- getUserAgent() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser
- The user agent to override, do not override if it's null.
- getUserAgent() - function in ai.platon.pulsar.crawl.fetch.driver.Browser
- The user agent to override, do not override if it's null.
- getUserDataDir() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId
- getUsername() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getUsernameSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getUuid() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector
- getValue() - function in ai.platon.pulsar.common.EncodingDetector.EncodingClue
- getValue() - function in ai.platon.pulsar.common.message.Record
- getValue() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation
- getValues() - function in ai.platon.pulsar.common.ReducerContext
- getValues() - function in ai.platon.pulsar.crawl.index.IndexField
- getVariable(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a variable from this session
- getVariable(java.lang.String) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Get a variable from this session
- getVariable(java.lang.String) - function in ai.platon.pulsar.session.PulsarSession
- Get a variable from this session
- getVerbose() - function in ai.platon.pulsar.common.options.FetchOptions
- getVerbose() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- getVersion() - function in ai.platon.pulsar.common.options.LoadOptions
- The load option version.
- getVolatileConfig() - function in ai.platon.pulsar.crawl.fetch.FetchTask
- getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- The timeout to wait for some object.
- getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The timeout to wait for some object.
- getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- The timeout to wait for some object.
- getWaitNonBlank() - function in ai.platon.pulsar.common.options.LoadOptions
- The selector specified element should have a non-blank text, the system should wait until the element is filled by a non-blank text, or until it times out.
- getWarnUpUrl() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler
- getWEB_GRAPH_SCORE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getWebDb() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getWebDb() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- getWebDb() - function in ai.platon.pulsar.context.support.ContextDefaults
- The default web db
- getWebDb() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- getWebDb() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- getWebDb() - function in ai.platon.pulsar.crawl.component.GenerateComponent
- getWebDb() - function in ai.platon.pulsar.crawl.component.InjectComponent
- getWebDb() - function in ai.platon.pulsar.crawl.component.LoadComponent
- getWebDb() - function in ai.platon.pulsar.crawl.component.UpdateComponent
- getWeight() - function in ai.platon.pulsar.crawl.index.IndexDocument
- getWeight() - function in ai.platon.pulsar.crawl.index.IndexField
- getWidth() - function in ai.platon.pulsar.common.message.Record
- getWithSymbolicLink() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter
- getWriters() - function in ai.platon.pulsar.common.MultiSinkWriter
- getZERO() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion
- getZkHostString() - function in ai.platon.pulsar.common.options.FetchOptions
- getZombieContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager
- getZoneId() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions
- GlobalCache - class in ai.platon.pulsar.crawl.common
- The global cache
- GlobalCacheFactory - class in ai.platon.pulsar.crawl.common
- The global cache factory.
- GOOD - enum entry in ai.platon.pulsar.common.options.Condition
- guessEncoding(ai.platon.pulsar.persist.WebPage,java.lang.String) - function in ai.platon.pulsar.common.EncodingDetector
- Guess the encoding with the previously specified list of clues.
- guessPageCategory(java.lang.String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion
- A simple regex rule to sniff the possible category of a web page