A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _ 

G

gauge(String,MetricRegistry.MetricSupplier) - function in com.codahale.metrics.AppMetricRegistry

 

GenerateComponent - class in ai.platon.pulsar.crawl.component

The generate component.

GenerateComponent.Companion - class in ai.platon.pulsar.crawl.component.GenerateComponent

 

GenerateComponent.Companion.Counter - class in ai.platon.pulsar.crawl.component.GenerateComponent.Companion

 

generateNextId() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

GenerateOptions - class in ai.platon.pulsar.common.options

 

generatorSortValue(WebPage,ScoreVector) - function in ai.platon.pulsar.crawl.scoring.ScoringFilter

This method prepares a sort value for the purpose of sorting and selecting top N scoring pages during fetchlist generation.

generatorSortValue(WebPage,ScoreVector) - function in ai.platon.pulsar.crawl.scoring.ScoringFilters

Calculate a sort value for Generate.

GENERIC - enum entry in ai.platon.pulsar.common.domain.TopLevelDomain.Type

 

get(String) - function in ai.platon.pulsar.common.domain.DomainSuffixes

Return the DomainSuffix object for the extension, if extension is atop level domain returned object will be an instance of TopLevelDomain

get(Integer) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

get(Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

get(String) - function in ai.platon.pulsar.context.PulsarContext

Get a webpage from the storage

get(String,String) - function in ai.platon.pulsar.context.PulsarContext

Get a page from storage.

get(String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a webpage from the storage

get(String,String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a page from storage.

get(String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a webpage from the storage

get(String,String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a page from storage.

get(String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a webpage from the storage

get(String,String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a page from storage.

get(String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a webpage from the storage

get(String,String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a page from storage.

get(Integer) - function in ai.platon.pulsar.crawl.common.WeakPageIndexer

 

get() - function in java.util.concurrent.CompletableHyperlink

 

get(Long,TimeUnit) - function in java.util.concurrent.CompletableHyperlink

 

get() - function in java.util.concurrent.CompletableListenableHyperlink

 

get(Long,TimeUnit) - function in java.util.concurrent.CompletableListenableHyperlink

 

get(String) - function in ai.platon.pulsar.crawl.component.WebDbComponent

 

get(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

get() - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable

 

get(String) - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields

 

get(Name) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector

 

get(Integer) - function in ai.platon.pulsar.common.NamedScoreVector

 

get() - function in ai.platon.pulsar.crawl.scoring.io.ScoreVectorWritable

 

get(String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get a page from storage.

get(String,String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get a page from storage.

get(String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get a page from storage.

get(String,String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get a page from storage.

get(String) - function in ai.platon.pulsar.session.PulsarSession

Get a page from storage.

get(String,String) - function in ai.platon.pulsar.session.PulsarSession

Get a page from storage.

getAbstract() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getAbstract() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getAbstract() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.CommonOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.FetchOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.InjectOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.LinkOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.LoadOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.PulsarOptions

 

getAcceptUnknownOptions() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getActionTimes() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

Track the time of page actions.

getActivateSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getActivateTimeout() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getActiveContext() - function in ai.platon.pulsar.context.PulsarContexts

 

getActiveContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getActualCriticalMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getAdddays() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getAliases() - function in ai.platon.pulsar.crawl.parse.ParserConfig

 

getAll(Integer) - function in ai.platon.pulsar.crawl.common.WeakPageIndexer

 

getAllow() - function in ai.platon.pulsar.crawl.filter.BlockFilter

 

getAllowLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.CommonOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.FetchOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.InjectOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.LinkOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.LoadOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.PulsarOptions

 

getAllowParameterOverwriting() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getANCHOR_ORDER() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getAnchorRegex() - function in ai.platon.pulsar.common.options.LinkOptions

 

getApiPublicOptionNames() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A list of all the names of options who are allowed with REST APIs.

getApplicationContext() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getApplicationContext() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getApplicationContext() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getApplicationContext() - function in ai.platon.pulsar.context.support.StaticPulsarContext

 

getArgOrElse(String,String) - function in ai.platon.pulsar.persist.FilterResult

 

getArgOrElse(String,String) - function in ai.platon.pulsar.persist.ParseResult

 

getArgs() - function in ai.platon.pulsar.common.options.CommonOptions

 

getArgs() - function in ai.platon.pulsar.common.options.FetchOptions

 

getArgs() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getArgs() - function in ai.platon.pulsar.common.options.InjectOptions

 

getArgs() - function in ai.platon.pulsar.common.options.LinkOptions

 

getArgs() - function in ai.platon.pulsar.common.options.LoadOptions

 

getArgs() - function in ai.platon.pulsar.common.options.PulsarOptions

 

getArgs() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getArgs() - function in ai.platon.pulsar.common.urls.NormUrl

 

getArgs() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getArgs() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getArgs() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getArgs() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getArgs() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The url arguments

getArgs() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getArgs() - function in ai.platon.pulsar.persist.FilterResult

 

getArgs() - function in ai.platon.pulsar.persist.ParseResult

 

getArgv() - function in ai.platon.pulsar.common.options.CommonOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.FetchOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.GenerateOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.InjectOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.LinkOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.LoadOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.PulsarOptions

The argument vector

getArgv() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

The argument vector

getArity0BooleanParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A list of the options who's arity is 0.

getArity1BooleanParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A list of the options who's arity is 1.

getAuthToken() - function in ai.platon.pulsar.common.options.LoadOptions

The auth token, used for authorization purpose.

getAuthToken() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getAuthToken() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getAuthToken() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getAutoClose() - function in ai.platon.pulsar.common.metrics.EnumCounterReporter

 

getAutoClose() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor

 

getAutoClose() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getAutoClose() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getAvailableMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getAvailableMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getAverageRecentTimeCost() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getAverageRecentTps() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getAverageTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getAverageTps() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getBadSeeds() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getBaseDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getBaseHref() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Sets the baseHref.

getBaseURLFromTag(Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

If Node contains a BASE tag then it's HREF is returned.

getBatchId() - function in ai.platon.pulsar.common.options.FetchOptions

 

getBatchId() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getBatchId() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getBatchSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getBatchSize() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getBatchSize() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getBatchSize() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getBatchStat() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getBatchTaskId() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getBbsUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getBean(KClass) - function in ai.platon.pulsar.context.PulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean(KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean(KClass) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean(KClass) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean(KClass) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBean() - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a bean with the specified class, throws BeansException if the bean doesn't exist

getBeanOrNull(KClass) - function in ai.platon.pulsar.context.PulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull(KClass) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull(KClass) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull(KClass) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull(KClass) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBeanOrNull() - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a bean with the specified class, returns null if the bean doesn't exist

getBlockFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getBlogUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getBoost() - function in ai.platon.pulsar.common.domain.DomainSuffix

 

getBoost() - function in ai.platon.pulsar.common.domain.TopLevelDomain

 

getBrowseEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getBrowseEvent() - function in ai.platon.pulsar.crawl.PageEvent

The browse phase event handler

getBrowseEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

The browse phase event handler

getBrowseEvent() - function in ai.platon.pulsar.crawl.event.impl.DefaultPageEvent

The browse phase event handler

getBrowser() - function in ai.platon.pulsar.common.options.LoadOptions

Specify which browser to use, google chrome is the default.

getBrowser() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

The default browser is chrome with pulsar implemented web driver.

getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The browser of the driver.

getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The browser of the driver.

getBrowser() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The browser of the driver.

getBrowserSettings() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The browser type.

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The browser type.

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The browser type.

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getBrowserType() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getBytesPerPage() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getBytesPerSecond() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getBytesThoRate() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status

 

getCACHE() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion

 

getCapacity() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

The cache capacity, we assume that all items in the file are loaded into the cache

getCapacity() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

The cache capacity, we assume that all items in the file are loaded into the cache

getCapacity() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

The cache capacity, we assume that all items in the file are loaded into the cache

getCapacity() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCapacity() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCapacity() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getCause() - function in ai.platon.pulsar.common.ServiceUnavailableException

 

getCause() - function in ai.platon.pulsar.common.IllegalBusinessPreconditionException

 

getCause() - function in ai.platon.pulsar.common.IllegalApplicationContextStateException

 

getCause() - function in ai.platon.pulsar.crawl.protocol.http.BlockedException

 

getCause() - function in ai.platon.pulsar.crawl.protocol.http.HttpException

 

getCause() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverException

 

getCause() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverCancellationException

 

getCause() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverUnavailableException

 

getCause() - function in ai.platon.pulsar.crawl.fetch.driver.BrowserErrorPageException

 

getCause() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextException

 

getCause() - function in ai.platon.pulsar.crawl.filter.UrlFilterException

 

getCause() - function in ai.platon.pulsar.crawl.index.IndexingException

 

getCause() - function in ai.platon.pulsar.crawl.parse.ParseException

 

getCause() - function in ai.platon.pulsar.crawl.parse.ParserNotFound

 

getCause() - function in ai.platon.pulsar.crawl.protocol.ProtocolException

 

getCause() - function in ai.platon.pulsar.crawl.protocol.ProtocolNotFound

 

getCause() - function in ai.platon.pulsar.crawl.scoring.ScoringFilterException

 

getChildren() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

The child filters

getChildren() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

The child filters

getChildren() - function in ai.platon.pulsar.crawl.parse.ParseFilter

The child filters

getClassName() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation

 

getClassName(String) - function in ai.platon.pulsar.crawl.parse.ParserConfig

 

getClickTarget() - function in ai.platon.pulsar.common.options.LoadOptions

The selector for element to click.

getClosed() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

Indicate if the tab for this navigation is closed.

getClosed() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getClosed() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getCloseSelector() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getClues() - function in ai.platon.pulsar.common.EncodingDetector

 

getCluesAsString() - function in ai.platon.pulsar.common.EncodingDetector

 

getCMD_SPLIT_PATTERN() - function in ai.platon.pulsar.common.options.PulsarOptions.Companion

 

getCodes() - function in ai.platon.pulsar.crawl.common.FetchState

 

getCollectCount() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getCollectCount() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getCollectCount() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCollectCount() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCollectCount() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCollectCount() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getCollected() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCollectedCount() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getCollector() - function in ai.platon.pulsar.common.collect.PriorityDataCollectorFormatter

 

getCollectors() - function in ai.platon.pulsar.common.collect.PriorityDataCollectorsTableFormatter

 

getCollectors() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getCollectors() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getCollectors() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getCollects() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters

 

getCollectTime() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getCollectTime() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getCollectTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCollectTime() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCollectTime() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCollectTime() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getColumnNumber() - function in ai.platon.pulsar.crawl.fetch.driver.JsException

 

getConf() - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getConf() - function in ai.platon.pulsar.common.config.AbstractNativeHttpProtocol

 

getConf() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getConf() - function in ai.platon.pulsar.crawl.protocol.HttpRobotRulesParser

Get the Configuration object

getConf() - function in ai.platon.pulsar.common.message.MiscMessageWriter

 

getConf() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getConf() - function in ai.platon.pulsar.common.options.LoadOptions

 

getConf() - function in ai.platon.pulsar.crawl.common.GlobalCache

 

getConf() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getConf() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

getConf() - function in ai.platon.pulsar.crawl.component.ParseComponent

 

getConf() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory

 

getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getConf() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getConf() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer

 

getConf() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getConf() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getConf() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters

 

getConf() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

getConf() - function in ai.platon.pulsar.crawl.index.IndexingFilter

 

getConf() - function in ai.platon.pulsar.crawl.index.IndexingFilters

 

getConf() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getConf() - function in ai.platon.pulsar.crawl.parse.LinkFilter

 

getConf() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getConf() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

getConf() - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

getConf() - function in ai.platon.pulsar.common.config.Protocol

 

getConf() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser

Get the Configuration object

getConf() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule

 

getConf() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule

 

getConf() - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule

 

getConf() - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule

 

getConf() - function in ai.platon.pulsar.crawl.scoring.ScoringFilters

 

getConfig() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getConfig() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getConfig() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getConfiguration() - function in ai.platon.pulsar.common.ReducerContext

 

getConfiguredUrl() - function in ai.platon.pulsar.common.urls.NormUrl

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getConfiguredUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getConfuser() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getContains() - function in ai.platon.pulsar.crawl.filter.TextFilter

 

getContainsAny() - function in ai.platon.pulsar.crawl.filter.TextFilter

 

getContainsNone() - function in ai.platon.pulsar.crawl.filter.TextFilter

 

getContent(String) - function in ai.platon.pulsar.context.PulsarContext

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get the content of the page from the storage

getContent(String) - function in ai.platon.pulsar.session.PulsarSession

Get the content of the page from the storage

getCONTENT_SCORE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getContentAsString(String) - function in ai.platon.pulsar.context.PulsarContext

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get the content of the page from the storage

getContentAsString(String) - function in ai.platon.pulsar.session.PulsarSession

Get the content of the page from the storage

getContentPersists() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getContentType() - function in ai.platon.pulsar.crawl.parse.ParserNotFound

 

getContext() - function in ai.platon.pulsar.context.ContextAware

 

getContext() - function in ai.platon.pulsar.session.AbstractPulsarSession

The pulsar context

getContext() - function in ai.platon.pulsar.session.BasicPulsarSession

The pulsar context

getContext() - function in ai.platon.pulsar.session.PulsarSession

The pulsar context

getCONTEXT_DIR_PREFIX() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getContextClassLoader() - function in java.lang.IndexThread

 

getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getContextLeaks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getContextLifeCycleMonitor() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getCookiesAsync() - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

getCoreMetrics() - function in ai.platon.pulsar.common.AppStatusTracker

 

getCoreMetrics() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getCoreMetrics() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

getCoreMetrics() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric

 

getCounterReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getCounterReportInterval() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getCounters() - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

getCounters() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCounters() - function in com.codahale.metrics.AppMetricRegistry

 

getCounters(MetricFilter) - function in com.codahale.metrics.AppMetricRegistry

 

getCountry() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getCountry() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getCountry() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getCountry() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getCountry() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getCountry() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

Required website country

getCountry() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getCountryName() - function in ai.platon.pulsar.common.domain.TopLevelDomain

Returns the country name if TLD is Country Code TLD

getCpuLoad() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion

 

getCRAWL_FILTER_RULES() - function in ai.platon.pulsar.crawl.filter.CrawlFilters.Companion

 

getCrawlDelay() - function in ai.platon.pulsar.crawl.protocol.RobotRules

Get Crawl-Delay, in milliseconds.

getCrawler() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getCrawler() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getCrawler() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getCrawlEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getCrawlEvent() - function in ai.platon.pulsar.crawl.PageEvent

The crawl phase event handler

getCrawlEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

The crawl phase event handler

getCrawlEvent() - function in ai.platon.pulsar.crawl.event.impl.DefaultPageEvent

The crawl phase event handler

getCrawlFilters() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getCrawlFilters() - function in ai.platon.pulsar.crawl.component.ParseComponent

 

getCrawlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getCrawlFilters() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getCrawlId() - function in ai.platon.pulsar.common.options.FetchOptions

 

getCrawlId() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getCrawlId() - function in ai.platon.pulsar.common.options.InjectOptions

 

getCrawlLoops() - function in ai.platon.pulsar.context.PulsarContext

The main loops

getCrawlLoops() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getCrawlLoops() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getCrawlLoops() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getCrawlLoops() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The main loop

getCrawlPool() - function in ai.platon.pulsar.context.PulsarContext

The url pool to fetch

getCrawlPool() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getCrawlPool() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getCrawlPool() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getCrawlPool() - function in ai.platon.pulsar.context.support.StaticPulsarContext

 

getCREATE_TIME() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getCreatedAt() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getCreatedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getCreatedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getCreatedTime() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getCreateTime() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getCreateTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The time when the object is created.

getCRITICAL_CPU_THRESHOLD() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getCriticalMemoryMiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getCsvReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getCsvReportInterval() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getCurrentKey() - function in ai.platon.pulsar.common.ReducerContext

 

getCurrentValue() - function in ai.platon.pulsar.common.ReducerContext

 

getDailyCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric

 

getDailyCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

getData() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

The associated data.

getData() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The associated data.

getData() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The associated data.

getData() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

The associated data.

getData() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The associated data.

getDb() - function in ai.platon.pulsar.crawl.component.LoadComponent.LazyFieldLoader

 

getDbGetCount() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion

 

getDeadline() - function in ai.platon.pulsar.common.options.LoadOptions

The deadline to finish the task, if the deadline is exceeded, the task should be discarded as soon as possible.

getDeadline() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getDeadline() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getDeadline() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getDeadline() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getDeadline() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getDeadline() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getDeadTime() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getDeadTime() - function in ai.platon.pulsar.common.options.LoadOptions

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getDeadTime() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getDeadUrls() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getDEFAULT() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion

 

getDEFAULT() - function in ai.platon.pulsar.common.options.LinkOptions.Companion

 

getDEFAULT() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

The default option.

getDEFAULT() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions.Companion

 

getDEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion

The default privacy agent opens browser with the default data dir, the default data dir will not be removed after the browser closes.

getDEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion

Represent the default browser.

getDEFAULT_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getDEFAULT_DELIMETER() - function in ai.platon.pulsar.common.options.PulsarOptions.Companion

 

getDEFAULT_FINGERPRINT() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

getDEFAULT_MINE_TYPE() - function in ai.platon.pulsar.crawl.parse.ParserFactory.Companion

 

getDEFAULT_SCORE_ENTRIES() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getDEFAULT_SEED_ARGS() - function in ai.platon.pulsar.common.options.LinkOptions.Companion

 

getDEFAULT_SEED_OPTIONS() - function in ai.platon.pulsar.common.options.LinkOptions.Companion

 

getDefaultArgsMap() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A map of all default options.

getDefaultBatchId() - function in ai.platon.pulsar.common.options.FetchOptions.Companion

 

getDefaultCharEncoding() - function in ai.platon.pulsar.common.EncodingDetector

 

getDefaultMetricRegistry() - function in ai.platon.pulsar.common.metrics.MetricsSystem.Companion

 

getDefaultMetricRegistry() - function in ai.platon.pulsar.common.metrics.AppMetrics.Companion

 

getDefaultParams() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A map of all default options.

getDelayCache() - function in ai.platon.pulsar.common.collect.LoadingDelayQueue

 

getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getDelayPolicy() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getDELIMITER() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getDepth() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getDepth() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getDepth() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getDepth() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getDescription() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation

 

getDetail() - function in ai.platon.pulsar.common.urls.NormUrl

 

getDETAIL_PAGE_URL_PATTERNS() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

 

getDetailUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getDigits() - function in ai.platon.pulsar.common.NamedScoreVector

 

getDimension() - function in ai.platon.pulsar.common.NamedScoreVector

 

getDisabledMetricAttributes() - function in com.codahale.metrics.CodahaleSlf4jReporter

 

getDisallow() - function in ai.platon.pulsar.crawl.filter.BlockFilter

 

getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getDisplay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getDisplay() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getDisplay() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getDisplay() - function in ai.platon.pulsar.session.PulsarSession

A short descriptive display text.

getDISTANCE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getDistrict() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getDistrict() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getDistrict() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getDistrict() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getDistrict() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getDistrict() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

Required website district

getDistrict() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getDO_NOT_FETCH() - function in ai.platon.pulsar.crawl.common.FetchState

 

getDoc() - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable

 

getDocument() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor

 

getDocument() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor

 

getDocument() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getDocument() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser

 

getDocument() - function in ai.platon.pulsar.crawl.parse.html.ParseContext

 

getDocumentCache() - function in ai.platon.pulsar.crawl.common.GlobalCache

The global document cache, a document will be removed automatically if it's expired or the cache is full.

getDocumentCache() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getDocumentCache() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getDocumentCache() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getDocumentCache() - function in ai.platon.pulsar.session.PulsarSession

The global document cache

getDocumentCacheHits() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

getDocumentReadyTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The time when the document is ready.

getDomain() - function in ai.platon.pulsar.common.domain.DomainSuffix

 

getDomain() - function in ai.platon.pulsar.common.domain.TopLevelDomain

 

getDomain() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getDomainName(URL) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the domain name of the url.

getDomainName(String) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the domain name of the url.

getDomainName(String,String) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getDomainSuffix(String) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the DomainSuffix corresponding to the last public part of the hostname

getDomainSuffix(URL) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the DomainSuffix corresponding to the last public part of the hostname

getDomainSuffix(DomainSuffixes,URL) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getDomainSuffix(DomainSuffixes,String) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the DomainSuffix corresponding to the last public part of the hostname

getDriver() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverException

 

getDriver() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverCancellationException

 

getDriver() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverUnavailableException

 

getDrivers() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getDrivers() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

The created drivers by this browser.

getDropContent() - function in ai.platon.pulsar.common.options.LoadOptions

If the option is set, do not persist the page content which is usually very large.

getDurationUnit() - function in com.codahale.metrics.CodahaleSlf4jReporter

 

getElapsedSeconds() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getElapsedTime() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getElapsedTime() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getElapsedTime() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getElapsedTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getEMPTY_RULES() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion

A BaseRobotRules object appropriate for use when the robots.txt file is empty or missing; all requests are allowed.

getEnableReporter() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getEndKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getEntity() - function in ai.platon.pulsar.common.options.LoadOptions

The entity name of the page, for example, article, product, hotel, flower, etc, it's optional.

getEntries() - function in ai.platon.pulsar.common.NamedScoreVector

 

getEnumCounterRegistry() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

getEnumCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getEstimatedExternalSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getEstimatedSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getEvent() - function in ai.platon.pulsar.common.options.LoadOptions

 

getEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getEvent() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getEvent() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

The event handler

getEvent() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

The event handler

getEvent() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getEvent() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

The event handler

getEventExceptionHandler() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getEventExceptionHandler() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getEventExceptionHandler() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getException() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getException() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation

 

getExecutor() - function in ai.platon.pulsar.common.metrics.EnumCounterReporter

 

getExecutor() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.CommonOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.FetchOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.InjectOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.LinkOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.LoadOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.PulsarOptions

 

getExpandAtSign() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getExpireAt() - function in ai.platon.pulsar.common.options.LoadOptions

The expiry time point.

getExpireAt() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

The default time to expire

getEXPIRED() - function in ai.platon.pulsar.crawl.common.FetchState

 

getExpiredLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getExpires() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getExpires() - function in ai.platon.pulsar.common.options.LoadOptions

The expiry duration.

getExpires() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

The default expiry time, some time we may need expire all pages by default, for example, in test mode

getExpireTime() - function in ai.platon.pulsar.crawl.protocol.RobotRules

Get expire time

getExternalSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getExternalSize() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getExternalSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getExternalSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getExternalSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getExternalSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getFailedHosts() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getFailedUrls() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getFailureRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getFailureRateThreshold() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getFatLink() - function in ai.platon.pulsar.common.collect.PageFatLink

 

getFatLinks() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

Track the status of this batch, we need a notice when the batch is finished

getFatLinks() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

Track the status of this batch, we need a notice when the batch is finished

getFatLinks() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

Track the status of this batch, we need a notice when the batch is finished

getFetchComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getFetchComponent() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getFetchComponent() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getFetchComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The fetch component

getFetchComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getFetchConcurrency() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getFetchingCache() - function in ai.platon.pulsar.crawl.common.GlobalCache

Fetching cache holds the URLs being fetched.

getFetchInterval() - function in ai.platon.pulsar.common.options.LoadOptions

The fetch interval, used for periodically fetch tasks.

getFetchInterval() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getFetchLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getFetchMode() - function in ai.platon.pulsar.common.options.FetchOptions

 

getFetchMode() - function in ai.platon.pulsar.common.options.LoadOptions

The fetch mode.

getFetchPriority() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getFetchSchedule() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getFetchSchedule() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics

The total bytes of page content of all success web pages

getFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getFetchTaskTimeout() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getFetchTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo

The actual latest fetch time, WebPage.

getField(CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFieldNames() - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFields() - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFieldValue(CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFieldValueAsString(CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFieldValues(CharSequence) - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getFileName() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getFileName() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getFileName() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getFilterReport() - function in ai.platon.pulsar.crawl.parse.LinkFilter

 

getFilters() - function in ai.platon.pulsar.crawl.CrawlLoops.Companion

 

getFilters() - function in ai.platon.pulsar.crawl.parse.FilterResult

 

getFingerprint() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getFingerprint() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getFingerprint() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getFinishedFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getFinishedFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getFinishes() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getFinishTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getFinishTimes() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getFirst() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getFirstCollectTime() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getFlowStatus() - function in ai.platon.pulsar.crawl.parse.FilterResult

 

getFlowStatus() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getFORBID_ALL_RULES() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion

A BaseRobotRules object appropriate for use when the robots.txt file is not fetched due to a 403/Forbidden response; all requests are disallowed.

getFreeDiskSpaces() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getFreeMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getFreeMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getFreshLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getGauges() - function in com.codahale.metrics.AppMetricRegistry

 

getGauges(MetricFilter) - function in com.codahale.metrics.AppMetricRegistry

 

getGeneralTags() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Returns all collected values of the general meta tags.

getGenerator() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory

 

getGenerators() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory

 

getGlobalCache() - function in ai.platon.pulsar.context.PulsarContext

The global cache

getGlobalCache() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getGlobalCache() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getGlobalCache() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getGlobalCache() - function in ai.platon.pulsar.context.support.StaticPulsarContext

 

getGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory

 

getGlobalCache() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getGlobalCache() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getGlobalCache() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getGlobalCache() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getGlobalCache() - function in ai.platon.pulsar.session.PulsarSession

The global cache

getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getGlobalCacheFactory() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The global cache

getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getGlobalCacheFactory() - function in ai.platon.pulsar.crawl.component.ParseComponent

 

getGlobalCacheFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getGlobalCacheFactory() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getGlobalCacheFactory() - function in ai.platon.pulsar.session.PulsarSession

 

getGlobalCounters() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion

 

getGlobalCounters() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion

 

getGlobalMetrics() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getGOOD_CONTENT_TEXT_LENGTH() - function in ai.platon.pulsar.crawl.signature.TextProfileSignature.Companion

 

getGraphiteReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getGraphiteReportInterval() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getGraphiteServer() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getGraphiteServer() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getGraphiteServerPort() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getGraphiteServerPort() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getGroup(T) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getGroup(Class) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getGroup(Class) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion

 

getGroup(T) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry.Companion

 

getGroupMode() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getGroupMode() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

Host group mode : can be by ip, by host or by domain

getHardRedirect() - function in ai.platon.pulsar.common.options.LoadOptions

If false, return the original page record but the redirect target's content, otherwise, return the page record of the redirected target.

getHeader(String) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

The value of a named header.

getHeader(String) - function in ai.platon.pulsar.crawl.protocol.Response

The value of a named header.

getHeaders() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getHeaders() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput

 

getHeaders() - function in ai.platon.pulsar.crawl.protocol.Response

 

getHelpList() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

 

getHistogramContentBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getHistograms() - function in com.codahale.metrics.AppMetricRegistry

 

getHistograms(MetricFilter) - function in com.codahale.metrics.AppMetricRegistry

 

getHistory() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory

Navigate history is small, so search is very fast in a list.

getHost(String) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHost(String,URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHost(String,String,URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHost(URL,String,URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHost(URL,URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHost() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getHost() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getHost() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getHost() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId

 

getHostBatches(URL) - function in ai.platon.pulsar.crawl.common.URLUtil

Partitions of the hostname of the url by ".

getHostBatches(String) - function in ai.platon.pulsar.crawl.common.URLUtil

Partitions of the hostname of the url by ".

getHostName(String) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the lowercased hostname for the url or null if the url is not well formed.

getHostName(String,String) - function in ai.platon.pulsar.crawl.common.URLUtil

 

getHostName() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getHourlyCounter() - function in ai.platon.pulsar.common.metrics.MultiMetric

 

getHourlyCounters() - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

getHref() - function in ai.platon.pulsar.common.urls.NormUrl

 

getHref() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getHref() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getHref() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getHref() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getHref() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The hypertext reference, It defines the address of the document, which this time is linked from

getHref() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getHref() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getHrefSpec() - function in ai.platon.pulsar.common.urls.NormUrl

 

getHttpCode() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getHttpCode() - function in ai.platon.pulsar.crawl.protocol.Response

 

getHttpEquivTags() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Returns all collected values of the "http-equiv" meta tags.

getHypeLinks() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getHyperlinks() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getHyperlinks() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getHyperlinks() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getId() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getId() - function in ai.platon.pulsar.context.PulsarContext

The context id

getId() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

The context id

getId() - function in ai.platon.pulsar.context.support.BasicPulsarContext

The context id

getId() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

The context id

getId() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The context id

getId() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getId() - function in ai.platon.pulsar.crawl.Crawler

The crawl id

getId() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getId() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop

 

getId() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getId() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

The unique browser id

getId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The unique driver id.

getId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The unique driver id.

getId() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

The unique browser id

getId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The unique driver id.

getId() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getId() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getId() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

The crawl id

getId() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getId() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

The crawl id

getId() - function in java.lang.IndexThread

 

getId() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

 

getId() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

 

getId() - function in ai.platon.pulsar.crawl.parse.ParseFilter

 

getId() - function in ai.platon.pulsar.session.AbstractPulsarSession

The session id.

getId() - function in ai.platon.pulsar.session.BasicPulsarSession

The session id.

getId() - function in ai.platon.pulsar.session.PulsarSession

The session id

getId0() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getID_CAPACITY() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

getID_END() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

getID_START() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

getIdelTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIdent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIdent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIdleTime() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getIdleTime() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The idle timeout.

getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The idle timeout.

getIdleTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The idle timeout.

getIframe() - function in ai.platon.pulsar.common.options.LoadOptions

The iframe id to switch to.

getIGNORED_PAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion

 

getIgnoredPageCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getIgnoreFailure() - function in ai.platon.pulsar.common.options.LoadOptions

Retry fetching the page even if it's failed last time.

getIgnoreFailure() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

If true, still fetch the page even if it is gone.

getIgnoreUrlQuery() - function in ai.platon.pulsar.common.options.LoadOptions

If true, remove the query parameters in the url.

getIllegalState() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion

 

getImmutableConfig() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory

 

getImmutableConfig() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getImmutableConfig() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

getImmutableConfig() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getImmutableConfig() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getIncognito() - function in ai.platon.pulsar.common.options.LoadOptions

Run browser in incognito mode.

getIndex(Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

Get counter indexSearch over small vector is very fast, even faster than small tree.

getIndex() - function in ai.platon.pulsar.common.options.FetchOptions

 

getINDEX_PAGE_URL_PATTERNS() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

The follow patterns are simple rule to indicate a url's category, this is a very simple solution, and the result is not accurate

getIndexed() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getIndexedPageCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getIndexerCollection() - function in ai.platon.pulsar.common.options.FetchOptions

 

getIndexerUrl() - function in ai.platon.pulsar.common.options.FetchOptions

 

getIndexerUrl() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getIndexingFilters() - function in ai.platon.pulsar.crawl.component.IndexComponent

 

getIndexingFilters() - function in ai.platon.pulsar.crawl.index.IndexingFilters

 

getIndexJIT() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getIndexServerHost() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

Index server

getIndexServerPort() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getIndexThreadCount() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getIndexUnchecked(Integer,Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getIndexUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getIndexWriters() - function in ai.platon.pulsar.crawl.component.IndexComponent

 

getIndexWriters() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

getInitialDelay() - function in ai.platon.pulsar.common.metrics.EnumCounterReporter

 

getInitialDelay() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getInitialDelay() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getInitialDelay() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor

 

getInitNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

The total all bytes received by the hardware at the application startup

getInjectComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getInjectComponent() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getInjectComponent() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getInjectComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The injection component

getInstance() - function in ai.platon.pulsar.common.domain.DomainSuffixes

Singleton instance, lazy instantination

getInstanceSequencer() - function in ai.platon.pulsar.context.support.AbstractPulsarContext.Companion

 

getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion

 

getInstanceSequencer() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver.Companion

 

getInstanceSequencer() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter.Companion

 

getInterval() - function in ai.platon.pulsar.common.metrics.EnumCounterReporter

 

getInterval() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor

 

getIsActive() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getIsActive() - function in ai.platon.pulsar.context.PulsarContext

The context id

getIsActive() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getIsActive() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getIsActive() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getIsActive() - function in ai.platon.pulsar.context.support.StaticPulsarContext

 

getIsActive() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getIsActive() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

getIsActive() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

getIsActive() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

 

getIsActive() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getIsActive() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsActive() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getIsActive() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getIsActive() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getIsActive() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

getIsActive() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getIsActive() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsCanceled() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsClosed() - function in ai.platon.pulsar.common.metrics.EnumCounterReporter

 

getIsClosed() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsClosed() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMonitor

 

getIsClosed() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getIsCrashed() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsCrashed() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsCrashed() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsCrashed() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsCrawlRetry() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getIsCriticalCPULoad() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getIsCriticalDiskSpace() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getIsCriticalMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getIsCriticalResources() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getIsDead() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getIsDead() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getIsDead() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getIsDead() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getIsDead() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getIsDead() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getIsDefault() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsDefault() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getIsEmpty() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getIsEnabled() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getIsExpired() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getIsFinished() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getIsFree() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsFree() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsFree() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsFree() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsFullCapacity() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

Check if the privacy context is full capacity.

getIsGood() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsGUI() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getIsHalted() - function in ai.platon.pulsar.crawl.index.jit.indexer.IndexThread

 

getIsHelp() - function in ai.platon.pulsar.common.options.CommonOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.FetchOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.InjectOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.LinkOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.LoadOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.PulsarOptions

 

getIsHelp() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getIsHighFailureRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

Check if this browser is idle.

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsIdle() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsIdle() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getIsInactive() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getIsInit() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsInit() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsInit() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsInit() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsLeaf() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

 

getIsLeaf() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

 

getIsLeaf() - function in ai.platon.pulsar.crawl.parse.ParseFilter

 

getIsLeaked() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsMissionComplete() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

 

getIsMockedPageSource() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Indicate whether the page source is mocked.

getIsMockedPageSource() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Indicate whether the page source is mocked.

getIsMockedPageSource() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Indicate whether the page source is mocked.

getIsNil() - function in ai.platon.pulsar.common.urls.NormUrl

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getIsNil() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getIsNotEmpty() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getIsNotNil() - function in ai.platon.pulsar.common.urls.NormUrl

 

getIsOutOfWork() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getIsPermanent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsPermanent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

A listenable url is not a persistence object because the event handler is not persistent

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

If this link is persistable

getIsPersistable() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getIsPrivacyRetry() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getIsPrototype() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsPrototype() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIsQuit() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsQuit() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsQuit() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsQuit() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsReady() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsReady() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsReady() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsReady() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsReady() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsRecovered() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Whether the driver is recovered from the browser's tab list.

getIsRecovered() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Whether the driver is recovered from the browser's tab list.

getIsRecovered() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Whether the driver is recovered from the browser's tab list.

getIsRelevant() - function in ai.platon.pulsar.crawl.event.VoidHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareFilter

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlFilter

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.HTMLDocumentHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.PrivacyContextHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.PageDatumHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getIsRelevant() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getIsResource() - function in ai.platon.pulsar.common.options.LoadOptions

If true, fetch the url as a resource without browser rendering.

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getIsRetired() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsReused() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Whether the driver is recovered and is reused to serve new tasks.

getIsReused() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Whether the driver is recovered and is reused to serve new tasks.

getIsReused() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Whether the driver is recovered and is reused to serve new tasks.

getIsRoot() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

 

getIsRoot() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

 

getIsRoot() - function in ai.platon.pulsar.crawl.parse.ParseFilter

 

getIsRunning() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getIsSlow() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getIsSmall() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getIsSmartRetryEnabled() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getIsStandard() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getIsStarted() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getIsStarted() - function in ai.platon.pulsar.crawl.CrawlLoops

 

getIsSuccess() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getIsSystemDefault() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsTemporary() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsTemporary() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIsUnderLoaded() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getIsUserDefault() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

getIsUserDefault() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

getIsWorking() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getIsWorking() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getIsWorking() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getIsWorking() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getIsWorking() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getItemBrowser() - function in ai.platon.pulsar.common.options.LoadOptions

The browser used to visit the item pages.

getItemEvent() - function in ai.platon.pulsar.common.options.LoadOptions

 

getItemExpireAt() - function in ai.platon.pulsar.common.options.LoadOptions

If an item page is expired, it should be fetched from the web again.

getItemExpires() - function in ai.platon.pulsar.common.options.LoadOptions

The same as expires, but only works for item pages.

getItemId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getItemId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getItemPageLoadTimeout() - function in ai.platon.pulsar.common.options.LoadOptions

The same as pageLoadTimeout, but only works for item pages.

getItemRequireAnchors() - function in ai.platon.pulsar.common.options.LoadOptions

Re-fetch item pages whos anchors is less than requireAnchors.

getItemRequireImages() - function in ai.platon.pulsar.common.options.LoadOptions

Re-fetch item pages who's images is less than requireImages.

getItemRequireNotBlank() - function in ai.platon.pulsar.common.options.LoadOptions

Re-fetch the item pages if the required text is blank.

getItemRequireSize() - function in ai.platon.pulsar.common.options.LoadOptions

Re-fetch item pages smaller than requireSize.

getItemScriptTimeout() - function in ai.platon.pulsar.common.options.LoadOptions

The same as scriptTimeout, but only works for item pages.

getItemScrollCount() - function in ai.platon.pulsar.common.options.LoadOptions

The same as scrollCount, but only works for item pages.

getItemScrollInterval() - function in ai.platon.pulsar.common.options.LoadOptions

The same as scrollInterval, but only works for item pages.

getJitIndexer() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getJobId() - function in ai.platon.pulsar.common.ReducerContext

 

getJobID() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getJobName() - function in ai.platon.pulsar.common.ReducerContext

 

getJobName() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

Initialize in setup using job conf

getJobName() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

The job name.

getKey() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getKey() - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getKeyMap() - function in ai.platon.pulsar.crawl.index.IndexerMapping

 

getKeywords() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getLabel() - function in ai.platon.pulsar.common.options.LoadOptions

The task label, it's optional and can be used to group tasks.

getLabel() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getLabel() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getLabels() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getLabels() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getLabels() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getLabels() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getLabels() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getLabels() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getLang() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getLang() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getLang() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getLang() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getLang() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

Required website language

getLang() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The time of the last action.

getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The time of the last action.

getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The last active time.

getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The time of the last action.

getLastActiveTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getLastCollectedTime() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getLastFailedLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getLastReportTime() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getLastTaskFinishTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getLastTaskStartTime() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getLastTaskTime() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getLAZY_PAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion

 

getLazyFlush() - function in ai.platon.pulsar.common.options.LoadOptions

If false, pages are flushed into database as soon as possible.

getLazyFlush() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

Lazy flush.

getLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getLength() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getLength() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput

 

getLength() - function in ai.platon.pulsar.crawl.protocol.Response

 

getLimit() - function in ai.platon.pulsar.common.options.FetchOptions

 

getLimit() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getLimit() - function in ai.platon.pulsar.common.options.InjectOptions

 

getLineNumber() - function in ai.platon.pulsar.crawl.fetch.driver.JsException

 

getLinkFilter() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getLinkOptions() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getListeners() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getListeners() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getListeners() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getLoadArgs() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getLoadArgs() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getLoadArgs() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getLoadComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getLoadComponent() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getLoadComponent() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getLoadComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The load component

getLoadedSeeds() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getLoadEvent() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getLoadEvent() - function in ai.platon.pulsar.crawl.PageEvent

The load phase event handler

getLoadEvent() - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

The load phase event handler

getLoadEvent() - function in ai.platon.pulsar.crawl.event.impl.DefaultPageEvent

The load phase event handler

getLocalizedMessage() - function in kotlin.ServiceUnavailableException

 

getLocalizedMessage() - function in kotlin.IllegalBusinessPreconditionException

 

getLocalizedMessage() - function in kotlin.IllegalApplicationContextStateException

 

getLocalizedMessage() - function in kotlin.BlockedException

 

getLocalizedMessage() - function in kotlin.HttpException

 

getLocalizedMessage() - function in kotlin.WebDriverException

 

getLocalizedMessage() - function in kotlin.WebDriverCancellationException

 

getLocalizedMessage() - function in kotlin.WebDriverUnavailableException

 

getLocalizedMessage() - function in kotlin.BrowserErrorPageException

 

getLocalizedMessage() - function in kotlin.PrivacyContextException

 

getLocalizedMessage() - function in kotlin.UrlFilterException

 

getLocalizedMessage() - function in kotlin.IndexingException

 

getLocalizedMessage() - function in kotlin.ParseException

 

getLocalizedMessage() - function in kotlin.ParserNotFound

 

getLocalizedMessage() - function in kotlin.ProtocolException

 

getLocalizedMessage() - function in kotlin.ProtocolNotFound

 

getLocalizedMessage() - function in kotlin.ScoringFilterException

 

getLocation() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The location of the page, it shows in the browser window, can differ from url.

getLOG() - function in ai.platon.pulsar.crawl.protocol.http.HttpRobotRulesParser.Companion

 

getLOG() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getLOG() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getLOG() - function in ai.platon.pulsar.crawl.component.IndexComponent.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.component.InjectComponent.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getLOG() - function in ai.platon.pulsar.crawl.component.WebDbComponent.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlFilters.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters

 

getLOG() - function in ai.platon.pulsar.crawl.index.IndexWriter.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

getLOG() - function in ai.platon.pulsar.crawl.index.IndexerMapping.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.index.IndexingFilter.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.index.IndexingFilters.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.inject.SeedBuilder.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.parse.LinkFilter.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.parse.PageParser.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.parse.ParserConfigReader.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.parse.ParserFactory.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser

 

getLog() - function in ai.platon.pulsar.crawl.protocol.Protocol.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser.Companion

 

getLOG() - function in ai.platon.pulsar.crawl.scoring.ScoringFilter.Companion

 

getLoginUrl() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getLogLevel() - function in ai.platon.pulsar.common.options.LinkOptions

 

getLoops() - function in ai.platon.pulsar.crawl.CrawlLoops

 

getLoss() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields

 

getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainRequestCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainRequestHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getMainRequestId() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainResponseHeaders() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainResponseStatus() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

getMainResponseStatusText() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getMajorCode() - function in ai.platon.pulsar.persist.FilterResult

 

getMajorCode() - function in ai.platon.pulsar.persist.ParseResult

 

getMajorName() - function in ai.platon.pulsar.persist.FilterResult

 

getMajorName() - function in ai.platon.pulsar.persist.ParseResult

 

getMap() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields

 

getMappedName() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getMAX_COUNTERS() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getMAX_COUNTERS_IN_GROUP() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getMAX_GROUPS() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getMaxAnchorLength() - function in ai.platon.pulsar.common.options.LinkOptions

 

getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule

 

getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule

 

getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule

 

getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.FetchSchedule

 

getMaxFetchInterval() - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule

 

getMaxHostFailureEvents() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getMaximumWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMaxReversedKeyRange() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getMaxUrlLength() - function in ai.platon.pulsar.common.options.LinkOptions

 

getMEDIA_PAGE_URL_PATTERN() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

 

getMEDIA_URL_SUFFIXES() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

TODO : use suffix-urlfilter instead

getMediaUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getMemoryInfo() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getMessage() - function in ai.platon.pulsar.common.ServiceUnavailableException

 

getMessage() - function in ai.platon.pulsar.common.IllegalBusinessPreconditionException

 

getMessage() - function in ai.platon.pulsar.common.IllegalApplicationContextStateException

 

getMessage() - function in ai.platon.pulsar.crawl.protocol.http.BlockedException

 

getMessage() - function in ai.platon.pulsar.crawl.protocol.http.HttpException

 

getMessage() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverException

 

getMessage() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverCancellationException

 

getMessage() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriverUnavailableException

 

getMessage() - function in ai.platon.pulsar.crawl.fetch.driver.BrowserErrorPageException

 

getMessage() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextException

 

getMessage() - function in ai.platon.pulsar.crawl.filter.UrlFilterException

 

getMessage() - function in ai.platon.pulsar.crawl.index.IndexingException

 

getMessage() - function in ai.platon.pulsar.crawl.parse.ParseException

 

getMessage() - function in ai.platon.pulsar.crawl.parse.ParserNotFound

 

getMessage() - function in ai.platon.pulsar.crawl.protocol.ProtocolException

 

getMessage() - function in ai.platon.pulsar.crawl.protocol.ProtocolNotFound

 

getMessage() - function in ai.platon.pulsar.crawl.scoring.ScoringFilterException

 

getMessageWriter() - function in ai.platon.pulsar.common.AppStatusTracker

 

getMessageWriter() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getMessageWriter() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getMessageWriter() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getMessageWriter() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule

 

getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule

 

getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule

 

getMessageWriter() - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule

 

getMetadata(Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

getMeter() - function in ai.platon.pulsar.common.metrics.MultiMetric

 

getMeterContentBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getMeterContentMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getMeterFinishes() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMeters() - function in com.codahale.metrics.AppMetricRegistry

 

getMeters(MetricFilter) - function in com.codahale.metrics.AppMetricRegistry

 

getMeterSmallPages() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMeterSuccesses() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMeterTasks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMeterTotalNetworkIFsRecvMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getMetrics() - function in ai.platon.pulsar.common.AppStatusTracker

 

getMetrics() - function in com.codahale.metrics.AppMetricRegistry

 

getMimeType(String) - function in ai.platon.pulsar.common.MimeTypeResolver

Facade interface to Tika's underlying getMimeType method.

getMimeType(File) - function in ai.platon.pulsar.common.MimeTypeResolver

Facade interface to Tika's underlying getMimeType method.

getMinAnchorLength() - function in ai.platon.pulsar.common.options.LinkOptions

 

getMinConfidence() - function in ai.platon.pulsar.common.EncodingDetector

 

getMinimumThroughput() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMinorCode() - function in ai.platon.pulsar.persist.FilterResult

 

getMinorCode() - function in ai.platon.pulsar.persist.ParseResult

 

getMinorLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getMinorName() - function in ai.platon.pulsar.persist.FilterResult

 

getMinorName() - function in ai.platon.pulsar.persist.ParseResult

 

getMinorWarningFactor() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getMinUrlLength() - function in ai.platon.pulsar.common.options.LinkOptions

 

getMISS_FIELD() - function in ai.platon.pulsar.crawl.common.FetchState

 

getModified() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo

 

getModifiedAt() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getModifiedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getModifiedAt() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getModifiedOptions() - function in ai.platon.pulsar.common.options.LoadOptions

 

getModifiedParams() - function in ai.platon.pulsar.common.options.LoadOptions

 

getModifiedTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo

 

getMODIFY_TIME() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getMovedUrls() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getMultiValued() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getName() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

The collector name

getName() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

The collector name

getName() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

The collector name

getName() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getName() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getName() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getName() - function in ai.platon.pulsar.common.message.Record

 

getName() - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.LoggingLevel

 

getName() - function in ai.platon.pulsar.common.metrics.CommonCounter

 

getName(Enum) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getName() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getName() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getName() - function in ai.platon.pulsar.common.options.ItemExtractor

 

getName() - function in ai.platon.pulsar.common.options.Condition

 

getName() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getName() - function in ai.platon.pulsar.crawl.Crawler

The crawl name

getName() - function in ai.platon.pulsar.crawl.common.URLUtil.GroupMode

 

getName() - function in ai.platon.pulsar.crawl.component.GenerateComponent.Companion.Counter

 

getName() - function in ai.platon.pulsar.crawl.component.UpdateComponent.Companion.Counter

 

getName() - function in ai.platon.pulsar.crawl.event.VoidHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareFilter

 

getName() - function in ai.platon.pulsar.crawl.event.UrlHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlFilter

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageHandler

 

getName() - function in ai.platon.pulsar.crawl.event.HTMLDocumentHandler

 

getName() - function in ai.platon.pulsar.crawl.event.PrivacyContextHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverHandler

 

getName() - function in ai.platon.pulsar.crawl.event.PageDatumHandler

 

getName() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getName() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getName() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getName() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getName() - function in ai.platon.pulsar.crawl.fetch.FetchTask.State

 

getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool.Status

 

getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Companion.Counter

 

getName() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

getName() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The driver name.

getName() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getName() - function in ai.platon.pulsar.crawl.fetch.driver.BrowserEvents

 

getName() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The driver name.

getName() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getName() - function in ai.platon.pulsar.crawl.fetch.privacy.CloseStrategy

 

getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getName() - function in ai.platon.pulsar.crawl.impl.CrawlEvents

 

getName() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getName() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getName() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getName() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

getName() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getName() - function in java.lang.IndexThread

 

getName() - function in ai.platon.pulsar.persist.FilterResult

 

getName() - function in ai.platon.pulsar.crawl.parse.PageParser.Counter

 

getName() - function in ai.platon.pulsar.persist.ParseResult

 

getName() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields

 

getName() - function in ai.platon.pulsar.crawl.scoring.Name

 

getNames() - function in com.codahale.metrics.AppMetricRegistry

 

getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The current navigation entry.

getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The current navigation entry.

getNavigateEntry() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The current navigation entry.

getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

The navigation history.

getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The navigation history.

getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The navigation history.

getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

The navigation history.

getNavigateHistory() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The navigation history.

getNetCondition() - function in ai.platon.pulsar.common.options.LoadOptions

Indicates the network condition.

getNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getNetworkIFsRecvBytesPerPage() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getNetworkIFsRecvBytesPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getNEW_PAGE() - function in ai.platon.pulsar.crawl.common.FetchState

 

getNextPageSelector() - function in ai.platon.pulsar.common.options.LoadOptions

The selector for next page anchor.

getNIL() - function in ai.platon.pulsar.common.urls.NormUrl.Companion

 

getNIL() - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

getNJitRetry() - function in ai.platon.pulsar.common.options.LoadOptions

Retry at most n times at fetch phase immediately if RETRY(1601) code return.

getNJitRetry() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

There are several cases to enable jit retry.

getNMaxRetry() - function in ai.platon.pulsar.common.options.LoadOptions

Retry to fetch at most n times, if page.fetchRetries nMaxRetry, the page is marked as gone and do not fetch it again until -refresh is set to clear page.

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The maximum retry times

getNMaxRetry() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getNO_CONTENT() - function in ai.platon.pulsar.crawl.common.FetchState

 

getNoCache() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

A convenience method.

getNoFilter() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getNoFilter() - function in ai.platon.pulsar.common.options.LoadOptions

If true, no filter will be applied when parse links.

getNoFollow() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

A convenience method.

getNoIndex() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

A convenience method.

getNoNorm() - function in ai.platon.pulsar.common.options.LoadOptions

If true, no normalizer will be applied when parse links.

getNoNormalizer() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getNoProxy() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

Do not use proxy

getNoRedirect() - function in ai.platon.pulsar.common.options.LoadOptions

Do not redirect.

getNormalizer() - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

getNormalizer() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor

 

getNotContains() - function in ai.platon.pulsar.crawl.filter.TextFilter

 

getNow(T) - function in java.util.concurrent.CompletableHyperlink

 

getNow(T) - function in java.util.concurrent.CompletableListenableHyperlink

 

getNRetries() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getNumberOfDependents() - function in java.util.concurrent.CompletableHyperlink

 

getNumberOfDependents() - function in java.util.concurrent.CompletableListenableHyperlink

 

getNumFinishedTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

getNumHtmlParsed() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser.Companion

 

getNumHtmlParses() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser.Companion

 

getNumJsoupParsed() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser.Companion

 

getNumJsoupParses() - function in ai.platon.pulsar.crawl.parse.html.JsoupParser.Companion

 

getNumMaxActiveTabs() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getNumParsed() - function in ai.platon.pulsar.crawl.component.ParseComponent.Companion

 

getNumParses() - function in ai.platon.pulsar.crawl.component.ParseComponent.Companion

 

getNumPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

getNumPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getNumPoolThreads() - function in ai.platon.pulsar.common.options.FetchOptions

 

getNumPrivacyContexts() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getNumReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

Task counters

getNumReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getNumReduceTasks() - function in ai.platon.pulsar.common.options.FetchOptions

Note: in browser mode, reducer tasks/fetch threads/pool threads are not used use browser instances/active browser tabs instead

getNumRunningTasks() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion

 

getNumSlowTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getNumTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

getNumTasksSuccess() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getNumTotalFinishedTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnBrowserLaunched() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnDataExtracted() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnDataExtracted() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnDataExtracted() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnDidInteract() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnDidInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnDidInteract() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnDidInteract() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnDidScroll() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnDidScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnDidScroll() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnDidScroll() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.BrowseEvent

Fire when the document is actually ready.

getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

Fire when the document is actually ready.

getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

Fire when the document is actually ready.

getOnDocumentActuallyReady() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

Fire when the document is actually ready.

getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnDOMStateChecked() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getONE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getOnFeatureComputed() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnFeatureComputed() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnFeatureComputed() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnFeatureComputed() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnFetched() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.CrawlEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnFilter() - function in ai.platon.pulsar.crawl.event.impl.DefaultCrawlEvent

 

getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnHTMLDocumentParsed() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnLoad() - function in ai.platon.pulsar.crawl.CrawlEvent

 

getOnLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

getOnLoad() - function in ai.platon.pulsar.crawl.event.impl.DefaultCrawlEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.CrawlEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnLoaded() - function in ai.platon.pulsar.crawl.event.impl.DefaultCrawlEvent

 

getOnNavigated() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnNavigated() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnNavigated() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnNavigated() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.CrawlEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnNormalize() - function in ai.platon.pulsar.crawl.event.impl.DefaultCrawlEvent

 

getOnParse() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getOnParsed() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnParsed() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnParsed() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnTabStopped() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnTabStopped() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnTabStopped() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnTabStopped() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillCheckDocumentState() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillCheckDOMState() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillComputeFeature() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillExtractData() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnWillExtractData() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnWillExtractData() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillFetch() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillInteract() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillInteract() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillInteract() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillInteract() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillLaunchBrowser() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.CrawlEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnWillLoad() - function in ai.platon.pulsar.crawl.event.impl.DefaultCrawlEvent

 

getOnWillNavigate() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillNavigate() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillNavigate() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillNavigate() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillParse() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnWillParse() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnWillParse() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.LoadEvent

 

getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

getOnWillParseHTMLDocument() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getOnWillScroll() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillScroll() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillScroll() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillScroll() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOnWillStopTab() - function in ai.platon.pulsar.crawl.BrowseEvent

 

getOnWillStopTab() - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

getOnWillStopTab() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getOnWillStopTab() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getOptionFields() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A list of all option fields.

getOptionFieldsMap() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A map of all option fields.

getOptionNames(String) - function in ai.platon.pulsar.common.options.LoadOptions.Companion

Get all the available option names for field fieldName.

getOptionNames() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

A list of all the option names.

getOptions() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getOptions() - function in ai.platon.pulsar.common.persist.ext.WebPageExKt

 

getOptions() - function in ai.platon.pulsar.common.urls.NormUrl

 

getOptions() - function in ai.platon.pulsar.crawl.common.FetchEntry

 

getOptions() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

Initialize in setup using job conf

getOrder() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getOrder() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getOrder() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getOrder() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The order of this hyperlink in its referrer page

getOrder() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

The order of this hyperlink in its referrer page

getOrdinal() - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.LoggingLevel

 

getOrdinal() - function in ai.platon.pulsar.common.metrics.CommonCounter

 

getOrdinal() - function in ai.platon.pulsar.common.options.ItemExtractor

 

getOrdinal() - function in ai.platon.pulsar.common.options.Condition

 

getOrdinal() - function in ai.platon.pulsar.crawl.common.URLUtil.GroupMode

 

getOrdinal() - function in ai.platon.pulsar.crawl.component.GenerateComponent.Companion.Counter

 

getOrdinal() - function in ai.platon.pulsar.crawl.component.UpdateComponent.Companion.Counter

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.FetchTask.State

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool.Status

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Companion.Counter

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.driver.BrowserEvents

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

getOrdinal() - function in ai.platon.pulsar.crawl.fetch.privacy.CloseStrategy

 

getOrdinal() - function in ai.platon.pulsar.crawl.impl.CrawlEvents

 

getOrdinal() - function in ai.platon.pulsar.crawl.parse.PageParser.Counter

 

getOrdinal() - function in ai.platon.pulsar.crawl.scoring.Name

 

getOrNull(String) - function in ai.platon.pulsar.context.PulsarContext

Get a webpage from the storage

getOrNull(String,String) - function in ai.platon.pulsar.context.PulsarContext

Get a page from storage.

getOrNull(String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a webpage from the storage

getOrNull(String,String) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Get a webpage from the storage

getOrNull(String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a webpage from the storage

getOrNull(String,String) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Get a webpage from the storage

getOrNull(String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a webpage from the storage

getOrNull(String,String) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Get a webpage from the storage

getOrNull(String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a webpage from the storage

getOrNull(String,String) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Get a webpage from the storage

getOrNull(String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get a page from storage.

getOrNull(String,String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get a page from storage.

getOrNull(String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get a page from storage.

getOrNull(String,String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get a page from storage.

getOrNull(String) - function in ai.platon.pulsar.session.PulsarSession

Get a page from storage.

getOrNull(String,String) - function in ai.platon.pulsar.session.PulsarSession

Get a page from storage.

getOutLinkPattern() - function in ai.platon.pulsar.common.options.LoadOptions

The pattern to select out links in the portal page.

getOutLinkSelector() - function in ai.platon.pulsar.common.options.LoadOptions

The selector to extract links in portal pages.

getOutLinkSelectorOrNull() - function in ai.platon.pulsar.common.options.LoadOptions

 

getOutOfWorkTimeout() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

The out of work timeout.

getPadding() - function in ai.platon.pulsar.common.message.Record

 

getPage() - function in ai.platon.pulsar.common.collect.PageFatLink

 

getPage() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor

 

getPage() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor

 

getPage() - function in ai.platon.pulsar.common.message.FetchStatusFormatter

 

getPage() - function in ai.platon.pulsar.crawl.common.FetchEntry

 

getPage() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getPage() - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry

 

getPage() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getPage() - function in ai.platon.pulsar.crawl.parse.html.ParseContext

 

getPage() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getPage() - function in ai.platon.pulsar.crawl.protocol.Response

 

getPAGE_FIELDS() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion

 

getPageAnchors() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPageCache() - function in ai.platon.pulsar.crawl.common.GlobalCache

The global page cache, a page will be removed automatically if it's expired or the cache is full.

getPageCache() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getPageCache() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getPageCache() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getPageCache() - function in ai.platon.pulsar.session.PulsarSession

The global page cache

getPageCacheHits() - function in ai.platon.pulsar.crawl.component.LoadComponent.Companion

 

getPageCacheHits() - function in ai.platon.pulsar.session.AbstractPulsarSession.Companion

 

getPageCategory(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

 

getPageDatum() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getPageDatum() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput

 

getPageDatum() - function in ai.platon.pulsar.crawl.protocol.Response

 

getPageHeights() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPageId() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The page id, 0 means there is no WebPage.

getPageImages() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPageLoadTimeout() - function in ai.platon.pulsar.common.options.LoadOptions

The maximum time to wait for a page to finish.

getPageNumbers() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPageParser() - function in ai.platon.pulsar.crawl.component.ParseComponent

 

getPageParser() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getPageReferrer() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The referrer claimed by the page.

getPages() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter

 

getPageSmallTexts() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPagesPerSecond() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getPagesThroughputRate() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status

 

getPageText(TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin.text/StringBuilder///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.lang/StringBuilder///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={}))),Node,Boolean) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

This method takes a StringBuilder and a DOM Node, and will append all the content text found beneath the DOM node to the StringBuilder.

getPageText(TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin.text/StringBuilder///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.lang/StringBuilder///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={}))),Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

This is a convinience method, equivalent to .

getPageText(Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

getPageTitle(Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

getPageType() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getPageUrl() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The page url which can be used to retrieve the WebPage from database.

getPageViews() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getPARAM_INDEXER_MAPPING_FILE() - function in ai.platon.pulsar.crawl.index.IndexerMapping.Companion

 

getParams() - function in ai.platon.pulsar.common.config.CommonOptions

 

getParams() - function in ai.platon.pulsar.common.config.FetchOptions

 

getParams() - function in ai.platon.pulsar.common.config.GenerateOptions

 

getParams() - function in ai.platon.pulsar.common.options.InjectOptions

 

getParams() - function in ai.platon.pulsar.common.options.LinkOptions

 

getParams() - function in ai.platon.pulsar.common.options.LoadOptions

Convert the LoadOptions to be a Params.

getParams() - function in ai.platon.pulsar.common.config.PulsarOptions

 

getParams() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getParams() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getParams() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getParams() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

getParams() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getParams() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

getParams() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

 

getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getParams() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getParams() - function in ai.platon.pulsar.common.config.IndexWriter

 

getParams() - function in ai.platon.pulsar.common.config.IndexingFilter

 

getParams() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

getParams() - function in ai.platon.pulsar.crawl.inject.SeedBuilder

 

getParams() - function in ai.platon.pulsar.common.config.AbstractParseFilter

 

getParams() - function in ai.platon.pulsar.common.config.EmptyParseFilter

 

getParams() - function in ai.platon.pulsar.crawl.parse.LinkFilter

 

getParams() - function in ai.platon.pulsar.common.config.PageParser

 

getParams() - function in ai.platon.pulsar.common.config.ParseFilter

 

getParams() - function in ai.platon.pulsar.common.config.Parser

 

getParams() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser

 

getParams() - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule

 

getParams() - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule

 

getParams() - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule

 

getParams() - function in ai.platon.pulsar.common.config.FetchSchedule

 

getParams() - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule

 

getParams() - function in ai.platon.pulsar.common.config.ScoringFilter

 

getParams() - function in ai.platon.pulsar.crawl.scoring.ScoringFilters

 

getParent() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

The parent filter

getParent() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

The parent filter

getParent() - function in ai.platon.pulsar.crawl.parse.ParseFilter

The parent filter

getParentId() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

 

getParentId() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

 

getParentId() - function in ai.platon.pulsar.crawl.parse.ParseFilter

 

getParse() - function in ai.platon.pulsar.common.options.FetchOptions

 

getParse() - function in ai.platon.pulsar.common.options.LoadOptions

If true, parse the page when it's just be fetched.

getParse() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

Trigger the parse phase or not.

getParse() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getPARSE_PLUGINS_FILE() - function in ai.platon.pulsar.crawl.parse.ParserConfigReader.Companion

The property name of the parse-plugins location

getParseComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getParseComponent() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getParseComponent() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getParseComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The parse component

getParseComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getParseFilters() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

getParseResult() - function in ai.platon.pulsar.crawl.parse.html.ParseContext

 

getParserFactory() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getParsers() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getParsers() - function in ai.platon.pulsar.crawl.parse.ParserConfig

 

getParsers(String) - function in ai.platon.pulsar.crawl.parse.ParserConfig

 

getParsers(String,String) - function in ai.platon.pulsar.crawl.parse.ParserFactory

Function returns an array of Parsers for a given content type.

getPassword() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getPasswordSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getPath() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

The path of the file source

getPath() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

The path of the file source

getPath() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

The path of the file source

getPath(String) - function in ai.platon.pulsar.common.MiscMessageWriter

 

getPendingFetchItems() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status

 

getPendingStart() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getPendingTask(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getPendingTasks() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop.Companion

 

getPermanentContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getPersist() - function in ai.platon.pulsar.common.options.LoadOptions

Persist fetched pages as soon as possible.

getPersistContentMBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPersists() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getPoolId() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getPoolPendingTimeout() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

Once timeout, the pending items should be put to the ready pool again.

getPostfix() - function in ai.platon.pulsar.common.message.Record

 

getPrefix() - function in ai.platon.pulsar.common.message.Record

 

getPREV_PAGE_NEVER_READY() - function in ai.platon.pulsar.crawl.fetch.driver.rpa.DefaultBrowseRPA.Companion

 

getPREV_PAGE_READY() - function in ai.platon.pulsar.crawl.fetch.driver.rpa.DefaultBrowseRPA.Companion

 

getPREV_PAGE_WILL_READY() - function in ai.platon.pulsar.crawl.fetch.driver.rpa.DefaultBrowseRPA.Companion

 

getPrevFetchTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo

The previous actual latest fetch time

getPrevModifiedTime() - function in ai.platon.pulsar.crawl.schedule.ModifyInfo

 

getPriority() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getPriority() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getPriority() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getPriority() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getPriority() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getPriority() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The priority

getPriority() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getPriority() - function in ai.platon.pulsar.crawl.event.VoidHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareFilter

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlFilter

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.HTMLDocumentHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.PrivacyContextHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.PageDatumHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getPriority() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getPriority() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getPriority() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId

 

getPriority() - function in java.lang.IndexThread

 

getPRIORITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getPRIVACY_CONTEXT_IDLE_TIMEOUT_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getPrivacyAgent() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getPrivacyAgent() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getPrivacyContextIdGenerator() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getPrivacyLeakMinorWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getPrivacyLeakWarnings() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getProtocol() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId

 

getProtocol(WebPage) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory

TODO: configurable, using major protocol/sub protocol is a good idea Using major protocol/sub protocol is a good idea, for example: selenium:http://www.baidu.

getProtocol(String) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory

Returns the appropriate Protocol implementation for a url.

getProtocol(FetchMode) - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory

 

getProtocolFactory() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getProtocolFactory() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

getProtocolOutput(WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getProtocolOutput(WebPage) - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

getProtocolOutput(WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

Returns the ProtocolOutput for a fetch list entry.

getProtocolOutput(WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Returns the ProtocolOutput for a fetch list entry.

getProtocolOutputDeferred(WebPage,Continuation) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getProtocolOutputDeferred(WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

Returns the ProtocolOutput for a fetch list entry.

getProtocolOutputDeferred(WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Returns the ProtocolOutput for a fetch list entry.

getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.ProtocolOutput

 

getProtocolStatus() - function in ai.platon.pulsar.crawl.protocol.Response

 

getPROTOTYPE() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion

The prototype privacy agent opens browser with the prototype data dir.

getPROTOTYPE() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion

Represent the prototype browser.

getPROTOTYPE_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getPROTOTYPE_DATA_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getProxies() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getProxyEntry() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getPulsarEnvironment() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getPulsarEnvironment() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getPulsarEnvironment() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getPulsarEnvironment() - function in ai.platon.pulsar.context.support.StaticPulsarContext

 

getQuery(String) - function in ai.platon.pulsar.crawl.common.URLUtil

Returns the path for the url.

getRANDOM() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion

 

getRANDOM() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion

 

getRANDOM_CONTEXT_DIR() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getRawEvent() - function in ai.platon.pulsar.common.options.LoadOptions

 

getRawItemEvent() - function in ai.platon.pulsar.common.options.LoadOptions

 

getReadableState() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getReadonly() - function in ai.platon.pulsar.common.options.LoadOptions

Specify if the load execution is read only or not.

getReadyFetchItems() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler.Status

 

getRealTimeNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getRECENT_TASKS_COUNT_LIMIT() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool.Companion

 

getREF_EXTRACT_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getREF_FETCH_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getREF_INDEX_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getREF_PARSE_ERROR_DENSITY() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getReferer() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getReferrer() - function in ai.platon.pulsar.common.options.LoadOptions

The page referrer.

getReferrer() - function in ai.platon.pulsar.common.urls.NormUrl

 

getReferrer() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getReferrer() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getReferrer() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getReferrer() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getReferrer() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The url of the referrer page

getReferrer() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getReflectedGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory

 

getRefresh() - function in ai.platon.pulsar.common.options.LoadOptions

Refresh the fetch state of a page, clear the retry counters.

getREFRESH() - function in ai.platon.pulsar.crawl.common.FetchState

 

getRefresh() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Sets refresh to the supplied value.

getRefreshCodes() - function in ai.platon.pulsar.crawl.common.FetchState

 

getRefreshHref() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Sets the refreshHref.

getRefreshTime() - function in ai.platon.pulsar.crawl.parse.html.HTMLMetaTags

Sets the refreshTime.

getReg() - function in ai.platon.pulsar.common.metrics.MetricsSystem.Companion

 

getReg() - function in ai.platon.pulsar.common.metrics.AppMetrics.Companion

 

getReGenerate() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getReGenerateSeeds() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getRegexMatchedLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getRegisteredCounters() - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getRemoteAddr() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getRemoteAddr() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getRemoteAddr() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getReparseLinks() - function in ai.platon.pulsar.common.options.LoadOptions

Re-parse links if the page has been parsed before.

getReport() - function in ai.platon.pulsar.common.options.LinkOptions

 

getReport() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getReport() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getReport() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

 

getReport() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

 

getReportDir() - function in ai.platon.pulsar.common.message.MiscMessageWriter

 

getRequireAnchors() - function in ai.platon.pulsar.common.options.LoadOptions

The minimum number of anchors expected in the page, if it is less than that, it will need to be re-fetched.

getRequired() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getRequired() - function in ai.platon.pulsar.crawl.parse.html.OpenMapFields

 

getRequireImages() - function in ai.platon.pulsar.common.options.LoadOptions

The minimum number of images expected in the page, if it is less than that, it will need to be re-fetched.

getRequireNotBlank() - function in ai.platon.pulsar.common.options.LoadOptions

The selector specified element should have a non-blank text, the task should be retried if the element's text content is empty or blank.

getRequireSize() - function in ai.platon.pulsar.common.options.LoadOptions

The minimum page size expected, if it is less than that, it will need to be re-fetched.

getReservedUrl() - function in ai.platon.pulsar.crawl.fetch.batch.IFetchEntry

 

getResponse(String,WebPage,boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getResponse(WebPage,boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getResponse(WebPage,Boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getResponse() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getResponseDeferred(WebPage,boolean,Continuation) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getResponseDeferred(WebPage,Boolean) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getResponses(Collection,VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getResponses(Collection,VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

getResponses(Collection,VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getResponses(Collection,VolatileConfig) - function in ai.platon.pulsar.crawl.protocol.Protocol

 

getRestrictCss() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor

 

getRestrictCss() - function in ai.platon.pulsar.common.options.LinkOptions

 

getResume() - function in ai.platon.pulsar.common.options.FetchOptions

 

getRETRY() - function in ai.platon.pulsar.crawl.common.FetchState

 

getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.Crawler

Delay policy for retry tasks

getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

Delay policy for retry tasks

getRetryDelayPolicy() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

Delay policy for retry tasks

getReversedEndKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getReversedKeyRanges() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getReversedStartKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getRobotRules(WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getRobotRules(WebPage) - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

getRobotRules(WebPage) - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

Retrieve robot rules applicable for this url.

getRobotRules(WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Retrieve robot rules applicable for this url.

getRobotRulesSet(Protocol,URL) - function in ai.platon.pulsar.crawl.protocol.http.HttpRobotRulesParser

Get the rules from robots.

getRobotRulesSet(Protocol,String) - function in ai.platon.pulsar.crawl.protocol.HttpRobotRulesParser

 

getRobotRulesSet(Protocol,String) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser

 

getRobotRulesSet(Protocol,URL) - function in ai.platon.pulsar.crawl.protocol.RobotRulesParser

 

getRound() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getRound() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector.Companion.Counters

 

getRound() - function in ai.platon.pulsar.common.options.FetchOptions

 

getRound() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getRoundCollected() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getRpa() - function in ai.platon.pulsar.crawl.event.impl.DefaultLoadEvent

 

getRpa() - function in ai.platon.pulsar.crawl.event.impl.PerfectTraceBrowseEvent

 

getRpa() - function in ai.platon.pulsar.crawl.event.impl.EmptyBrowseEvent

 

getRunningChromeProcesses() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion

 

getSCHEDULED() - function in ai.platon.pulsar.crawl.common.FetchState

 

getScope() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer

 

getScope() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getSCOPE_CRAWLDB() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_DEFAULT() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

Default scope.

getSCOPE_FETCHER() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_GENERATE_HOST_COUNT() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_INDEXER() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_INJECT() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_LINKDB() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_OUTLINK() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getSCOPE_PARTITION() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer.Companion

 

getScore() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getScoreVector() - function in ai.platon.pulsar.crawl.scoring.io.ScoreVectorWritable

 

getScoringFilters() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getScriptLoader() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

getScriptTimeout() - function in ai.platon.pulsar.common.options.LoadOptions

The maximum time to perform javascript injected into the browser.

getScrollCount() - function in ai.platon.pulsar.common.options.LoadOptions

The number of times the page should be scrolled down after it has just been opened in a browser.

getScrollInterval() - function in ai.platon.pulsar.common.options.LoadOptions

The interval to scroll down.

getSEARCH_PAGE_URL_PATTERN() - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

 

getSearchUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getSeed() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getSeeds() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

The urls of portal pages from where hyper links are extracted from

getSeeds() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

The urls of portal pages from where hyper links are extracted from

getSeeds() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

The urls of portal pages from where hyper links are extracted from

getSeeds() - function in ai.platon.pulsar.common.options.InjectOptions

 

getSelector() - function in ai.platon.pulsar.common.collect.HyperlinkExtractor

 

getSEPERATORS() - function in ai.platon.pulsar.crawl.filter.TextFilter.Companion

 

getSequence() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getSession() - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

getSession() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

The pulsar session to use

getSession() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

The pulsar session to use

getSession() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

The pulsar session to use

getSession() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

getSession() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

getSession() - function in ai.platon.pulsar.session.SessionAware

 

getSessionBean() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getSessionBean() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getSessionBeanFactory() - function in ai.platon.pulsar.session.AbstractPulsarSession

The scoped bean factory: for each volatileConfig object, there is a bean factory

getSessionBeanFactory() - function in ai.platon.pulsar.session.BasicPulsarSession

The scoped bean factory: for each volatileConfig object, there is a bean factory

getSessionBeanFactory() - function in ai.platon.pulsar.session.PulsarSession

The scoped bean factory: for each volatileConfig object, there is a bean factory

getSessionConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession

The session scope volatile config, every setting is supposed to be changed at any time and any place

getSessionConfig() - function in ai.platon.pulsar.session.BasicPulsarSession

The session scope volatile config, every setting is supposed to be changed at any time and any place

getSessionConfig() - function in ai.platon.pulsar.session.PulsarSession

The session scope volatile config, every setting is supposed to be changed at any time and any place

getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

getSessionId() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

getSessions() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

All open sessions

getSessions() - function in ai.platon.pulsar.context.support.BasicPulsarContext

All open sessions

getSessions() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

All open sessions

getSessions() - function in ai.platon.pulsar.context.support.StaticPulsarContext

All open sessions

getSHADOW_METRIC_SYMBOL() - function in ai.platon.pulsar.common.metrics.MetricsSystem.Companion

A shadow metric should not be displayed, nor be stored

getSHADOW_METRIC_SYMBOL() - function in ai.platon.pulsar.common.metrics.AppMetrics.Companion

 

getShouldBreak() - function in ai.platon.pulsar.crawl.parse.FilterResult

 

getShouldBreak() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getShouldContinue() - function in ai.platon.pulsar.crawl.parse.FilterResult

 

getShouldContinue() - function in ai.platon.pulsar.crawl.parse.ParseResult

 

getSignature() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getSize() - function in ai.platon.pulsar.common.collect.LoadingDelayQueue

 

getSize() - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

getSize() - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

getSize() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getSize() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getSize() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getSize() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getSize() - function in ai.platon.pulsar.crawl.event.VoidEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlAwareEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlAwareEventFilter

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlFilterEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebAssetEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebPageEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlAwareWebAssetEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.UrlAwareWebPageEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebAssetHTMLDocumentEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebPageHTMLDocumentEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.PageDatumEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebAssetWebDriverEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebPageWebDriverEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.WebPageJvmWebDriverEventHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getSize() - function in ai.platon.pulsar.crawl.event.impl.CloseMaskLayerHandler

 

getSize() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue

 

getSize() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory

 

getSkipTruncated() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getSlashed() - function in ai.platon.pulsar.common.options.InjectOptions

 

getSlf4jReportInterval() - function in ai.platon.pulsar.common.metrics.MetricsSystem

 

getSlf4jReportInterval() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

getSMALL_CONTENT() - function in ai.platon.pulsar.crawl.common.FetchState

 

getSmallPageRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getSmallPages() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getSource() - function in ai.platon.pulsar.common.EncodingDetector.EncodingClue

 

getSpec() - function in ai.platon.pulsar.common.urls.NormUrl

 

getSpecifiedGlobalCache() - function in ai.platon.pulsar.crawl.common.GlobalCacheFactory

 

getStackTrace() - function in kotlin.ServiceUnavailableException

 

getStackTrace() - function in kotlin.IllegalBusinessPreconditionException

 

getStackTrace() - function in kotlin.IllegalApplicationContextStateException

 

getStackTrace() - function in kotlin.BlockedException

 

getStackTrace() - function in kotlin.HttpException

 

getStackTrace() - function in kotlin.WebDriverException

 

getStackTrace() - function in kotlin.WebDriverCancellationException

 

getStackTrace() - function in kotlin.WebDriverUnavailableException

 

getStackTrace() - function in kotlin.BrowserErrorPageException

 

getStackTrace() - function in kotlin.PrivacyContextException

 

getStackTrace() - function in kotlin.UrlFilterException

 

getStackTrace() - function in kotlin.IndexingException

 

getStackTrace() - function in java.lang.IndexThread

 

getStackTrace() - function in kotlin.ParseException

 

getStackTrace() - function in kotlin.ParserNotFound

 

getStackTrace() - function in kotlin.ProtocolException

 

getStackTrace() - function in kotlin.ProtocolNotFound

 

getStackTrace() - function in kotlin.ScoringFilterException

 

getStartKey() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getStartTime() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getStartTime() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getStartTime() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter

 

getStartTime() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

The start time

getStartTime() - function in ai.platon.pulsar.context.support.BasicPulsarContext

The start time

getStartTime() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

The start time

getStartTime() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The start time

getStartTime() - function in ai.platon.pulsar.crawl.CoreMetrics

The start time of the program process

getStartTime() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getStartTime() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getStartTimes() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getState() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getState() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The driver status.

getState() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The driver status.

getState() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The driver status.

getState() - function in java.lang.IndexThread

 

getStatus() - function in ai.platon.pulsar.common.domain.DomainSuffix

 

getStatus() - function in ai.platon.pulsar.common.domain.TopLevelDomain

 

getStatus() - function in ai.platon.pulsar.common.ReducerContext

 

getStatus(Set,Boolean) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getStatus(Boolean) - function in ai.platon.pulsar.common.metrics.EnumCounterRegistry

 

getStatus() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getStatus() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getStatus() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getStatus() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getStatus() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

If a fetch queue is inactive, the queue does not accept any tasks, nor serve any requests, but still hold pending tasks, waiting to finish

getSTATUS_MODIFIED() - function in ai.platon.pulsar.crawl.schedule.FetchSchedule.Companion

Page is known to have been modified since our last visit.

getSTATUS_NOTMODIFIED() - function in ai.platon.pulsar.crawl.schedule.FetchSchedule.Companion

Page is known to remain unmodified since our last visit.

getSTATUS_UNKNOWN() - function in ai.platon.pulsar.crawl.schedule.FetchSchedule.Companion

It is unknown whether page was changed since our last visit.

getStatusTracker() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getStopped() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

Indicate if the navigation is stopped.

getStoreContent() - function in ai.platon.pulsar.common.options.LoadOptions

If false, do not persist the page content which is usually very large.

getStoreContent() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

Store webpage content or not.

getStoreContent() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getStored() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getStrictDf() - function in ai.platon.pulsar.common.options.FetchOptions

 

getStringValues() - function in ai.platon.pulsar.crawl.index.IndexField

 

getSubmitSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getSuccesses() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getSuccessFetchTasks() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getSuccessFetchTasksPerSecond() - function in ai.platon.pulsar.crawl.CoreMetrics

 

getSuccessRate() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

getSupportedMimeTypes() - function in ai.platon.pulsar.crawl.parse.ParserConfig

 

getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Indicates whether the driver supports javascript.

getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Indicates whether the driver supports javascript.

getSupportJavascript() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Indicates whether the driver supports javascript.

getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

getSupportParallel() - function in ai.platon.pulsar.crawl.protocol.Protocol

 

getSuppressed() - function in kotlin.ServiceUnavailableException

 

getSuppressed() - function in kotlin.IllegalBusinessPreconditionException

 

getSuppressed() - function in kotlin.IllegalApplicationContextStateException

 

getSuppressed() - function in kotlin.BlockedException

 

getSuppressed() - function in kotlin.HttpException

 

getSuppressed() - function in kotlin.WebDriverException

 

getSuppressed() - function in kotlin.WebDriverCancellationException

 

getSuppressed() - function in kotlin.WebDriverUnavailableException

 

getSuppressed() - function in kotlin.BrowserErrorPageException

 

getSuppressed() - function in kotlin.PrivacyContextException

 

getSuppressed() - function in kotlin.UrlFilterException

 

getSuppressed() - function in kotlin.IndexingException

 

getSuppressed() - function in kotlin.ParseException

 

getSuppressed() - function in kotlin.ParserNotFound

 

getSuppressed() - function in kotlin.ProtocolException

 

getSuppressed() - function in kotlin.ProtocolNotFound

 

getSuppressed() - function in kotlin.ScoringFilterException

 

getSymbols() - function in ai.platon.pulsar.crawl.common.FetchState

 

getSYSTEM_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion

 

getSYSTEM_DEFAULT_CONTEXT_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getSystemCpuLoad() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getSystemInfo() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getSystemLoadAverage() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getTask() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

getTaskId() - function in ai.platon.pulsar.common.options.LoadOptions

The task id, it's optional and can be used to distinguish tasks.

getTasks() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextMetrics

 

getTasksMonitor() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

getTaskTime() - function in ai.platon.pulsar.common.options.LoadOptions

The task time, we usually use task time to indicate the name of a task batch.

getTaskTime() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

The default task time.

getTEMP_MOVED() - function in ai.platon.pulsar.crawl.common.FetchState

 

getTemporaryContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

NOTE: we can use a priority queue and every time we need a context, take the top one

getTest() - function in ai.platon.pulsar.common.options.LoadOptions

The test level, 0 to disable, we will talk more in test mode.

getTest() - function in ai.platon.pulsar.common.options.LoadOptionDefaults

Set to be 0 if we are doing unit test or other test.

getText() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getText() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getText() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getText() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The anchor text of this hyperlink

getText() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

The anchor text of this hyperlink

getText() - function in ai.platon.pulsar.crawl.fetch.driver.JsException

 

getTextFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getThreadGroup() - function in java.lang.IndexThread

 

getTiebaUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getTimeout() - function in ai.platon.pulsar.crawl.parse.Parser

 

getTimeout() - function in ai.platon.pulsar.crawl.parse.html.PrimerHtmlParser

Optimized for html content To parse non-html content, the parser might run into an endless loop, run it in a separate coroutine to protect the process

getTimeoutUrls() - function in ai.platon.pulsar.crawl.CoreMetrics

Tracking hosts who are failed to fetch tasks.

getTimePerPage() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getTimeReport() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

getTimeReport() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue

 

getTimers() - function in com.codahale.metrics.AppMetricRegistry

 

getTimers(MetricFilter) - function in com.codahale.metrics.AppMetricRegistry

 

getTopLinks() - function in ai.platon.pulsar.common.options.LoadOptions

Specify how many links to extract for out pages.

getTopN() - function in ai.platon.pulsar.common.options.GenerateOptions

 

getTopNAnchorGroups() - function in ai.platon.pulsar.common.options.LoadOptions

Choose the top N anchor groups for further process.

getTotalMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getTotalMemoryGiB() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getTotalNetworkIFsRecvBytes() - function in ai.platon.pulsar.crawl.CoreMetrics

The total all bytes received by the hardware last read from system

getTotalSuccessBytes() - function in ai.platon.pulsar.crawl.fetch.BatchStat

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getToURL() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

getToURLOrNull() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getTraceInfo() - function in ai.platon.pulsar.crawl.component.ParseComponent

 

getType() - function in ai.platon.pulsar.common.domain.TopLevelDomain

 

getType() - function in ai.platon.pulsar.crawl.index.IndexerMapping.MappingField

 

getUncaughtExceptionHandler() - function in java.lang.IndexThread

 

getUnfilteredLinks() - function in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion.Counters

 

getUNKNOWN() - function in ai.platon.pulsar.crawl.common.FetchState

 

getUnknownUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getUnmodifiedConfig() - function in ai.platon.pulsar.context.PulsarContext

An immutable config loaded from the config file at startup, and never changes

getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getUnmodifiedConfig() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The unmodified config

getUnmodifiedConfig() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

getUnmodifiedConfig() - function in ai.platon.pulsar.session.BasicPulsarSession

 

getUnmodifiedConfig() - function in ai.platon.pulsar.session.PulsarSession

 

getUnparsableTypes() - function in ai.platon.pulsar.crawl.parse.PageParser

 

getUnreachableHosts() - function in ai.platon.pulsar.crawl.CoreMetrics

Tracking unreachable hosts

getUnserializableValue() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation

 

getUpdateComponent() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getUpdateComponent() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getUpdateComponent() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getUpdateComponent() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The update component

getUpdateComponent() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getUrl() - function in ai.platon.pulsar.common.urls.NormUrl

 

getUrl() - function in ai.platon.pulsar.crawl.common.url.ListenableUrl

 

getUrl() - function in ai.platon.pulsar.crawl.common.url.ListenableHyperlink

 

getUrl() - function in ai.platon.pulsar.crawl.common.url.StatefulListenableHyperlink

 

getUrl() - function in ai.platon.pulsar.crawl.common.url.ParsableHyperlink

 

getUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

The url of this hyperlink

getUrl() - function in ai.platon.pulsar.crawl.common.url.CompletableListenableHyperlink

 

getUrl() - function in ai.platon.pulsar.crawl.component.LoadComponent.LazyFieldLoader

 

getUrl() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getUrl() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getUrl() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

getUrl() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

The url to navigate to.

getUrl() - function in ai.platon.pulsar.crawl.fetch.driver.JsException

 

getUrl() - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getUrl() - function in ai.platon.pulsar.crawl.parse.ParserNotFound

 

getUrl() - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse

 

getUrl() - function in ai.platon.pulsar.crawl.protocol.ProtocolNotFound

 

getUrl() - function in ai.platon.pulsar.crawl.protocol.Response

 

getUrlContains() - function in ai.platon.pulsar.common.options.LinkOptions

 

getUrlFeeder() - function in ai.platon.pulsar.crawl.CrawlLoop

 

getUrlFeeder() - function in ai.platon.pulsar.crawl.impl.AbstractCrawlLoop

The fetch iterable from which all fetch tasks are taken

getUrlFeeder() - function in ai.platon.pulsar.crawl.impl.StreamingCrawlLoop

The fetch iterable from which all fetch tasks are taken

getUrlFilter() - function in ai.platon.pulsar.crawl.filter.CrawlFilter

 

getUrlFilters() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getUrlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getUrlFilters() - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters

 

getUrlNormalizer() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

getUrlNormalizer() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

getUrlNormalizer() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

getUrlNormalizers() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getUrlNormalizers() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getUrlNormalizers() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getUrlNormalizers() - function in ai.platon.pulsar.context.support.StaticPulsarContext

Url normalizers

getUrlNormalizers() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getUrlNormalizers() - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer

 

getURLNormalizers(String) - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer

TODO : scoped normalizer not implemented

getUrlNormalizers() - function in ai.platon.pulsar.crawl.filter.CrawlFilters

 

getUrlPattern() - function in ai.platon.pulsar.common.collect.RegexHyperlinkExtractor

 

getUrlPool() - function in ai.platon.pulsar.crawl.common.GlobalCache

A url pool contains many url caches, the urls added to the pool will be processed in crawl loops.

getUrlPostfix() - function in ai.platon.pulsar.common.options.LinkOptions

 

getUrlPrefix() - function in ai.platon.pulsar.common.options.LinkOptions

 

getUrlRegex() - function in ai.platon.pulsar.common.options.LinkOptions

 

getUrls() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getUrls() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

The url sequence

getUrlsFromSeed() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getUrlStatistics() - function in ai.platon.pulsar.crawl.CoreMetrics

Tracking statistics for each host

getUrlsTooLong() - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

getUrlString() - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

getUsedMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion

 

getUsedMemory() - function in ai.platon.pulsar.crawl.CoreMetrics.Companion

 

getUSER_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent.Companion

The user default privacy agent opens browser just like real users do every day.

getUSER_DEFAULT() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId.Companion

Represent the real user's default browser.

getUSER_DEFAULT_CONTEXT_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getUSER_DEFAULT_DATA_DIR_PLACEHOLDER() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

 

getUserAgent() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

The user agent to override, do not override if it's null.

getUserAgent() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

The user agent to override, do not override if it's null.

getUserDataDir() - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

getUsername() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getUsernameSelector() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getUuid() - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

getValue() - function in ai.platon.pulsar.common.EncodingDetector.EncodingClue

 

getValue() - function in ai.platon.pulsar.common.message.Record

 

getValue() - function in ai.platon.pulsar.crawl.fetch.driver.JsEvaluation

 

getValues() - function in ai.platon.pulsar.common.ReducerContext

 

getValues() - function in ai.platon.pulsar.crawl.index.IndexField

 

getVariable(String) - function in ai.platon.pulsar.session.AbstractPulsarSession

Get a variable from this session

getVariable(String) - function in ai.platon.pulsar.session.BasicPulsarSession

Get a variable from this session

getVariable(String) - function in ai.platon.pulsar.session.PulsarSession

Get a variable from this session

getVerbose() - function in ai.platon.pulsar.common.options.FetchOptions

 

getVerbose() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

getVersion() - function in ai.platon.pulsar.common.options.LoadOptions

The load option version.

getVERSION() - function in ai.platon.pulsar.crawl.index.io.IndexDocumentWritable.Companion

 

getVolatileConfig() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

The timeout to wait for some object.

getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

The timeout to wait for some object.

getWaitForElementTimeout() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

The timeout to wait for some object.

getWaitNonBlank() - function in ai.platon.pulsar.common.options.LoadOptions

The selector specified element should have a non-blank text, the system should wait until the element is filled by a non-blank text, or until it times out.

getWarnUpUrl() - function in ai.platon.pulsar.crawl.event.impl.LoginHandler

 

getWEB_GRAPH_SCORE() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getWebDb() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

 

getWebDb() - function in ai.platon.pulsar.context.support.BasicPulsarContext

 

getWebDb() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

 

getWebDb() - function in ai.platon.pulsar.context.support.StaticPulsarContext

The web db

getWebDb() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

getWebDb() - function in ai.platon.pulsar.crawl.component.GenerateComponent

 

getWebDb() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

getWebDb() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

getWebDb() - function in ai.platon.pulsar.crawl.component.UpdateComponent

 

getWeight() - function in ai.platon.pulsar.crawl.index.IndexDocument

 

getWeight() - function in ai.platon.pulsar.crawl.index.IndexField

 

getWidth() - function in ai.platon.pulsar.common.message.Record

 

getWithSymbolicLink() - function in ai.platon.pulsar.common.message.LoadedPagesStatusFormatter

 

getWriters() - function in ai.platon.pulsar.common.message.MiscMessageWriter

 

getZERO() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

getZkHostString() - function in ai.platon.pulsar.common.options.FetchOptions

 

getZombieContexts() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

getZoneId() - function in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

GlobalCache - class in ai.platon.pulsar.crawl.common

The global cache

GlobalCacheFactory - class in ai.platon.pulsar.crawl.common

The global cache factory.

GOOD - enum entry in ai.platon.pulsar.common.options.Condition

 

guessEncoding(WebPage,String) - function in ai.platon.pulsar.common.EncodingDetector

Guess the encoding with the previously specified list of clues.

guessPageCategory(String) - function in ai.platon.pulsar.crawl.filter.CrawlFilter.Companion

A simple regex rule to sniff the possible category of a web page

A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _