A  B  C  D  E  F  G  H  I  J  L  M  N  O  P  Q  R  S  T  U  V  W  _ 

R

randomDelayMillis(java.lang.String,kotlin.ranges.IntRange) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

Generate a random delay in milliseconds.

RandomPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy

The random privacy agent generator.

readAllLines(java.lang.String) - function in ai.platon.pulsar.common.MultiSinkWriter

 

readFields(java.io.DataInput) - function in ai.platon.pulsar.skeleton.crawl.index.IndexField

 

readFields(java.io.DataInput) - function in ai.platon.pulsar.skeleton.crawl.index.io.IndexDocumentWritable

 

readFields(java.io.DataInput) - function in ai.platon.pulsar.skeleton.crawl.scoring.io.ScoreVectorWritable

 

READY - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask.State

 

READY - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver.State

The driver is ready to work.

recoverUnmanagedPages() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractBrowser

 

referrer() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

The referrer property returns the URI of the page that linked to this page.

referrer() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

The referrer property returns the URI of the page that linked to this page.

referrer() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

The referrer property returns the URI of the page that linked to this page.

refExtractErrDensity - enum entry in ai.platon.pulsar.skeleton.crawl.scoring.Name

 

refFetchErrDensity - enum entry in ai.platon.pulsar.skeleton.crawl.scoring.Name

 

refIndexErrDensity - enum entry in ai.platon.pulsar.skeleton.crawl.scoring.Name

 

refParseErrDensity - enum entry in ai.platon.pulsar.skeleton.crawl.scoring.Name

 

refresh(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry

Refresh the entry with the given action.

RegexHyperlinkExtractor - class in ai.platon.pulsar.skeleton.common.collect

 

register(java.lang.Class,java.lang.String,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.Object,java.lang.String,T) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.Object,java.lang.String,java.lang.String,T) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(kotlin.reflect.KClass,java.lang.String,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.String,T) - function in com.codahale.metrics.MetricRegistry

 

registerAll(java.lang.Object,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

registerAll(java.lang.Object,java.util.Map) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

registerAll(com.codahale.metrics.MetricSet) - function in com.codahale.metrics.MetricRegistry

 

registerAll(java.lang.String,com.codahale.metrics.MetricSet) - function in com.codahale.metrics.MetricRegistry

 

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.PulsarContext

Register closable objects, the objects will be closed when the context closes.

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.PulsarContexts

Register a closable object to the active context.

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register close objects, the objects will be closed when the context closes

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register close objects, the objects will be closed when the context closes

registerClosable(java.lang.AutoCloseable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession

 

registerClosable(java.lang.AutoCloseable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession

 

registerGauge(java.lang.String,com.codahale.metrics.Gauge) - function in com.codahale.metrics.MetricRegistry

 

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.PulsarContext

Register shutdown hook

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register a shutdown hook with the JVM runtime, closing this context on JVM shutdown unless it has already been closed at that time.

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register a shutdown hook with the JVM runtime, closing this context on JVM shutdown unless it has already been closed at that time.

REJECTED - enum entry in ai.platon.pulsar.skeleton.common.domain.DomainSuffix.Status

 

reload(ai.platon.pulsar.common.config.ImmutableConfig) - function in ai.platon.pulsar.skeleton.common.MimeTypeResolver

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction0

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction1

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction2

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedPDFunction2

 

remove(ai.platon.pulsar.common.urls.FatLink) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector

 

remove(ai.platon.pulsar.common.urls.FatLink) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector

 

remove(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector

 

remove(java.lang.String) - function in ai.platon.pulsar.skeleton.common.collect.HyperlinkCollector

 

remove(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.FetchingCache

 

remove(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(kotlin.reflect.KClass) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(java.lang.String) - function in com.codahale.metrics.MetricRegistry

 

remove(java.util.concurrent.Delayed) - function in java.util.AbstractCollection

 

remove() - function in java.util.AbstractQueue

 

removeAll(java.lang.Iterable) - function in ai.platon.pulsar.common.collect.CrawlableFatLinkCollector

 

removeAll(java.util.List) - function in ai.platon.pulsar.common.collect.CrawlableFatLinkCollector

 

removeAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.crawl.common.FetchingCache

 

removeAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateHistory

 

removeAll(kotlin.text.Regex) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateHistory

 

removeAll(java.util.Collection) - function in java.util.AbstractCollection

 

removeField(java.lang.CharSequence) - function in ai.platon.pulsar.skeleton.crawl.index.IndexDocument

 

removeIf(java.util.function.Predicate) - function in kotlin.collections.MutableCollection

 

removeListener(com.codahale.metrics.MetricRegistryListener) - function in com.codahale.metrics.MetricRegistry

 

removeMatching(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry

 

removePDCache(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache

Remove items specified by the url from page cache and document cache.

report() - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion

 

report(java.util.SortedMap,java.util.SortedMap,java.util.SortedMap,java.util.SortedMap,java.util.SortedMap) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter

 

report() - function in ai.platon.pulsar.skeleton.crawl.Crawler

 

report() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext

 

report() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler

 

report() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler

 

report(kotlin.text.StringBuilder) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

report() - function in com.codahale.metrics.ScheduledReporter

 

reportBadModifiedTime(java.lang.String) - function in ai.platon.pulsar.skeleton.common.message.MiscMessageWriter

 

reportFetchSchedule(ai.platon.pulsar.persist.WebPage,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.message.MiscMessageWriter

 

reportKeys() - function in ai.platon.pulsar.skeleton.crawl.index.IndexerMapping

 

reset() - function in ai.platon.pulsar.skeleton.common.metrics.MultiMetric

Reset the counters

reset() - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults

Reset all the options to default.

reset() - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask

 

reset(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyManager

Resets the privacy environment by closing all privacy contexts.

reset(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyManager

Resets the privacy environment by closing all privacy contexts.

reset() - function in ai.platon.pulsar.skeleton.crawl.index.IndexField

 

reset() - function in ai.platon.pulsar.skeleton.crawl.parse.html.HTMLMetaTags

Sets all boolean values to false.

reset() - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol

Reset the protocol environment, so the peer host view the client as a new one

reset() - function in ai.platon.pulsar.skeleton.crawl.protocol.http.AbstractHttpProtocol

Reset the protocol environment, so the peer host view the client as a new one

resetCaches() - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache

Reset all caches.

resetDailyCounters() - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

resetGlobalState() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler.Companion

Reset the global state to the initial state.

resetHourlyCounters() - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

resolveEncodingAlias(java.lang.String) - function in ai.platon.pulsar.skeleton.common.EncodingDetector

 

Response - class in ai.platon.pulsar.skeleton.crawl.protocol

A response interface.

restart() - function in ai.platon.pulsar.common.CrawlLoop

 

restart() - function in ai.platon.pulsar.common.StartStopRunnable

 

resultNow() - function in java.util.concurrent.CompletableFuture

 

resultNow() - function in java.util.concurrent.CompletableFuture

 

resume() - function in ai.platon.pulsar.skeleton.crawl.Crawler

 

resume() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler

 

resume() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawler

 

retainAll(java.util.Collection) - function in java.util.AbstractCollection

 

retire() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

Mark the driver as retired, so it can not be used to fetch any page, and should be quit as soon as possible.

RETIRED - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver.State

The driver is retired and should be quit as soon as possible.

retry(ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult

 

retry(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult.Companion

 

retry(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.persist.RetryScope,kotlin.Exception) - function in ai.platon.pulsar.skeleton.crawl.protocol.ForwardingResponse.Companion

Returns response that indicates that the page should be retried.

retry(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.protocol.ForwardingResponse.Companion

Returns response that indicates that the page should be retried.

reversed() - function in java.util.Comparator

 

reverseOrder() - function in java.util.Comparator

 

RobotRules - class in ai.platon.pulsar.skeleton.crawl.protocol

This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules.

RobotRulesParser - class in ai.platon.pulsar.skeleton.crawl.protocol

This class uses crawler-commons for handling the parsing of robots.txt files.

RobotRulesParser.Companion - class in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser

 

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext

Run a task in the privacy context, with the specified fetch function.

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyManager

Runs a fetch task within a privacy context.

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyContext

Run a task in the privacy context.

run() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyContextMonitor

 

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyManager

Runs a fetch task within a privacy context.

run() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler

Run the crawler.

run(kotlinx.coroutines.CoroutineScope) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingCrawler

Run the crawler in the given coroutine scope.

runAfterBoth(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterBothAsync(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterBothAsync(java.util.concurrent.CompletionStage,java.lang.Runnable,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

runAfterEither(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterEitherAsync(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterEitherAsync(java.util.concurrent.CompletionStage,java.lang.Runnable,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

A  B  C  D  E  F  G  H  I  J  L  M  N  O  P  Q  R  S  T  U  V  W  _