A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W 

R

randomDelayMillis(java.lang.String,kotlin.ranges.IntRange) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

Generate a random delay in milliseconds for an action.

RandomPrivacyAgentGenerator - class in ai.platon.pulsar.skeleton.crawl.fetch.privacy

The random browser profile generator.

readAllLines(java.lang.String) - function in ai.platon.pulsar.common.MultiSinkMessageWriter

 

readSourceFileFromResource(java.lang.String,java.lang.String) - function in ai.platon.pulsar.skeleton.common.llm.LLMUtils

Reads the content of a source file as a resource string.

READY - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask.State

 

READY - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver.State

Ready to accept a task. No navigation or interaction is currently in progress.

recoverUnmanagedPages() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractBrowser

 

referrer() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

The referrer property returns the URI of the page that linked to this page.

referrer() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

The referrer property returns the URI of the page that linked to this page.

refresh(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateEntry

Refresh the entry with the given action.

register(java.lang.Class,java.lang.String,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.Object,java.lang.String,T) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.Object,java.lang.String,java.lang.String,T) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(kotlin.reflect.KClass,java.lang.String,java.lang.Boolean) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

register(java.lang.String,T) - function in com.codahale.metrics.MetricRegistry

 

registerAll(java.lang.Object,java.lang.String,java.util.Map) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

registerAll(java.lang.Object,java.util.Map) - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

registerAll(com.codahale.metrics.MetricSet) - function in com.codahale.metrics.MetricRegistry

 

registerAll(java.lang.String,com.codahale.metrics.MetricSet) - function in com.codahale.metrics.MetricRegistry

 

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.PulsarContext

Register closable objects, the objects will be closed when the context closes.

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.PulsarContexts

Registers a closable object with the active context.

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register close objects, the objects will be closed when the context closes

registerClosable(java.lang.AutoCloseable,java.lang.Integer) - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register close objects, the objects will be closed when the context closes

registerClosable(java.lang.AutoCloseable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession

Register a closable object to the session.

registerClosable(java.lang.AutoCloseable) - function in ai.platon.pulsar.skeleton.session.AbstractPulsarSession

Register a closable object to the session.

registerClosable(java.lang.AutoCloseable) - function in ai.platon.pulsar.skeleton.session.PulsarSession

Register a closable object to the session.

registerGauge(java.lang.String,com.codahale.metrics.Gauge) - function in com.codahale.metrics.MetricRegistry

 

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.PulsarContext

Register shutdown hook

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register a shutdown hook with the JVM runtime, closing this context on JVM shutdown unless it has already been closed at that time.

registerShutdownHook() - function in ai.platon.pulsar.skeleton.context.support.AbstractPulsarContext

Register a shutdown hook with the JVM runtime, closing this context on JVM shutdown unless it has already been closed at that time.

reload() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

Reloads the current page.

reload() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

Reloads the current page.

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction0

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction1

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedFunction2

 

remove(java.lang.Object) - function in ai.platon.pulsar.common.lang.AbstractChainedPDFunction2

 

remove(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.FetchingCache

 

remove(ai.platon.pulsar.skeleton.crawl.parse.ParseFilter) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(kotlin.reflect.KClass) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

remove(java.lang.String) - function in com.codahale.metrics.MetricRegistry

 

removeAll(java.lang.Iterable) - function in ai.platon.pulsar.skeleton.crawl.common.FetchingCache

 

removeAll(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateHistory

 

removeAll(kotlin.text.Regex) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.NavigateHistory

 

removeListener(com.codahale.metrics.MetricRegistryListener) - function in com.codahale.metrics.MetricRegistry

 

removeMatching(com.codahale.metrics.MetricFilter) - function in com.codahale.metrics.MetricRegistry

 

removePDCache(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache

Remove items specified by the url from page cache and document cache.

report() - function in ai.platon.pulsar.skeleton.common.AppSystemInfo.Companion

 

report(java.util.SortedMap,java.util.SortedMap,java.util.SortedMap,java.util.SortedMap,java.util.SortedMap) - function in ai.platon.pulsar.skeleton.common.metrics.CodahaleSlf4jReporter

 

report() - function in ai.platon.pulsar.skeleton.crawl.TaskRunner

 

report() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext

 

report() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractTaskRunner

 

report() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingTaskRunner

 

report(java.lang.StringBuilder) - function in ai.platon.pulsar.skeleton.crawl.parse.ParseFilters

 

report() - function in com.codahale.metrics.ScheduledReporter

 

reset() - function in ai.platon.pulsar.skeleton.common.metrics.MultiMetric

Reset the counters

reset() - function in ai.platon.pulsar.skeleton.common.options.LoadOptionDefaults

Reset all the options to default.

reset() - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchTask

 

reset() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.BrowserFetcher

 

reset(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyManager

Resets the privacy environment by closing all privacy contexts.

reset(java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyManager

Resets the privacy environment by closing all privacy contexts.

reset() - function in ai.platon.pulsar.skeleton.crawl.protocol.Protocol

Reset the protocol environment, so the peer host view the client as a new one

reset() - function in ai.platon.pulsar.skeleton.crawl.protocol.http.AbstractHttpProtocol

Reset the protocol environment, so the peer host view the client as a new one

resetCaches() - function in ai.platon.pulsar.skeleton.crawl.common.GlobalCache

Reset all caches.

resetDailyCounters() - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

resetGlobalState() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingTaskRunner.Companion

Reset the global state to the initial state.

resetHourlyCounters() - function in ai.platon.pulsar.skeleton.common.metrics.AppMetricRegistry

 

resize(java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

Resizes the viewport to the specified width and height.

resize(java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.WebDriver

Resizes the viewport to the specified width and height.

resolveMimeType(java.lang.String,java.lang.String,kotlin.ByteArray) - function in ai.platon.pulsar.skeleton.crawl.common.MimeTypeResolver

 

Response - class in ai.platon.pulsar.skeleton.crawl.protocol

A response interface.

restart() - function in ai.platon.pulsar.common.StartStopRunnable

 

restart() - function in ai.platon.pulsar.common.TaskLoop

 

resultNow() - function in java.util.concurrent.CompletableFuture

 

resultNow() - function in java.util.concurrent.CompletableFuture

 

resume() - function in ai.platon.pulsar.skeleton.crawl.TaskRunner

 

resume() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractTaskRunner

 

resume() - function in ai.platon.pulsar.skeleton.crawl.impl.AbstractTaskRunner

 

retire() - function in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver

Mark for disposal after current task.

RETIRED - enum entry in ai.platon.pulsar.skeleton.crawl.fetch.driver.AbstractWebDriver.State

Marked for disposal. Should not receive new tasks. Will be closed ASAP.

retry(ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult

 

retry(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.fetch.FetchResult.Companion

 

retry(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.persist.RetryScope,java.lang.Exception) - function in ai.platon.pulsar.skeleton.crawl.protocol.ForwardingResponse.Companion

Returns response that indicates that the page should be retried.

retry(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.persist.RetryScope,java.lang.String) - function in ai.platon.pulsar.skeleton.crawl.protocol.ForwardingResponse.Companion

Returns response that indicates that the page should be retried.

RobotRules - class in ai.platon.pulsar.skeleton.crawl.protocol

This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules.

RobotRulesParser - class in ai.platon.pulsar.skeleton.crawl.protocol

This class uses crawler-commons for handling the parsing of robots.txt files.

RobotRulesParser.Companion - class in ai.platon.pulsar.skeleton.crawl.protocol.RobotRulesParser

 

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyContext

Run a task in the privacy context, with the specified fetch function.

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.AbstractPrivacyManager

Runs a fetch task within a privacy context.

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyContext

Run a task in the privacy context.

run() - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyContextMonitor

 

run(ai.platon.pulsar.skeleton.crawl.fetch.FetchTask,kotlin.coroutines.SuspendFunction2) - function in ai.platon.pulsar.skeleton.crawl.fetch.privacy.PrivacyManager

Runs a fetch task within a privacy context.

run() - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingTaskRunner

Run the crawler.

run(kotlinx.coroutines.CoroutineScope) - function in ai.platon.pulsar.skeleton.crawl.impl.StreamingTaskRunner

Run the crawler in the given coroutine scope.

runAfterBoth(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterBothAsync(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterBothAsync(java.util.concurrent.CompletionStage,java.lang.Runnable,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

runAfterEither(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterEitherAsync(java.util.concurrent.CompletionStage,java.lang.Runnable) - function in java.util.concurrent.CompletableFuture

 

runAfterEitherAsync(java.util.concurrent.CompletionStage,java.lang.Runnable,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W