A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _ 

C

calculate(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.signature.MD5Signature

 

calculate(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.signature.Signature

 

calculate(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.signature.TextMD5Signature

We need calculate signature using a more clean signature content, eg, extracted by signature-persist

calculate(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.signature.TextProfileSignature

 

cancel() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel the page

cancel(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel the page

cancel(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel the page

cancel(java.lang.Boolean) - function in java.util.concurrent.CompletableFuture

 

cancelAll() - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel all fetching tasks

cancelAll() - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel all fetching tasks

cancelAll() - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel all fetching tasks

canceled() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

canceled(ai.platon.pulsar.crawl.fetch.FetchTask) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

canceled(ai.platon.pulsar.crawl.fetch.FetchTask,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

CANCELED - enum entry in ai.platon.pulsar.crawl.fetch.FetchTask.State

 

CANCELED - enum entry in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

canceled(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

canceled(ai.platon.pulsar.persist.WebPage,java.lang.String) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

captureScreenshot(ai.platon.pulsar.common.geometric.RectD) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

captureScreenshot(ai.platon.pulsar.common.geometric.RectD) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

captureScreenshot(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshot(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(ai.platon.pulsar.common.geometric.RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

captureScreenshotAsync(ai.platon.pulsar.common.geometric.RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

captureScreenshotAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(ai.platon.pulsar.common.geometric.RectD) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

captureScreenshotAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

chain(ai.platon.pulsar.crawl.BrowseEvent) - function in ai.platon.pulsar.crawl.BrowseEvent

 

chain(ai.platon.pulsar.crawl.CrawlEvent) - function in ai.platon.pulsar.crawl.CrawlEvent

 

chain(ai.platon.pulsar.crawl.LoadEvent) - function in ai.platon.pulsar.crawl.LoadEvent

 

chain(ai.platon.pulsar.crawl.PageEvent) - function in ai.platon.pulsar.crawl.PageEvent

Chain the other page event handler to the tail of this one.

chain(ai.platon.pulsar.crawl.BrowseEvent) - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

chain(ai.platon.pulsar.crawl.BrowseEvent) - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

chain(ai.platon.pulsar.crawl.CrawlEvent) - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

chain(ai.platon.pulsar.crawl.CrawlEvent) - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

chain(ai.platon.pulsar.crawl.LoadEvent) - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

chain(ai.platon.pulsar.crawl.LoadEvent) - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

chain(ai.platon.pulsar.crawl.PageEvent) - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

Chain the other page event handler to the tail of this one.

chain(ai.platon.pulsar.crawl.PageEvent) - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

Chain the other page event handler to the tail of this one.

ChainedUrlNormalizer - class in ai.platon.pulsar.crawl.filter

This class uses a "chained filter" pattern to run defined normalizers.

check(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

check(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

check(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

checkAccess() - function in java.lang.Thread

 

checkAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

checkAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

checkAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

chooseRepr(java.lang.String,java.lang.String,java.lang.Boolean) - function in ai.platon.pulsar.crawl.common.URLUtil

Given two urls, a src and a destination of a redirect, it returns the representative url.

CircularHyperlinkCollector - class in ai.platon.pulsar.common.collect

 

CircularLocalFileHyperlinkCollector - class in ai.platon.pulsar.common.collect

 

ClassPathXmlPulsarContext - class in ai.platon.pulsar.context.support

 

cleanMimeType(java.lang.String) - function in ai.platon.pulsar.common.MimeTypeResolver

Cleans a MimeType name by removing out the actual MimeType, from a string of the form:

     <primary type>/<sub type> ; < optional params

clear() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector

 

clear() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction0

 

clear() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction1

 

clear() - function in ai.platon.pulsar.common.lang.AbstractChainedFunction2

 

clear() - function in ai.platon.pulsar.common.lang.AbstractChainedPDFunction2

 

clear() - function in ai.platon.pulsar.crawl.common.FetchingCache

 

clear() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

clear() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue

 

clear() - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory

 

clear() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

clear() - function in java.util.AbstractQueue

 

clearBrowserCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Clears browser cookies.

clearBrowserCookies() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Clears browser cookies.

clearCaches() - function in ai.platon.pulsar.crawl.common.GlobalCache

Clear all caches.

clearClues() - function in ai.platon.pulsar.common.EncodingDetector

Clears all clues.

clearCookies() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

Clear all cookies.

clearCookies() - function in ai.platon.pulsar.crawl.fetch.driver.Browser

Clear all cookies.

clearPDCaches() - function in ai.platon.pulsar.crawl.common.GlobalCache

Clear page cache and document cache.

clearPendingQueue() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearPendingTasksIfFew(java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearReadyQueue() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

click(java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

click(java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickablePoint(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Calculate the clickable point of an element located by selector.

clickablePoint(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

Calculate the clickable point of an element located by selector.

clickAsync(java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickAsync(java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickAsync(java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatches(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatches(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Use clickTextMatches instead

clickMatches(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Use clickTextMatches instead

clickMatches(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickMatches(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatchesAsync(java.lang.String,java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickNthAnchor(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickNthAnchor(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickNthAnchor(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickNthAnchorAsync(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickNthAnchorAsync(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickNthAnchorAsync(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickTextMatches(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickTextMatches(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickTextMatches(java.lang.String,java.lang.String,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clone() - function in ai.platon.pulsar.common.ScoreVector

 

clone() - function in ai.platon.pulsar.common.options.LoadOptions

Create a new LoadOptions object with the same arguments string and event handlers.

clone() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

clone() - function in ai.platon.pulsar.crawl.index.IndexField

 

close() - function in ai.platon.pulsar.common.concurrent.GracefulScheduledExecutor

 

close() - function in ai.platon.pulsar.common.message.MiscMessageWriter

 

close() - function in ai.platon.pulsar.common.metrics.MetricsSystem

Close the metrics system.

close() - function in ai.platon.pulsar.common.metrics.MetricsSystem

Close the metrics system.

close() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.crawl.CoreMetrics

 

close() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

close() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

close() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

close() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

close() - function in ai.platon.pulsar.crawl.component.WebDbComponent

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

close() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

close() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Close the privacy manager.

close(ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Close a given privacy context, remove it from the active list and add it to the zombie list.

close() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

close() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

Quit and close the crawl loop.

close() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

close() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

close() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

close() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.PageParser

 

close() - function in ai.platon.pulsar.crawl.parse.ParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

close() - function in ai.platon.pulsar.crawl.protocol.Protocol

 

close() - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory

 

close() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

close() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

close() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

close() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

close() - function in com.codahale.metrics.ScheduledReporter

 

close() - function in java.io.Closeable

 

close() - function in java.io.WebDriver

 

close() - function in java.lang.AutoCloseable

 

close() - function in java.lang.AutoCloseable

 

close() - function in java.lang.Browser

 

close() - function in java.lang.Crawler

 

close() - function in java.lang.PulsarContext

 

close() - function in java.lang.PulsarSession

 

CloseMaskLayerHandler - class in ai.platon.pulsar.crawl.event.impl

 

closeSession(ai.platon.pulsar.session.PulsarSession) - function in ai.platon.pulsar.context.PulsarContext

Close a pulsar session

closeSession(ai.platon.pulsar.session.PulsarSession) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close the given session

closeSession(ai.platon.pulsar.session.PulsarSession) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close the given session

CloseStrategy - class in ai.platon.pulsar.crawl.fetch.privacy

 

closeWriter(java.lang.String) - function in ai.platon.pulsar.common.MultiSinkWriter

 

CodahaleSlf4jReporter - class in ai.platon.pulsar.common.metrics

A reporter class for logging metrics values to a SLF4J Logger periodically, similar to ConsoleReporter or CsvReporter, but using the SLF4J framework instead.

CodahaleSlf4jReporter.Builder - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

A builder for Slf4jReporter instances.

CodahaleSlf4jReporter.Companion - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

 

CodahaleSlf4jReporter.LoggingLevel - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

 

collectLinks(java.net.URL,java.util.Set,org.w3c.dom.Node,ai.platon.pulsar.crawl.filter.CrawlFilters) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

collectLinks(java.net.URL,org.w3c.dom.Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

This method finds all anchors below the supplied DOM root, and creates appropriate HyperlinkPersistable records for each (relative to the supplied base URL), and adds them to the outlinks ArrayList.

collectLinks(java.net.URL,org.w3c.dom.Node,ai.platon.pulsar.crawl.filter.CrawlFilters) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

collectTo(java.util.List) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

collectTo(ai.platon.pulsar.common.urls.UrlAware,java.util.List) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector

 

collectTo(java.lang.Integer,ai.platon.pulsar.common.urls.UrlAware,java.util.List) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector

 

collectTo(java.lang.Integer,java.util.List) - function in ai.platon.pulsar.common.collect.collector.AbstractDataCollector

 

CombinedUrlNormalizer - class in ai.platon.pulsar.common.urls

 

commit() - function in ai.platon.pulsar.crawl.common.WeakPageIndexer

 

commit() - function in ai.platon.pulsar.crawl.component.IndexComponent

 

commit() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

commit() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

commit() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

CommonCounter - class in ai.platon.pulsar.common.metrics

Created by vincent on 17-4-5.

CommonCounter.Companion - class in ai.platon.pulsar.common.metrics.CommonCounter

 

CommonOptions - class in ai.platon.pulsar.common.options

Created by vincent on 17-4-12.

compare(kotlin.Array,kotlin.Array) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compare(Object,Object) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compare(java.nio.ByteBuffer,java.nio.ByteBuffer) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compareTo(ai.platon.pulsar.common.ScoreVector) - function in ai.platon.pulsar.common.ScoreVector

 

compareTo(ai.platon.pulsar.common.collect.collector.PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.PriorityDataCollector

 

compareTo(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.common.urls.AbstractUrl

 

compareTo(ai.platon.pulsar.common.urls.NormUrl) - function in ai.platon.pulsar.common.urls.NormUrl

 

compareTo(ai.platon.pulsar.common.urls.UrlAware) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

compareTo(ai.platon.pulsar.crawl.fetch.FetchTask) - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

compareTo(ai.platon.pulsar.crawl.fetch.UrlStat) - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.FeedLoop) - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.FetchLoop) - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.TaskPool) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

compareTo(ai.platon.pulsar.crawl.fetch.batch.data.PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId

 

compareTo(ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

compareTo(ai.platon.pulsar.crawl.fetch.driver.NavigateEntry) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

compareTo(ai.platon.pulsar.crawl.fetch.privacy.BrowserId) - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

compareTo(ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

compareTo(ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgentId

 

compareTo(ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext

 

compareTo(ai.platon.pulsar.crawl.index.jit.indexer.IndexThread) - function in ai.platon.pulsar.crawl.index.jit.indexer.IndexThread

 

compareTo(ai.platon.pulsar.common.urls.UrlAware) - function in kotlin.Comparable

 

comparing(java.util.function.Function,java.util.Comparator) - function in java.util.Comparator

 

comparingDouble(java.util.function.ToDoubleFunction) - function in java.util.Comparator

 

comparingInt(java.util.function.ToIntFunction) - function in java.util.Comparator

 

comparingLong(java.util.function.ToLongFunction) - function in java.util.Comparator

 

CompletableHyperlink - class in ai.platon.pulsar.crawl.common.url

 

CompletableListenableHyperlink - class in ai.platon.pulsar.crawl.common.url

 

complete(T) - function in java.util.concurrent.CompletableFuture

 

complete(T) - function in java.util.concurrent.CompletableFuture

 

completeAsync(java.util.function.Supplier) - function in java.util.concurrent.CompletableFuture

 

completeAsync(java.util.function.Supplier) - function in java.util.concurrent.CompletableFuture

 

completeAsync(java.util.function.Supplier,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

completeAsync(java.util.function.Supplier,java.util.concurrent.Executor) - function in java.util.concurrent.CompletableFuture

 

completeExceptionally(java.lang.Throwable) - function in java.util.concurrent.CompletableFuture

 

completeOnTimeout(T,java.lang.Long,java.util.concurrent.TimeUnit) - function in java.util.concurrent.CompletableFuture

 

completeOnTimeout(T,java.lang.Long,java.util.concurrent.TimeUnit) - function in java.util.concurrent.CompletableFuture

 

component1() - function in ai.platon.pulsar.common.urls.NormUrl

 

component1() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

component2() - function in ai.platon.pulsar.common.urls.NormUrl

 

component2() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

component3() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

compose(java.util.function.Function) - function in java.util.function.Function

 

computeIfAbsent(ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextId) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a context with privacyAgent and add it to active context list if not absent

computeIfNecessary(ai.platon.pulsar.common.browser.Fingerprint) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an existing one

computeIfNecessary(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.browser.Fingerprint,ai.platon.pulsar.crawl.fetch.FetchTask) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an existing one

computeNextContext(ai.platon.pulsar.common.browser.Fingerprint) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an existing one.

computeNextContext(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.browser.Fingerprint,ai.platon.pulsar.crawl.fetch.FetchTask) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an existing one.

computeNextSequentialContextDir() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContext.Companion

TODO: use a file lock

Condition - class in ai.platon.pulsar.common.options

 

Condition.Companion - class in ai.platon.pulsar.common.options.Condition

 

ConditionConverter - class in ai.platon.pulsar.common.options

 

consume(ai.platon.pulsar.crawl.fetch.batch.data.PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

consume() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

Ask a task from this queue.

consume() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

Thread safe

contains(java.lang.String) - function in ai.platon.pulsar.common.metrics.MetricFilters

 

contains(java.lang.String) - function in ai.platon.pulsar.crawl.common.FetchingCache

 

contains(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory

 

contains(kotlin.text.Regex) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory

 

contains(ai.platon.pulsar.crawl.fetch.batch.TaskPool) - function in java.util.AbstractCollection

 

contains(java.util.concurrent.Delayed) - function in java.util.AbstractCollection

 

containsAll(java.util.Collection) - function in java.util.AbstractCollection

 

containsAll(java.util.Collection) - function in java.util.AbstractCollection

 

contentScore - enum entry in ai.platon.pulsar.crawl.scoring.Name

 

ContextAware - class in ai.platon.pulsar.context

 

ContextDefaults - class in ai.platon.pulsar.context.support

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.BrowserTypeConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.ConditionConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.DimensionConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.DurationConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.FetchModeConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.InstantConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.IntRangeConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.ItemExtractorConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.PairConverter

 

convert(java.lang.String) - function in ai.platon.pulsar.common.options.WeightedKeywordsConverter

 

convertDurationsTo(java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder

Convert durations to the given time unit.

convertRatesTo(java.util.concurrent.TimeUnit) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder

Convert rates to the given time unit.

copy() - function in java.util.concurrent.CompletableFuture

 

copy() - function in java.util.concurrent.CompletableFuture

 

CoreMetrics - class in ai.platon.pulsar.crawl

 

CoreMetrics.Companion - class in ai.platon.pulsar.crawl.CoreMetrics

 

count(ai.platon.pulsar.crawl.impl.CrawlEvents) - function in ai.platon.pulsar.common.event.AbstractEventEmitter

 

count(ai.platon.pulsar.crawl.fetch.driver.BrowserEvents) - function in ai.platon.pulsar.common.event.Browser

 

count(ai.platon.pulsar.crawl.fetch.driver.BrowserEvents) - function in ai.platon.pulsar.common.event.EventEmitter

 

counter(java.lang.Object,java.lang.String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counter(java.lang.Object,java.lang.String,java.lang.String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counter(java.lang.String) - function in com.codahale.metrics.MetricRegistry

 

counter(java.lang.String,com.codahale.metrics.MetricRegistry.MetricSupplier) - function in com.codahale.metrics.MetricRegistry

 

counterAndGauge(java.lang.Object,java.lang.String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counterAndGauge(java.lang.Object,java.lang.String,java.lang.String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

countHostTasks(java.lang.String) - function in ai.platon.pulsar.crawl.CoreMetrics

 

COUNTRY - enum entry in ai.platon.pulsar.common.domain.TopLevelDomain.Type

 

countStackFrames() - function in java.lang.Thread

 

CRASHED - enum entry in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State

 

Crawler - class in ai.platon.pulsar.crawl

 

CrawlEvent - class in ai.platon.pulsar.crawl

Manage all events in crawl phase of the webpage lifecycle.

CrawlEvents - class in ai.platon.pulsar.crawl.impl

 

CrawlFilter - class in ai.platon.pulsar.crawl.filter

TODO : configurable

CrawlFilter.Companion - class in ai.platon.pulsar.crawl.filter.CrawlFilter

 

CrawlFilters - class in ai.platon.pulsar.crawl.filter

TODO : need full unit test TODO : Move to plugin, urlfilter/contentfilter, etc

CrawlFilters.Companion - class in ai.platon.pulsar.crawl.filter.CrawlFilters

 

CrawlLoop - class in ai.platon.pulsar.crawl

 

CrawlLoops - class in ai.platon.pulsar.crawl

 

CrawlLoops.Companion - class in ai.platon.pulsar.crawl.CrawlLoops

 

CrawlOptions - class in ai.platon.pulsar.common.options.deprecated

Created by vincent on 17-3-18.

CrawlOptions.Companion - class in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

crawlRetry(ai.platon.pulsar.crawl.fetch.FetchTask,kotlin.Exception) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(ai.platon.pulsar.crawl.fetch.FetchTask,java.time.Duration,kotlin.Exception) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(ai.platon.pulsar.crawl.fetch.FetchTask,java.time.Duration,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(ai.platon.pulsar.crawl.fetch.FetchTask,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(ai.platon.pulsar.persist.WebPage,kotlin.Exception) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

crawlRetry(ai.platon.pulsar.persist.WebPage,java.lang.String) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

CrawlUrlFilter - class in ai.platon.pulsar.crawl.filter

Interface used to limit which URLs enter AppConstants.

CrawlUrlFilters - class in ai.platon.pulsar.crawl.filter

Creates and caches CrawlUrlFilter implementing plugins.

create(ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.common.options.LoadOptions.Companion

Create an empty LoadOptions.

create() - function in ai.platon.pulsar.context.PulsarContexts

 

create(ai.platon.pulsar.context.PulsarContext) - function in ai.platon.pulsar.context.PulsarContexts

 

create(java.lang.String) - function in ai.platon.pulsar.context.PulsarContexts

 

create(org.springframework.context.ApplicationContext) - function in ai.platon.pulsar.context.PulsarContexts

 

create(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

create(java.lang.String,ai.platon.pulsar.common.config.VolatileConfig) - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

create(java.lang.Integer,java.lang.Integer,java.lang.String,ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.crawl.common.URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Companion

Create an item.

create(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextIdGeneratorFactory

 

create(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.inject.SeedBuilder

 

create(org.apache.commons.lang3.tuple.Pair) - function in ai.platon.pulsar.crawl.inject.SeedBuilder

 

createFatLink(ai.platon.pulsar.common.urls.NormUrl) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(ai.platon.pulsar.common.urls.NormUrl,ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.dom.FeaturedDocument) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(ai.platon.pulsar.common.urls.NormUrl,ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.dom.FeaturedDocument,java.util.Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

Create a fat link.

createFatLink(ai.platon.pulsar.common.urls.NormUrl,ai.platon.pulsar.persist.WebPage,java.util.Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(ai.platon.pulsar.common.urls.NormUrl,java.util.Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.dom.FeaturedDocument,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createItemOptions() - function in ai.platon.pulsar.common.options.LoadOptions

Create a new LoadOptions object for item pages.

createPageShell(ai.platon.pulsar.common.urls.NormUrl) - function in ai.platon.pulsar.crawl.common.FetchEntry.Companion

 

createPageShell(java.lang.String,ai.platon.pulsar.common.options.LoadOptions,java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.common.FetchEntry.Companion

 

createScoreEntry(ai.platon.pulsar.crawl.scoring.Name) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

Enum ordinal is the priority in reversed order

createScoreEntry(ai.platon.pulsar.crawl.scoring.Name,java.lang.Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createScoreEntry(ai.platon.pulsar.crawl.scoring.Name,java.lang.Integer,java.lang.Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createSession() - function in ai.platon.pulsar.context.PulsarContext

Create a pulsar session

createSession() - function in ai.platon.pulsar.context.PulsarContexts

 

createSession() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Create a session

createSession() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Create a session

createSession() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Create a session

createSortedScoreEntries() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createSortedScoreEntries(java.lang.Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createTime - enum entry in ai.platon.pulsar.crawl.scoring.Name

 

createUnmanagedContext(ai.platon.pulsar.crawl.fetch.privacy.PrivacyContextId) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a context and do not add to active context list

createUnsafe() - function in ai.platon.pulsar.common.options.LoadOptions.Companion

Create an empty LoadOptions.

currentUrl() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrl() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

Returns a string representing the current URL that the browser is looking at.

A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _