A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _ 

C

calculate(WebPage) - function in ai.platon.pulsar.crawl.signature.Signature

 

calculate(WebPage) - function in ai.platon.pulsar.crawl.signature.TextMD5Signature

We need calculate signature using a more clean signature content, eg, extracted by signature-persist

calculate(WebPage) - function in ai.platon.pulsar.crawl.signature.MD5Signature

 

calculate(WebPage) - function in ai.platon.pulsar.crawl.signature.TextProfileSignature

 

cancel(WebPage) - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

cancel(WebPage) - function in ai.platon.pulsar.crawl.protocol.AbstractHttpProtocol

Cancel the page

cancel(Boolean) - function in java.util.concurrent.CompletableHyperlink

 

cancel(Boolean) - function in java.util.concurrent.CompletableListenableHyperlink

 

cancel() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Mark the driver as canceled, so the fetch process should return as soon as possible, and the fetch result should be dropped.

cancel(WebPage) - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel the page

cancelAll() - function in ai.platon.pulsar.crawl.protocol.AbstractNativeHttpProtocol

 

cancelAll() - function in ai.platon.pulsar.crawl.protocol.AbstractHttpProtocol

Cancel all fetching tasks

cancelAll() - function in ai.platon.pulsar.crawl.protocol.Protocol

Cancel all fetching tasks

CANCELED - enum entry in ai.platon.pulsar.crawl.fetch.FetchTask.State

 

canceled() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

canceled(FetchTask) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

CANCELED - enum entry in ai.platon.pulsar.crawl.fetch.driver.WebDriver.Status

 

canceled(WebPage) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

captureScreenshot(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshot(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

captureScreenshot(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshot(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

captureScreenshot(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshot(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

captureScreenshotAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

captureScreenshotAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

captureScreenshotAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

This method scrolls element into view if needed, and then ake a screenshot of the element.

captureScreenshotAsync(RectD) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

chain(CrawlEvent) - function in ai.platon.pulsar.crawl.CrawlEvent

 

chain(LoadEvent) - function in ai.platon.pulsar.crawl.LoadEvent

 

chain(BrowseEvent) - function in ai.platon.pulsar.crawl.BrowseEvent

 

chain(PageEvent) - function in ai.platon.pulsar.crawl.PageEvent

Chain the other page event handler to the tail of this one.

chain(LoadEvent) - function in ai.platon.pulsar.crawl.event.AbstractLoadEvent

 

chain(CrawlEvent) - function in ai.platon.pulsar.crawl.event.AbstractCrawlEvent

 

chain(BrowseEvent) - function in ai.platon.pulsar.crawl.event.AbstractBrowseEvent

 

chain(PageEvent) - function in ai.platon.pulsar.crawl.event.AbstractPageEvent

Chain the other page event handler to the tail of this one.

chain(LoadEvent) - function in ai.platon.pulsar.crawl.event.DefaultLoadEvent

 

chain(CrawlEvent) - function in ai.platon.pulsar.crawl.event.DefaultCrawlEvent

 

chain(BrowseEvent) - function in ai.platon.pulsar.crawl.event.PerfectTraceBrowseEvent

 

chain(BrowseEvent) - function in ai.platon.pulsar.crawl.event.EmptyBrowseEvent

 

chain(PageEvent) - function in ai.platon.pulsar.crawl.event.DefaultPageEvent

Chain the other page event handler to the tail of this one.

ChainedUrlNormalizer - class in ai.platon.pulsar.crawl.filter

This class uses a "chained filter" pattern to run defined normalizers.

ChainedUrlNormalizer.Companion - class in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer

 

check(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

check(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

check(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

checkAccess() - function in java.lang.IndexThread

 

checkAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

checkAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

checkAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

chooseRepr(String,String,Boolean) - function in ai.platon.pulsar.crawl.common.URLUtil

Given two urls, a src and a destination of a redirect, it returns the representative url.

CircularHyperlinkCollector - class in ai.platon.pulsar.common.collect

 

CircularLocalFileHyperlinkCollector - class in ai.platon.pulsar.common.collect

 

ClassPathXmlPulsarContext - class in ai.platon.pulsar.context.support

 

cleanMimeType(String) - function in ai.platon.pulsar.common.MimeTypeResolver

Cleans a MimeType name by removing out the actual MimeType,from a string of the form:

     <primary type>/<sub type> ; < optional params

cleanStack() - function in java.util.concurrent.CompletableHyperlink

 

cleanStack() - function in java.util.concurrent.CompletableListenableHyperlink

 

clear() - function in java.util.LoadingDelayQueue

 

clear() - function in ai.platon.pulsar.common.collect.collector.LocalFileHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.collector.CircularLocalFileHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.collector.PeriodicalLocalFileHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

clear() - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

clear() - function in ai.platon.pulsar.crawl.common.FetchingCache

 

clear() - function in ai.platon.pulsar.common.lang.VoidEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.UrlAwareEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.UrlAwareEventFilter

 

clear() - function in ai.platon.pulsar.common.lang.UrlFilterEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.UrlEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebAssetEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebPageEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.UrlAwareWebAssetEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.UrlAwareWebPageEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebAssetHTMLDocumentEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebPageHTMLDocumentEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.PageDatumEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebAssetWebDriverEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebPageWebDriverEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.WebPageJvmWebDriverEventHandler

 

clear() - function in ai.platon.pulsar.common.lang.LoginHandler

 

clear() - function in ai.platon.pulsar.common.lang.CloseMaskLayerHandler

 

clear() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

clear() - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue

 

clear() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

clearCaches() - function in ai.platon.pulsar.crawl.common.GlobalCache

Clear all caches.

clearClues() - function in ai.platon.pulsar.common.EncodingDetector

Clears all clues.

clearPDCaches() - function in ai.platon.pulsar.crawl.common.GlobalCache

Clear page cache and document cache.

clearPendingQueue() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearPendingTasksIfFew(Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearReadyQueue() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

clearReadyTasks() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

click(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

click(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

click(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickablePoint(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Calculate the clickable point of an element located by selector.

clickablePoint(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Calculate the clickable point of an element located by selector.

clickablePoint(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Calculate the clickable point of an element located by selector.

clickablePointAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

Calculate the clickable point of an element located by selector.

clickAsync(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickAsync(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickAsync(String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickAsync(String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatches(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatches(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatches(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatches(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatches(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickMatches(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickMatchesAsync(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickMatchesAsync(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatchesAsync(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatchesAsync(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickMatchesAsync(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatchesAsync(String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickMatchesAsync(String,String,String,Integer) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clickNthAnchor(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickNthAnchor(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickNthAnchor(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

 

clickNthAnchorAsync(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

 

clickNthAnchorAsync(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

clickNthAnchorAsync(Integer,String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

 

clone() - function in ai.platon.pulsar.common.options.LoadOptions

Create a new LoadOptions object with the same arguments string and event handlers.

clone() - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

clone() - function in ai.platon.pulsar.crawl.index.IndexField

 

clone() - function in java.lang.IndexThread

 

clone() - function in ai.platon.pulsar.common.NamedScoreVector

 

close() - function in ai.platon.pulsar.crawl.protocol.http.AbstractNativeHttpProtocol

 

close() - function in java.lang.AbstractNativeHttpProtocol

 

close() - function in ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol

 

close() - function in ai.platon.pulsar.common.message.MiscMessageWriter

 

close() - function in ai.platon.pulsar.common.metrics.AppMetrics

 

close() - function in com.codahale.metrics.CodahaleSlf4jReporter

 

close() - function in ai.platon.pulsar.common.concurrent.EnumCounterReporter

 

close() - function in java.lang.PulsarContext

 

close() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.context.support.StaticPulsarContext

Close this pulsar contextDelegates to doClose() for the actual closing procedure.

close() - function in ai.platon.pulsar.crawl.CoreMetrics

 

close() - function in java.lang.Crawler

 

close() - function in ai.platon.pulsar.crawl.component.BatchFetchComponent

 

close() - function in ai.platon.pulsar.crawl.component.FetchComponent

 

close() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

close() - function in ai.platon.pulsar.crawl.component.LoadComponent

 

close() - function in ai.platon.pulsar.crawl.component.WebDbComponent

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler

 

close() - function in ai.platon.pulsar.crawl.fetch.batch.TaskSchedulers

 

close() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractBrowser

 

close() - function in java.io.AbstractJvmWebDriver

 

close() - function in java.io.AbstractWebDriver

 

close() - function in java.lang.Browser

 

close() - function in java.io.WebDriver

 

close() - function in java.lang.PrivacyContext

 

close() - function in ai.platon.pulsar.common.concurrent.PrivacyContextMonitor

 

close(PrivacyContext) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

close() - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

 

close() - function in ai.platon.pulsar.crawl.impl.AbstractCrawler

 

close() - function in ai.platon.pulsar.crawl.impl.StreamingCrawler

 

close() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

close() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

close() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

 

close() - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.PageParser

 

close() - function in ai.platon.pulsar.crawl.parse.ParseFilter

Close the filter.

close() - function in ai.platon.pulsar.crawl.parse.ParseFilters

 

close() - function in ai.platon.pulsar.crawl.protocol.Protocol

 

close() - function in ai.platon.pulsar.crawl.protocol.ProtocolFactory

 

close() - function in ai.platon.pulsar.session.AbstractPulsarSession

 

close() - function in ai.platon.pulsar.session.BasicPulsarSession

 

close() - function in java.lang.PulsarSession

 

CloseMaskLayerHandler - class in ai.platon.pulsar.crawl.event.impl

 

closeSession(PulsarSession) - function in ai.platon.pulsar.context.PulsarContext

Close a pulsar session

closeSession(PulsarSession) - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Close the given session

closeSession(PulsarSession) - function in ai.platon.pulsar.context.support.BasicPulsarContext

Close the given session

closeSession(PulsarSession) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Close the given session

closeSession(PulsarSession) - function in ai.platon.pulsar.context.support.StaticPulsarContext

Close the given session

closeWriter(String) - function in ai.platon.pulsar.common.MiscMessageWriter

 

CodahaleSlf4jReporter - class in ai.platon.pulsar.common.metrics

A reporter class for logging metrics values to a SLF4J Logger periodically, similar to ConsoleReporter or CsvReporter, but using the SLF4J framework instead.

CodahaleSlf4jReporter.Builder - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

A builder for Slf4jReporter instances.

CodahaleSlf4jReporter.Companion - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

 

CodahaleSlf4jReporter.LoggingLevel - class in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter

 

collectLinks(URL,Node) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

This method finds all anchors below the supplied DOM root, and creates appropriate HyperlinkPersistable records for each (relative to the supplied base URL), and adds them to the outlinksArrayList.

collectLinks(URL,Node,CrawlFilters) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

collectLinks(URL,Set,Node,CrawlFilters) - function in ai.platon.pulsar.crawl.parse.html.PrimerParser

 

collectTo(List) - function in ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.LocalFileHyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.LocalFileHyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.LocalFileHyperlinkCollector

 

collectTo(List) - function in ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.CircularLocalFileHyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.CircularLocalFileHyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.CircularLocalFileHyperlinkCollector

 

collectTo(List) - function in ai.platon.pulsar.common.collect.PeriodicalLocalFileHyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalLocalFileHyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalLocalFileHyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalLocalFileHyperlinkCollector

 

collectTo(List) - function in ai.platon.pulsar.common.collect.HyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.HyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.HyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.HyperlinkCollector

 

collectTo(List) - function in ai.platon.pulsar.common.collect.CircularHyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.CircularHyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.CircularHyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.CircularHyperlinkCollector

 

collectTo(List) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector

 

collectTo(UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalHyperlinkCollector

 

collectTo(Integer,UrlAware,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalHyperlinkCollector

 

collectTo(Integer,List) - function in ai.platon.pulsar.common.collect.collector.PeriodicalHyperlinkCollector

 

CombinedUrlNormalizer - class in ai.platon.pulsar.common.urls

 

commit() - function in ai.platon.pulsar.crawl.common.WeakPageIndexer

 

commit() - function in ai.platon.pulsar.crawl.component.IndexComponent

 

commit() - function in ai.platon.pulsar.crawl.component.InjectComponent

 

commit() - function in ai.platon.pulsar.crawl.index.IndexWriter

 

commit() - function in ai.platon.pulsar.crawl.index.IndexWriters

 

CommonCounter - class in ai.platon.pulsar.common.metrics

Created by vincent on 17-4-5.

CommonCounter.Companion - class in ai.platon.pulsar.common.metrics.CommonCounter

 

CommonOptions - class in ai.platon.pulsar.common.options

Created by vincent on 17-4-12.

compare(Array,Array) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compare(ByteBuffer,ByteBuffer) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compare(Object,Object) - function in ai.platon.pulsar.crawl.signature.SignatureComparator

 

compare(T,T) - function in java.util.SignatureComparator

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.LocalFileHyperlinkCollector

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.CircularLocalFileHyperlinkCollector

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.PeriodicalLocalFileHyperlinkCollector

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.HyperlinkCollector

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.CircularHyperlinkCollector

 

compareTo(PriorityDataCollector) - function in ai.platon.pulsar.common.collect.collector.PeriodicalHyperlinkCollector

 

compareTo(NormUrl) - function in ai.platon.pulsar.common.urls.NormUrl

 

compareTo(UrlAware) - function in ai.platon.pulsar.common.urls.ListenableHyperlink

 

compareTo(UrlAware) - function in ai.platon.pulsar.common.urls.StatefulListenableHyperlink

 

compareTo(UrlAware) - function in ai.platon.pulsar.common.urls.ParsableHyperlink

 

compareTo(UrlAware) - function in ai.platon.pulsar.crawl.common.url.CompletableHyperlink

 

compareTo(UrlAware) - function in kotlin.CompletableListenableHyperlink

 

compareTo(UrlStat) - function in ai.platon.pulsar.crawl.fetch.UrlStat

 

compareTo(FetchTask) - function in ai.platon.pulsar.crawl.fetch.FetchTask

 

compareTo(FeedLoop) - function in ai.platon.pulsar.crawl.fetch.batch.FeedLoop

 

compareTo(FetchLoop) - function in ai.platon.pulsar.crawl.fetch.batch.FetchLoop

 

compareTo(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask

 

compareTo(JobFetchTask.Key) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Key

 

compareTo(TaskPool) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

 

compareTo(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolId

 

compareTo(AbstractWebDriver) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

 

compareTo(NavigateEntry) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateEntry

 

compareTo(PrivacyAgent) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyAgent

 

compareTo(BrowserId) - function in ai.platon.pulsar.crawl.fetch.privacy.BrowserId

 

compareTo(IndexThread) - function in ai.platon.pulsar.crawl.index.jit.indexer.IndexThread

 

compareTo(ScoreVector) - function in ai.platon.pulsar.common.NamedScoreVector

 

comparing(Function,Comparator) - function in java.util.SignatureComparator

 

comparingDouble(ToDoubleFunction) - function in java.util.SignatureComparator

 

comparingInt(ToIntFunction) - function in java.util.SignatureComparator

 

comparingLong(ToLongFunction) - function in java.util.SignatureComparator

 

CompletableHyperlink - class in ai.platon.pulsar.crawl.common.url

 

CompletableListenableHyperlink - class in ai.platon.pulsar.crawl.common.url

 

complete(T) - function in java.util.concurrent.CompletableHyperlink

 

complete(T) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeAsync(Supplier,Executor) - function in java.util.concurrent.CompletableHyperlink

 

completeAsync(Supplier) - function in java.util.concurrent.CompletableHyperlink

 

completeAsync(Supplier,Executor) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeAsync(Supplier) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeExceptionally(Throwable) - function in java.util.concurrent.CompletableHyperlink

 

completeExceptionally(Throwable) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeNull() - function in java.util.concurrent.CompletableHyperlink

 

completeNull() - function in java.util.concurrent.CompletableListenableHyperlink

 

completeOnTimeout(T,Long,TimeUnit) - function in java.util.concurrent.CompletableHyperlink

 

completeOnTimeout(T,Long,TimeUnit) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeRelay(Object) - function in java.util.concurrent.CompletableHyperlink

 

completeRelay(Object) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeThrowable(Throwable) - function in java.util.concurrent.CompletableHyperlink

 

completeThrowable(Throwable,Object) - function in java.util.concurrent.CompletableHyperlink

 

completeThrowable(Throwable) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeThrowable(Throwable,Object) - function in java.util.concurrent.CompletableListenableHyperlink

 

completeValue(T) - function in java.util.concurrent.CompletableHyperlink

 

completeValue(T) - function in java.util.concurrent.CompletableListenableHyperlink

 

component1() - function in ai.platon.pulsar.common.urls.NormUrl

 

component1() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

component2() - function in ai.platon.pulsar.common.urls.NormUrl

 

component2() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

component3() - function in ai.platon.pulsar.crawl.fetch.FetchResult

 

computeIfAbsent(TypeAliased(typeAlias=GenericTypeConstructor(dri=ai.platon.pulsar.crawl.fetch.privacy/PrivacyContextId///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=ai.platon.pulsar.crawl.fetch.privacy/PrivacyAgent///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a context with id and add to active context list if not absent

computeIfNecessary(Fingerprint) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an exist one

computeNextContext(Fingerprint) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a new context or return an exist one

Condition - class in ai.platon.pulsar.common.options

 

Condition.Companion - class in ai.platon.pulsar.common.options.Condition

 

ConditionConverter - class in ai.platon.pulsar.common.options

 

consume(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor

 

consume() - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool

Ask a task from this queue.

consume() - function in ai.platon.pulsar.crawl.index.jit.indexer.JITIndexer

Thread safe

contains(Delayed) - function in java.util.LoadingDelayQueue

 

contains(String) - function in ai.platon.pulsar.common.metrics.MetricFilters

 

contains(String) - function in ai.platon.pulsar.crawl.common.FetchingCache

 

contains(TaskPool) - function in java.util.PoolQueue

 

containsAll(Collection) - function in java.util.LoadingDelayQueue

 

containsAll(Collection) - function in java.util.PoolQueue

 

contentScore - enum entry in ai.platon.pulsar.crawl.scoring.Name

 

ContextAware - class in ai.platon.pulsar.context

 

convert(String) - function in ai.platon.pulsar.common.options.DurationConverter

 

convert(String) - function in ai.platon.pulsar.common.options.InstantConverter

 

convert(String) - function in ai.platon.pulsar.common.options.PairConverter

 

convert(String) - function in ai.platon.pulsar.common.options.BrowserTypeConverter

 

convert(String) - function in ai.platon.pulsar.common.options.FetchModeConverter

 

convert(String) - function in ai.platon.pulsar.common.options.ItemExtractorConverter

 

convert(String) - function in ai.platon.pulsar.common.options.WeightedKeywordsConverter

 

convert(String) - function in ai.platon.pulsar.common.options.IntRangeConverter

 

convert(String) - function in ai.platon.pulsar.common.options.DimensionConverter

 

convert(String) - function in ai.platon.pulsar.common.options.ConditionConverter

 

convertDuration(Double) - function in com.codahale.metrics.CodahaleSlf4jReporter

 

convertDurationsTo(TimeUnit) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder

Convert durations to the given time unit.

convertRate(Double) - function in com.codahale.metrics.CodahaleSlf4jReporter

 

convertRatesTo(TimeUnit) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder

Convert rates to the given time unit.

copy() - function in java.util.concurrent.CompletableHyperlink

 

copy() - function in java.util.concurrent.CompletableListenableHyperlink

 

CoreMetrics - class in ai.platon.pulsar.crawl

 

CoreMetrics.Companion - class in ai.platon.pulsar.crawl.CoreMetrics

 

count(BrowserEvents) - function in ai.platon.pulsar.common.event.AbstractBrowser

 

count(BrowserEvents) - function in ai.platon.pulsar.common.event.Browser

 

count(CrawlEvents) - function in ai.platon.pulsar.common.event.AbstractCrawler

 

count(CrawlEvents) - function in ai.platon.pulsar.common.event.StreamingCrawler

 

counter(Object,String,String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counter(Object,String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counter(String) - function in com.codahale.metrics.AppMetricRegistry

 

counter(String,MetricRegistry.MetricSupplier) - function in com.codahale.metrics.AppMetricRegistry

 

counterAndGauge(Object,String,String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

counterAndGauge(Object,String) - function in ai.platon.pulsar.common.metrics.AppMetricRegistry

 

countHostTasks(String) - function in ai.platon.pulsar.crawl.CoreMetrics

 

COUNTRY - enum entry in ai.platon.pulsar.common.domain.TopLevelDomain.Type

 

countStackFrames() - function in java.lang.IndexThread

 

CRASHED - enum entry in ai.platon.pulsar.crawl.fetch.driver.WebDriver.Status

 

Crawler - class in ai.platon.pulsar.crawl

 

CrawlEvent - class in ai.platon.pulsar.crawl

Manage all events in crawl phase of the webpage lifecycle.

CrawlEvents - class in ai.platon.pulsar.crawl.impl

 

CrawlFilter - class in ai.platon.pulsar.crawl.filter

TODO : configurable

CrawlFilter.Companion - class in ai.platon.pulsar.crawl.filter.CrawlFilter

 

CrawlFilters - class in ai.platon.pulsar.crawl.filter

TODO : need full unit test TODO : Move to plugin, urlfilter/contentfilter, etc

CrawlFilters.Companion - class in ai.platon.pulsar.crawl.filter.CrawlFilters

 

CrawlLoop - class in ai.platon.pulsar.crawl

 

CrawlLoops - class in ai.platon.pulsar.crawl

 

CrawlLoops.Companion - class in ai.platon.pulsar.crawl.CrawlLoops

 

CrawlOptions - class in ai.platon.pulsar.common.options.deprecated

Created by vincent on 17-3-18.

CrawlOptions.Companion - class in ai.platon.pulsar.common.options.deprecated.CrawlOptions

 

crawlRetry(FetchTask) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(FetchTask,Duration) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(FetchTask,TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin/Exception///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.lang/Exception///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion

 

crawlRetry(WebPage) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

crawlRetry(WebPage,TypeAliased(typeAlias=GenericTypeConstructor(dri=kotlin/Exception///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=java.lang/Exception///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion

 

CrawlUrlFilter - class in ai.platon.pulsar.crawl.filter

Interface used to limit which URLs enter AppConstants.

CrawlUrlFilters - class in ai.platon.pulsar.crawl.filter

Creates and caches CrawlUrlFilter implementing plugins.

create(VolatileConfig) - function in ai.platon.pulsar.common.options.LoadOptions.Companion

Create an empty LoadOptions.

create() - function in ai.platon.pulsar.context.PulsarContexts

 

create(PulsarContext) - function in ai.platon.pulsar.context.PulsarContexts

 

create(String) - function in ai.platon.pulsar.context.PulsarContexts

 

create(ApplicationContext) - function in ai.platon.pulsar.context.PulsarContexts

 

create(String,VolatileConfig) - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

create(WebPage) - function in ai.platon.pulsar.crawl.fetch.FetchTask.Companion

 

create(Integer,Integer,String,WebPage,URLUtil.GroupMode) - function in ai.platon.pulsar.crawl.fetch.batch.JobFetchTask.Companion

Create an item.

create(Pair) - function in ai.platon.pulsar.crawl.inject.SeedBuilder

 

create(String,String) - function in ai.platon.pulsar.crawl.inject.SeedBuilder

 

createFatLink(NormUrl) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(NormUrl,WebPage,Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(NormUrl,Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(WebPage,FeaturedDocument,LoadOptions) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(NormUrl,WebPage,FeaturedDocument) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

 

createFatLink(NormUrl,WebPage,FeaturedDocument,Collection) - function in ai.platon.pulsar.common.collect.FatLinkExtractor

Create a fat link.

createItemOptions() - function in ai.platon.pulsar.common.options.LoadOptions

Create a new LoadOptions object for item pages.

createPageShell(NormUrl) - function in ai.platon.pulsar.crawl.common.FetchEntry.Companion

 

createPageShell(String,LoadOptions,String,String) - function in ai.platon.pulsar.crawl.common.FetchEntry.Companion

 

createScoreEntry(Name) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

Enum ordinal is the priority in reversed order

createScoreEntry(Name,Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createScoreEntry(Name,Integer,Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createSession() - function in ai.platon.pulsar.context.PulsarContext

Create a pulsar session

createSession() - function in ai.platon.pulsar.context.PulsarContexts

 

createSession() - function in ai.platon.pulsar.context.support.AbstractPulsarContext

Create a session

createSession() - function in ai.platon.pulsar.context.support.BasicPulsarContext

Create a session

createSession() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext

Create a session

createSession() - function in ai.platon.pulsar.context.support.StaticPulsarContext

Create a session

createSortedScoreEntries() - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createSortedScoreEntries(Integer) - function in ai.platon.pulsar.crawl.scoring.NamedScoreVector.Companion

 

createTime - enum entry in ai.platon.pulsar.crawl.scoring.Name

 

createUnmanagedContext(TypeAliased(typeAlias=GenericTypeConstructor(dri=ai.platon.pulsar.crawl.fetch.privacy/PrivacyContextId///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})), inner=GenericTypeConstructor(dri=ai.platon.pulsar.crawl.fetch.privacy/PrivacyAgent///PointingToDeclaration/, projections=[], presentableName=null, extra=PropertyContainer(map={})))) - function in ai.platon.pulsar.crawl.fetch.privacy.PrivacyManager

Create a context and do not add to active context list

currentUrl() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrl() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrl() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver

Returns a string representing the current URL that the browser is looking at.

currentUrlAsync() - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver

Returns a string representing the current URL that the browser is looking at.

A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  _