F-index

A B C D E F G H I J K L M N O P Q R S T U V W _

F

failed(java.lang.Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult
failed(ai.platon.pulsar.crawl.fetch.FetchTask,java.lang.Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion
failed(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
failed(java.lang.Throwable) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
failed(java.lang.Integer,java.lang.String) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
failed(java.lang.Throwable) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
failed(ai.platon.pulsar.persist.WebPage,java.lang.Throwable) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion
FatLinkExtractor - class in ai.platon.pulsar.common.collect
FatLinkExtractor.Companion - class in ai.platon.pulsar.common.collect.FatLinkExtractor
FatLinkExtractor.Companion.Counters - class in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion
FeedLoop - class in ai.platon.pulsar.crawl.fetch.batch: This class feeds the fetchMonitor with input items, and re-fills them as items are consumed by FetcherThread-s.
fetch(java.lang.String) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch an url
fetch(java.lang.String) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch an url
fetch(java.lang.String,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch an url
fetch(java.lang.String,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch an url
fetchAll(java.lang.Iterable,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent: Fetch all the urls, config property 'fetch.concurrency' controls the concurrency level.
FetchComponent - class in ai.platon.pulsar.crawl.component: The fetch component is the portal to fetch the content of pages.
FetchComponent.Companion - class in ai.platon.pulsar.crawl.component.FetchComponent
fetchContent(ai.platon.pulsar.crawl.common.FetchEntry) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
fetchContent(ai.platon.pulsar.crawl.common.FetchEntry) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
fetchContent(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
fetchContent(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
fetchContentDeferred(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
fetchContentDeferred(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent: Fetch a page
FetchEntry - class in ai.platon.pulsar.crawl.common
FetchEntry.Companion - class in ai.platon.pulsar.crawl.common.FetchEntry
FetchingCache - class in ai.platon.pulsar.crawl.common
FetchLoop - class in ai.platon.pulsar.crawl.fetch.batch: This class picks items from queues and fetches the pages
FetchLoop.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FetchLoop
FetchModeConverter - class in ai.platon.pulsar.common.options
FetchMonitor - class in ai.platon.pulsar.crawl.fetch.batch: Created by vincent on 16-9-24.
FetchOptions - class in ai.platon.pulsar.common.options
FetchOptions.Companion - class in ai.platon.pulsar.common.options.FetchOptions
FetchResult - class in ai.platon.pulsar.crawl.fetch
FetchResult.Companion - class in ai.platon.pulsar.crawl.fetch.FetchResult
FetchSchedule - class in ai.platon.pulsar.crawl.schedule: This interface defines the contract for implementations that manipulate fetch times and re-fetch intervals.
FetchSchedule.Companion - class in ai.platon.pulsar.crawl.schedule.FetchSchedule
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.context.PulsarContext: Check the fetch state of a webpage
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Check the fetch state of a page
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Check the fetch state of a page
FetchState - class in ai.platon.pulsar.crawl.common
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.crawl.component.LoadComponent
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.session.AbstractPulsarSession: Return the fetch state of the page.
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.session.AbstractPulsarSession: Return the fetch state of the page.
fetchState(ai.platon.pulsar.persist.WebPage,ai.platon.pulsar.common.options.LoadOptions) - function in ai.platon.pulsar.session.PulsarSession: Return the fetch state of the page.
FetchStatusFormatter - class in ai.platon.pulsar.common.message
FetchTask - class in ai.platon.pulsar.crawl.fetch
FetchTask.Companion - class in ai.platon.pulsar.crawl.fetch.FetchTask
FetchTask.State - class in ai.platon.pulsar.crawl.fetch.FetchTask
fillInStackTrace() - function in kotlin.Throwable
filter(com.codahale.metrics.MetricFilter) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder: Only report metrics which match the given filter.
filter(ai.platon.pulsar.persist.HyperlinkPersistable) - function in ai.platon.pulsar.common.options.LinkOptions
filter(java.lang.String) - function in ai.platon.pulsar.common.options.LinkOptions
filter(java.lang.String,java.lang.String) - function in ai.platon.pulsar.common.options.LinkOptions
filter(ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
filter(java.lang.String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilter
filter(java.lang.String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters: Run all defined urlFilters.
filter - enum entry in ai.platon.pulsar.crawl.impl.CrawlEvents
filter(ai.platon.pulsar.crawl.index.IndexDocument,java.lang.String,ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilter: Adds fields or otherwise modifies the document that will be indexed for a parse.
filter(ai.platon.pulsar.crawl.index.IndexDocument,java.lang.String,ai.platon.pulsar.persist.WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilters: Run all defined filters.
filter(ai.platon.pulsar.crawl.parse.html.ParseContext) - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter: Do the filtering.
filter(ai.platon.pulsar.crawl.parse.html.ParseContext) - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter: Do the filtering.
filter(ai.platon.pulsar.persist.HyperlinkPersistable) - function in ai.platon.pulsar.crawl.parse.LinkFilter
filter(ai.platon.pulsar.crawl.parse.html.ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilter: Do the filtering.
filter(ai.platon.pulsar.crawl.parse.html.ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilters: Run all defined filters
FilterResult - class in ai.platon.pulsar.crawl.parse
FilterResult.Companion - class in ai.platon.pulsar.crawl.parse.FilterResult
find(ai.platon.pulsar.crawl.fetch.batch.data.PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
findAll(kotlin.text.Regex) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory
findByClassName(java.lang.String) - function in ai.platon.pulsar.crawl.filter.ChainedUrlNormalizer
findExtend(ai.platon.pulsar.crawl.fetch.batch.data.PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
findPendingTask(ai.platon.pulsar.crawl.fetch.batch.data.PoolId,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor: Get a pending task, the task can be in working pools or in detached pools
findPendingTask(java.lang.Integer,java.net.URL,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
finish(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
finish(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask,java.lang.Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool: Note : We have set response time for each page, @see {HttpBase#getProtocolOutput}
finish(java.lang.Integer,java.lang.Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
finish(ai.platon.pulsar.crawl.fetch.batch.data.PoolId,java.lang.Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler: Finished downloading the web pageMultiple threaded, non-synchronized class member variables are not allowed inside this method.
finishAsap(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
finishUnchecked(ai.platon.pulsar.crawl.fetch.batch.JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler: Finish the fetch item anyway, even if it's failed to download the target page
first() - function in ai.platon.pulsar.crawl.CrawlLoops
firstAttr(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Returns the node's attribute name.
firstAttr(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Returns the node's attribute name.
firstAttr(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Returns the node's attribute name.
firstAttrAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
firstAttrAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
firstAttrAsync(java.lang.String,java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver
firstIsInstance() - function in ai.platon.pulsar.crawl.CrawlLoops
firstOrNull(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory
firstOrNull(kotlin.text.Regex) - function in ai.platon.pulsar.crawl.fetch.driver.NavigateHistory
firstText(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Returns the node's text content.
firstText(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Returns the node's text content.
firstText(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Returns the node's text content.
firstTextAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
firstTextAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractJvmWebDriver
firstTextAsync(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.JvmWebDriver
flush() - function in ai.platon.pulsar.context.PulsarContext: Flush the backend storage
flush() - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Flush the storage
flush() - function in ai.platon.pulsar.context.support.AbstractPulsarContext: Flush the storage
flush() - function in ai.platon.pulsar.crawl.component.LoadComponent
flush() - function in ai.platon.pulsar.crawl.component.WebDbComponent
flush() - function in ai.platon.pulsar.session.AbstractPulsarSession: Flush to the storage
flush() - function in ai.platon.pulsar.session.AbstractPulsarSession: Flush to the storage
flush() - function in ai.platon.pulsar.session.PulsarSession: Flush to the storage
focus(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
focus(java.lang.String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
forceRefetch(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.lang.Boolean) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forceRefetch(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.lang.Boolean) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule: This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forceRefetch(ai.platon.pulsar.persist.WebPage,java.time.Instant,java.lang.Boolean) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule: This method resets fetchTime, fetchInterval, modifiedTime and page text, so that it forces refetching.
forEach(java.util.function.Consumer) - function in kotlin.collections.Iterable
forEach(java.util.function.Consumer) - function in kotlin.collections.Iterable
format() - function in ai.platon.pulsar.common.message.Record
formatAsLine() - function in ai.platon.pulsar.crawl.index.IndexDocument
formatAsTable(java.util.Collection) - function in ai.platon.pulsar.common.collect.DataCollectorFormatterKt
formatAvailableMemory() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
formatMemoryShortage() - function in ai.platon.pulsar.common.AppSystemInfo.Companion
forName(java.lang.String) - function in ai.platon.pulsar.common.MimeTypeResolver: A facade interface to Tika's underlying forName method.
forRegistry(com.codahale.metrics.MetricRegistry) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Companion: Returns a new Builder for Slf4jReporter.
ForwardingResponse - class in ai.platon.pulsar.crawl.protocol: Forward a response.
ForwardingResponse.Companion - class in ai.platon.pulsar.crawl.protocol.ForwardingResponse
free() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver: Mark the driver as free, so it can be used to fetch a new page.
free() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Mark the driver as free, so it can be used to fetch a new page.
free() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver: Mark the driver as free, so it can be used to fetch a new page.
FREE - enum entry in ai.platon.pulsar.crawl.fetch.driver.WebDriver.State
fromConfig(java.lang.String,ai.platon.pulsar.session.PulsarSession,ai.platon.pulsar.common.Priority13) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector.Companion
fromString(java.lang.String) - function in ai.platon.pulsar.common.options.ItemExtractor.Companion

A B C D E F G H I J K L M N O P Q R S T U V W _