Class AbstractCrawlLoop
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.StartStopRunnable,ai.platon.pulsar.skeleton.crawl.CrawlLoop
public abstract class AbstractCrawlLoop implements CrawlLoop
-
-
Field Summary
Fields Modifier and Type Field Description private final Integeridprivate final BooleanisRunningprivate final UrlFeederurlFeederprivate final List<PriorityDataCollector<UrlAware>>collectorsprivate final Crawlercrawlerprivate final Stringdisplayprivate final Stringabstractprivate final Stringreportprivate final Stringnameprivate final ImmutableConfigconfig
-
Constructor Summary
Constructors Constructor Description AbstractCrawlLoop(String name, ImmutableConfig config)
-
Method Summary
Modifier and Type Method Description IntegergetId()BooleanisRunning()abstract UrlFeedergetUrlFeeder()The url feeder is used by the crawl loop to feed urls to the crawler. List<PriorityDataCollector<UrlAware>>getCollectors()abstract CrawlergetCrawler()StringgetDisplay()StringgetAbstract()StringgetReport()StringgetName()ImmutableConfiggetConfig()-
-
Constructor Detail
-
AbstractCrawlLoop
AbstractCrawlLoop(String name, ImmutableConfig config)
-
-
Method Detail
-
getUrlFeeder
abstract UrlFeeder getUrlFeeder()
The url feeder is used by the crawl loop to feed urls to the crawler.
-
getCollectors
List<PriorityDataCollector<UrlAware>> getCollectors()
-
getCrawler
abstract Crawler getCrawler()
-
getDisplay
String getDisplay()
-
getAbstract
String getAbstract()
-
getConfig
ImmutableConfig getConfig()
-
-
-
-