-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.StartStopRunnable,ai.platon.pulsar.crawl.CrawlLoop
public class StreamingCrawlLoop extends AbstractCrawlLoop
-
-
Field Summary
Fields Modifier and Type Field Description private final BooleanisRunningprivate final UrlFeederurlFeederprivate final Crawlercrawlerprivate final Integeridprivate final List<PriorityDataCollector<UrlAware>>collectorsprivate final Stringabstractprivate final Stringreportprivate final Stringnameprivate final ImmutableConfigconfig
-
Constructor Summary
Constructors Constructor Description StreamingCrawlLoop(ImmutableConfig unmodifiedConfig, String name)
-
Method Summary
Modifier and Type Method Description final BooleangetIsRunning()UrlFeedergetUrlFeeder()The fetch iterable from which all fetch tasks are taken CrawlergetCrawler()IntegergetId()List<PriorityDataCollector<UrlAware>>getCollectors()StringgetAbstract()StringgetReport()StringgetName()ImmutableConfiggetConfig()Unitstart()Unitstop()Unitawait()-
-
Constructor Detail
-
StreamingCrawlLoop
StreamingCrawlLoop(ImmutableConfig unmodifiedConfig, String name)
-
-
Method Detail
-
getIsRunning
final Boolean getIsRunning()
-
getUrlFeeder
UrlFeeder getUrlFeeder()
The fetch iterable from which all fetch tasks are taken
-
getCrawler
Crawler getCrawler()
-
getCollectors
List<PriorityDataCollector<UrlAware>> getCollectors()
-
getAbstract
String getAbstract()
-
getConfig
ImmutableConfig getConfig()
-
start
@Synchronized() Unit start()
-
stop
@Synchronized() Unit stop()
-
-
-
-