Class StreamingCrawlLoop
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.StartStopRunnable,ai.platon.pulsar.skeleton.crawl.CrawlLoop
public class StreamingCrawlLoop extends AbstractCrawlLoop
-
-
Field Summary
Fields Modifier and Type Field Description private final Crawlercrawlerprivate final UrlFeederurlFeederprivate final Stringabstractprivate final Stringreportprivate final Integeridprivate final BooleanisRunningprivate final List<PriorityDataCollector<UrlAware>>collectorsprivate final Stringdisplayprivate final Stringnameprivate final ImmutableConfigconfig
-
Constructor Summary
Constructors Constructor Description StreamingCrawlLoop(ImmutableConfig unmodifiedConfig, String name)
-
Method Summary
Modifier and Type Method Description CrawlergetCrawler()UrlFeedergetUrlFeeder()The url feeder is used by the crawl loop to feed urls to the crawler. StringgetAbstract()StringgetReport()Unitstart()Unitstop()Unitawait()Wait until the loop is started and all tasks are done. -
Methods inherited from class ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawlLoop
getCollectors, getConfig, getDisplay, getId, getName, isRunning -
Methods inherited from class ai.platon.pulsar.common.StartStopRunnable
restart -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Constructor Detail
-
StreamingCrawlLoop
StreamingCrawlLoop(ImmutableConfig unmodifiedConfig, String name)
-
-
Method Detail
-
getCrawler
Crawler getCrawler()
-
getUrlFeeder
UrlFeeder getUrlFeeder()
The url feeder is used by the crawl loop to feed urls to the crawler.
-
getAbstract
String getAbstract()
-
start
@Synchronized() Unit start()
-
stop
@Synchronized() Unit stop()
-
-
-
-