Class StreamingCrawlLoop

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
    • Constructor Summary

      Constructors 
      Constructor Description
      StreamingCrawlLoop(ImmutableConfig unmodifiedConfig, String name)
    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description
    • Method Summary

      Modifier and Type Method Description
      Crawler getCrawler()
      UrlFeeder getUrlFeeder() The url feeder is used by the crawl loop to feed urls to the crawler.
      String getAbstract()
      String getReport()
      Unit start()
      Unit stop()
      Unit await() Wait until the loop is started and all tasks are done.
      • Methods inherited from class ai.platon.pulsar.skeleton.crawl.impl.AbstractCrawlLoop

        getCollectors, getConfig, getDisplay, getId, getName, isRunning
      • Methods inherited from class ai.platon.pulsar.common.StartStopRunnable

        restart
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait