Package ai.platon.pulsar.skeleton.crawl

Interface TaskRunner

  • All Implemented Interfaces:
    java.lang.AutoCloseable 
    
public interface TaskRunner
 implements AutoCloseable

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Field Summary

      Fields 
      Modifier and Type Field Description

    • Constructor Summary

      Constructors 
      Constructor Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      abstract Unit pause()
      abstract Unit resume()
      abstract Unit await() Wait until all tasks are done.
      abstract Unit report()
      abstract Unit onWillLoad(UrlAware url)
      abstract Unit onLoad(UrlAware url)
      abstract Unit onLoaded(UrlAware url, WebPage page)
      abstract Integer getId() The crawl id
      abstract String getName() The crawl name
      abstract Function2<Integer, UrlAware, Duration> getRetryDelayPolicy() Delay policy for retry tasks
      abstract Unit setRetryDelayPolicy(Function2<Integer, UrlAware, Duration> retryDelayPolicy) Delay policy for retry tasks

      • Methods inherited from class java.lang.AutoCloseable

        close

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait