Package ai.platon.pulsar.crawl.fetch.batch

Object JobFetchTask.Companion

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Constructor Summary

      Constructors 
      Constructor Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      final JobFetchTask create(Integer jobId, Integer priority, String url, WebPage page, URLUtil.GroupMode groupMode) Create an item.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

    • Method Detail

      • create

         final JobFetchTask create(Integer jobId, Integer priority, String url, WebPage page, URLUtil.GroupMode groupMode)

        Create an item. Queue id will be created based on groupMode argument, either as a protocol + hostname pair, protocol + IP address pair or protocol+domain pair.