Package ai.platon.pulsar.skeleton.crawl.schedule

Interface FetchSchedule

  • All Implemented Interfaces:
    ai.platon.pulsar.common.config.Parameterized 
    
public interface FetchSchedule
 implements Parameterized

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Field Summary

      Fields 
      Modifier and Type Field Description

    • Constructor Summary

      Constructors 
      Constructor Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      abstract Unit initializeSchedule(WebPage page)
      abstract Unit setFetchSchedule(WebPage page, ModifyInfo m)
      abstract Unit setPageGoneSchedule(WebPage page, Instant prevFetchTime, Instant prevModifiedTime, Instant fetchTime)
      abstract Unit setPageRetrySchedule(WebPage page, Instant prevFetchTime, Instant prevModifiedTime, Instant fetchTime)
      abstract Instant estimatePrevFetchTime(WebPage page)
      abstract Boolean shouldFetch(WebPage page, Instant now)
      abstract Unit forceRefetch(WebPage page, Instant prevFetchTime, Boolean asap)
      abstract Duration getMaxFetchInterval()

      • Methods inherited from class ai.platon.pulsar.common.config.Parameterized

        getParams

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait