Package ai.platon.pulsar.skeleton.crawl.filter

Class AbstractScopedUrlNormalizer

  • All Implemented Interfaces:
    ai.platon.pulsar.common.urls.preprocess.UrlNormalizer , ai.platon.pulsar.skeleton.crawl.filter.ScopedUrlNormalizer , kotlin.Function , kotlin.Function1 
    
public abstract class AbstractScopedUrlNormalizer
 implements ScopedUrlNormalizer

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Field Summary

      Fields 
      Modifier and Type Field Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      Boolean isRelevant(String url, String scope)
      <Error class: unknown class> invoke(String url)
      abstract String normalize(String url, String scope)

      • Methods inherited from class ai.platon.pulsar.skeleton.crawl.filter.ScopedUrlNormalizer

        valid

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • AbstractScopedUrlNormalizer

        AbstractScopedUrlNormalizer()

    • Method Detail

      • isRelevant

         Boolean isRelevant(String url, String scope)

      • invoke

         <Error class: unknown class> invoke(String url)

      • normalize

         abstract String normalize(String url, String scope)