Package ai.platon.pulsar.skeleton.crawl.filter

Interface ScopedUrlNormalizer

  • All Implemented Interfaces:
    ai.platon.pulsar.common.urls.preprocess.UrlNormalizer , kotlin.Function , kotlin.Function1 
    
public interface ScopedUrlNormalizer
 implements UrlNormalizer

    Interface used to convert URLs to normal form and optionally perform substitutions

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Field Summary

      Fields 
      Modifier and Type Field Description

    • Constructor Summary

      Constructors 
      Constructor Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      abstract Boolean isRelevant(String url, String scope)
      abstract String normalize(String url, String scope)
      Boolean valid(String urlString, String scope)

      • Methods inherited from class kotlin.Function1

        invoke

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

    • Method Detail

      • isRelevant

         abstract Boolean isRelevant(String url, String scope)

      • normalize

         abstract String normalize(String url, String scope)

      • valid

         Boolean valid(String urlString, String scope)