Package ai.platon.pulsar.skeleton.crawl.filter

Class ChainedUrlNormalizer

  • All Implemented Interfaces:
    ai.platon.pulsar.common.urls.preprocess.UrlNormalizer , ai.platon.pulsar.skeleton.crawl.filter.ScopedUrlNormalizer , kotlin.Function , kotlin.Function1 
    
public final class ChainedUrlNormalizer
extends AbstractScopedUrlNormalizer

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description

    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description

    • Method Summary

      Modifier and Type Method Description
      final Integer getMaxLoops()
      final Unit setMaxLoops(Integer maxLoops)
      final MultiValuedMap<String, ScopedUrlNormalizer> getUrlNormalizers()
      final Unit add(ScopedUrlNormalizer normalizer, String scope)
      final Collection<ScopedUrlNormalizer> get(String scope)
      Boolean isRelevant(String url, String scope)
      String normalize(String url, String scope) Normalize
      String toString()

      • Methods inherited from class ai.platon.pulsar.skeleton.crawl.filter.AbstractScopedUrlNormalizer

        invoke

      • Methods inherited from class ai.platon.pulsar.skeleton.crawl.filter.ScopedUrlNormalizer

        valid

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait