Package 

Class BoilerpipeExtractor

  • All Implemented Interfaces:
    ai.platon.pulsar.common.config.Parameterized , ai.platon.pulsar.crawl.parse.ParseFilter , java.lang.AutoCloseable 
    
public final class BoilerpipeExtractor
extends AbstractParseFilter

    Parse html document into fields

    • Constructor Summary

      Constructors 
      Constructor Description
      BoilerpipeExtractor(ImmutableConfig conf)

    • Method Summary

      Modifier and Type Method Description
      final ImmutableConfig getConf()
      List<ParseFilter> getChildren()
      final Integer getId()
      Boolean getIsLeaf()
      Boolean getIsRoot()
      ParseFilter getParent()
      Unit setParent(ParseFilter parent)
      Integer getParentId()
      final TextDocument extract(WebPage page, String encoding) Extract the page into fields

      • Methods inherited from class ai.platon.pulsar.parse.html.filters.BoilerpipeExtractor

        addFirst, addLast, close, filter, initialize, isRelevant, onAfterFilter, onBeforeFilter

      • Methods inherited from class ai.platon.pulsar.crawl.parse.ParseFilter

        getParams

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait