Class LocalFileHyperlinkCollector

  • All Implemented Interfaces:
    ai.platon.pulsar.common.collect.collector.DataCollector , ai.platon.pulsar.common.collect.collector.PriorityDataCollector , kotlin.Comparable

    
    public class LocalFileHyperlinkCollector
    extends AbstractPriorityDataCollector<UrlAware>
                        
    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description
    • Method Summary

      Modifier and Type Method Description
      Integer getCapacity() The cache capacity, we assume that all items in the file are loaded into the cache
      String getName() The collector name
      Unit setName(String name) The collector name
      final String getFileName()
      final String getLoadArgs()
      final Unit setLoadArgs(String loadArgs)
      final List<Hyperlink> getHyperlinks()
      Integer getSize()
      final Path getPath() The path of the file source
      <Error class: unknown class> hasMore()
      Integer collectTo(List<UrlAware> sink)
      List<String> dump()
      • Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector

        clear, collectTo, collectTo, collectTo, getCollectCount, getCollectTime, getCollectedCount, getCountry, getCreateTime, getDeadTime, getDistrict, getEstimatedExternalSize, getEstimatedSize, getExternalSize, getFirstCollectTime, getId, getLabels, getLang, getLastCollectedTime, setCollectCount, setCollectedCount, setCountry, setDeadTime, setDistrict, setFirstCollectTime, setLang, setLastCollectedTime
      • Methods inherited from class ai.platon.pulsar.common.collect.collector.DataCollector

        deepClear, isDead
      • Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector

        getPriority, toString
      • Methods inherited from class ai.platon.pulsar.common.collect.collector.PriorityDataCollector

        compareTo
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • LocalFileHyperlinkCollector

        LocalFileHyperlinkCollector(Path path, Priority13 priority)
      • LocalFileHyperlinkCollector

        LocalFileHyperlinkCollector(Path path, Integer priority)