Package ai.platon.pulsar.common.collect
Class LocalFileHyperlinkCollector
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.collect.collector.DataCollector,ai.platon.pulsar.common.collect.collector.PriorityDataCollector,kotlin.Comparable
public class LocalFileHyperlinkCollector extends AbstractPriorityDataCollector<UrlAware>
-
-
Field Summary
Fields Modifier and Type Field Description private final Integercapacityprivate Stringnameprivate final StringfileNameprivate StringloadArgsprivate final List<Hyperlink>hyperlinksprivate final Integersizeprivate final Pathpathprivate IntegercollectCountprivate final DurationcollectTimeprivate IntegercollectedCountprivate Stringcountryprivate final InstantcreateTimeprivate InstantdeadTimeprivate Stringdistrictprivate final IntegerestimatedExternalSizeprivate final IntegerestimatedSizeprivate final IntegerexternalSizeprivate InstantfirstCollectTimeprivate final Integeridprivate final BooleanisDeadprivate final Set<String>labelsprivate Stringlangprivate InstantlastCollectedTimeprivate final Integerpriority
-
Constructor Summary
Constructors Constructor Description LocalFileHyperlinkCollector(Path path, Priority13 priority)LocalFileHyperlinkCollector(Path path, Integer priority)
-
Method Summary
Modifier and Type Method Description IntegergetCapacity()The cache capacity, we assume that all items in the file are loaded into the cache StringgetName()The collector name UnitsetName(String name)The collector name final StringgetFileName()final StringgetLoadArgs()final UnitsetLoadArgs(String loadArgs)final List<Hyperlink>getHyperlinks()IntegergetSize()final PathgetPath()The path of the file source BooleanhasMore()IntegercollectTo(List<UrlAware> sink)List<String>dump()-
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector
clear, collectTo, collectTo, collectTo, getCollectCount, getCollectTime, getCollectedCount, getCountry, getCreateTime, getDeadTime, getDistrict, getEstimatedExternalSize, getEstimatedSize, getExternalSize, getFirstCollectTime, getId, getLabels, getLang, getLastCollectedTime, setCollectCount, setCollectedCount, setCountry, setDeadTime, setDistrict, setFirstCollectTime, setLang, setLastCollectedTime -
Methods inherited from class ai.platon.pulsar.common.collect.collector.DataCollector
deepClear, isDead -
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
getPriority, toString -
Methods inherited from class ai.platon.pulsar.common.collect.collector.PriorityDataCollector
compareTo -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Method Detail
-
getCapacity
Integer getCapacity()
The cache capacity, we assume that all items in the file are loaded into the cache
-
getFileName
final String getFileName()
-
getLoadArgs
final String getLoadArgs()
-
setLoadArgs
final Unit setLoadArgs(String loadArgs)
-
getHyperlinks
final List<Hyperlink> getHyperlinks()
-
dump
@Synchronized() List<String> dump()
-
-
-
-