-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.config.Parameterized,ai.platon.pulsar.crawl.parse.ParseFilter,ai.platon.pulsar.crawl.parse.Parser,java.lang.AutoCloseable
public final class JSParseFilter extends AbstractParseFilter implements ParserThis class is a heuristic link extractor for JavaScript files and code snippets. The general idea of a two-pass regex matching comes from Heritrix. Parts of the code come from OutlinkExtractor.java by Stephan Strittmatter.
-
-
Constructor Summary
Constructors Constructor Description JSParseFilter(ImmutableConfig conf)
-
Method Summary
Modifier and Type Method Description final ImmutableConfiggetConf()List<ParseFilter>getChildren()final IntegergetId()BooleangetIsLeaf()BooleangetIsRoot()ParseFiltergetParent()UnitsetParent(ParseFilter parent)IntegergetParentId()ParseResultparse(WebPage page)-
Methods inherited from class ai.platon.pulsar.parse.js.JSParseFilter
addFirst, addLast, close, filter, initialize, isRelevant, onAfterFilter, onBeforeFilter -
Methods inherited from class ai.platon.pulsar.crawl.parse.ParseFilter
getParams -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Method Detail
-
getConf
final ImmutableConfig getConf()
-
getChildren
List<ParseFilter> getChildren()
-
getParent
ParseFilter getParent()
-
getParentId
Integer getParentId()
-
parse
ParseResult parse(WebPage page)
-
-
-
-