Class ScoringFilters
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.config.Parameterized,ai.platon.pulsar.skeleton.crawl.scoring.ScoringFilter
public final class ScoringFilters implements ScoringFilter
-
-
Field Summary
Fields Modifier and Type Field Description private final ImmutableConfigconf
-
Constructor Summary
Constructors Constructor Description ScoringFilters(ImmutableConfig conf)ScoringFilters(List<ScoringFilter> scoringFilters, ImmutableConfig conf)
-
Method Summary
Modifier and Type Method Description final ImmutableConfiggetConf()ParamsgetParams()UnitinitialScore(WebPage page)Calculate a new initial score, used when adding newly discovered pages. UnitinjectedScore(WebPage page)Calculate a new initial score, used when injecting new pages. ScoreVectorgeneratorSortValue(WebPage page, ScoreVector initSort)Calculate a sort value for Generate. UnitdistributeScoreToOutlinks(WebPage page, WebGraph graph, Collection<WebEdge> outgoingEdges, Integer allCount)UnitupdateScore(WebPage page, WebGraph graph, Collection<WebEdge> incomingEdges)UnitupdateContentScore(WebPage page)FloatindexerScore(String url, IndexDocument doc, WebPage page, Float initScore)StringtoString()-
-
Constructor Detail
-
ScoringFilters
ScoringFilters(ImmutableConfig conf)
-
ScoringFilters
ScoringFilters(List<ScoringFilter> scoringFilters, ImmutableConfig conf)
-
-
Method Detail
-
getConf
final ImmutableConfig getConf()
-
getParams
Params getParams()
-
initialScore
Unit initialScore(WebPage page)
Calculate a new initial score, used when adding newly discovered pages.
-
injectedScore
Unit injectedScore(WebPage page)
Calculate a new initial score, used when injecting new pages.
-
generatorSortValue
ScoreVector generatorSortValue(WebPage page, ScoreVector initSort)
Calculate a sort value for Generate.
-
distributeScoreToOutlinks
Unit distributeScoreToOutlinks(WebPage page, WebGraph graph, Collection<WebEdge> outgoingEdges, Integer allCount)
-
updateScore
Unit updateScore(WebPage page, WebGraph graph, Collection<WebEdge> incomingEdges)
-
updateContentScore
Unit updateContentScore(WebPage page)
-
indexerScore
Float indexerScore(String url, IndexDocument doc, WebPage page, Float initScore)
-
-
-
-