Class GenerateComponent
-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.config.Configurable,ai.platon.pulsar.common.config.Parameterized,ai.platon.pulsar.skeleton.crawl.common.LazyConfigurable
public final class GenerateComponent implements Parameterized, LazyConfigurable
The generate component.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public classGenerateComponent.Companion
-
Field Summary
Fields Modifier and Type Field Description private final LoggerLOGprivate final CrawlFilterscrawlFiltersprivate final WebDbwebDbprivate final CrawlUrlFiltersurlFiltersprivate final ChainedUrlNormalizerurlNormalizersprivate final FetchSchedulefetchScheduleprivate final MiscMessageWritermessageWriterprivate ImmutableConfigconfpublic final static GenerateComponent.CompanionCompanion
-
Constructor Summary
Constructors Constructor Description GenerateComponent(CrawlFilters crawlFilters, WebDb webDb, CrawlUrlFilters urlFilters, ChainedUrlNormalizer urlNormalizers, FetchSchedule fetchSchedule, MiscMessageWriter messageWriter, ImmutableConfig conf)
-
Method Summary
Modifier and Type Method Description final LoggergetLOG()final CrawlFiltersgetCrawlFilters()final WebDbgetWebDb()final CrawlUrlFiltersgetUrlFilters()final ChainedUrlNormalizergetUrlNormalizers()final FetchSchedulegetFetchSchedule()final MiscMessageWritergetMessageWriter()ImmutableConfiggetConf()UnitsetConf(ImmutableConfig conf)Unitconfigure(ImmutableConfig conf1)ParamsgetParams()-
-
Constructor Detail
-
GenerateComponent
GenerateComponent(CrawlFilters crawlFilters, WebDb webDb, CrawlUrlFilters urlFilters, ChainedUrlNormalizer urlNormalizers, FetchSchedule fetchSchedule, MiscMessageWriter messageWriter, ImmutableConfig conf)
-
-
Method Detail
-
getLOG
final Logger getLOG()
-
getCrawlFilters
final CrawlFilters getCrawlFilters()
-
getWebDb
final WebDb getWebDb()
-
getUrlFilters
final CrawlUrlFilters getUrlFilters()
-
getUrlNormalizers
final ChainedUrlNormalizer getUrlNormalizers()
-
getFetchSchedule
final FetchSchedule getFetchSchedule()
-
getMessageWriter
final MiscMessageWriter getMessageWriter()
-
getConf
ImmutableConfig getConf()
-
getParams
Params getParams()
-
-
-
-