All Implemented Interfaces:: ai.platon.pulsar.crawl.CrawlEventHandler , ai.platon.pulsar.crawl.CrawlEventPipelineHandler


public final class DefaultCrawlEventHandler
extends AbstractCrawlEventHandler implements CrawlEventPipelineHandler

Field Summary

Fields
Modifier and Type	Field	Description
`private final UrlAwareFilterPipeline`	`onFilterPipeline`
`private final UrlAwareFilterPipeline`	`onNormalizePipeline`
`private final UrlAwareHandlerPipeline`	`onBeforeLoadPipeline`
`private final UrlAwareHandlerPipeline`	`onLoadPipeline`
`private final UrlAwareWebPageHandlerPipeline`	`onAfterLoadPipeline`
`private final Function1<UrlAware, UrlAware>`	`onFilter`
`private final Function1<UrlAware, UrlAware>`	`onNormalize`
`private final Function1<UrlAware, Unit>`	`onBeforeLoad`
`private final Function1<UrlAware, Unit>`	`onLoad`
`private final Function2<UrlAware, WebPage, Unit>`	`onAfterLoad`

Constructor Summary

Constructors
Constructor	Description
`DefaultCrawlEventHandler(UrlAwareFilterPipeline onFilterPipeline, UrlAwareFilterPipeline onNormalizePipeline, UrlAwareHandlerPipeline onBeforeLoadPipeline, UrlAwareHandlerPipeline onLoadPipeline, UrlAwareWebPageHandlerPipeline onAfterLoadPipeline)`

Method Summary

Modifier and Type	Method	Description
`UrlAwareFilterPipeline`	`getOnFilterPipeline()`
`UrlAwareFilterPipeline`	`getOnNormalizePipeline()`
`UrlAwareHandlerPipeline`	`getOnBeforeLoadPipeline()`
`UrlAwareHandlerPipeline`	`getOnLoadPipeline()`
`UrlAwareWebPageHandlerPipeline`	`getOnAfterLoadPipeline()`
`Function1<UrlAware, UrlAware>`	`getOnFilter()`
`Function1<UrlAware, UrlAware>`	`getOnNormalize()`
`Function1<UrlAware, Unit>`	`getOnBeforeLoad()`
`Function1<UrlAware, Unit>`	`getOnLoad()`
`Function2<UrlAware, WebPage, Unit>`	`getOnAfterLoad()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultCrawlEventHandler

DefaultCrawlEventHandler(UrlAwareFilterPipeline onFilterPipeline, UrlAwareFilterPipeline onNormalizePipeline, UrlAwareHandlerPipeline onBeforeLoadPipeline, UrlAwareHandlerPipeline onLoadPipeline, UrlAwareWebPageHandlerPipeline onAfterLoadPipeline)

Method Detail

getOnFilterPipeline

 UrlAwareFilterPipeline getOnFilterPipeline()

getOnNormalizePipeline

 UrlAwareFilterPipeline getOnNormalizePipeline()

getOnBeforeLoadPipeline

 UrlAwareHandlerPipeline getOnBeforeLoadPipeline()

getOnLoadPipeline

 UrlAwareHandlerPipeline getOnLoadPipeline()

getOnAfterLoadPipeline

 UrlAwareWebPageHandlerPipeline getOnAfterLoadPipeline()

getOnFilter

 Function1<UrlAware, UrlAware> getOnFilter()

getOnNormalize

 Function1<UrlAware, UrlAware> getOnNormalize()

getOnBeforeLoad

 Function1<UrlAware, Unit> getOnBeforeLoad()

getOnLoad
```
 Function1<UrlAware, Unit> getOnLoad()
```

getOnAfterLoad

 Function2<UrlAware, WebPage, Unit> getOnAfterLoad()

Class DefaultCrawlEventHandler

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

DefaultCrawlEventHandler

Method Detail

getOnFilterPipeline

getOnNormalizePipeline

getOnBeforeLoadPipeline

getOnLoadPipeline

getOnAfterLoadPipeline

getOnFilter

getOnNormalize

getOnBeforeLoad

getOnLoad

getOnAfterLoad