All Implemented Interfaces:: ai.platon.pulsar.crawl.LoadEventHandler , ai.platon.pulsar.crawl.LoadEventPipelineHandler


public class DefaultLoadEventHandler
extends AbstractLoadEventHandler implements LoadEventPipelineHandler

Field Summary

Fields
Modifier and Type	Field	Description
`private final UrlFilterPipeline`	`onFilterPipeline`
`private final UrlFilterPipeline`	`onNormalizePipeline`
`private final UrlHandlerPipeline`	`onBeforeLoadPipeline`
`private final WebPageHandlerPipeline`	`onBeforeFetchPipeline`
`private final WebPageHandlerPipeline`	`onAfterFetchPipeline`
`private final WebPageHandlerPipeline`	`onBeforeParsePipeline`
`private final WebPageHandlerPipeline`	`onBeforeHtmlParsePipeline`
`private final WebPageHandlerPipeline`	`onBeforeExtractPipeline`
`private final HtmlDocumentHandlerPipeline`	`onAfterExtractPipeline`
`private final HtmlDocumentHandlerPipeline`	`onAfterHtmlParsePipeline`
`private final WebPageHandlerPipeline`	`onAfterParsePipeline`
`private final WebPageHandlerPipeline`	`onAfterLoadPipeline`
`private final UrlFilter`	`onFilter`
`private final UrlFilter`	`onNormalize`
`private final UrlHandler`	`onBeforeLoad`
`private final WebPageHandler`	`onBeforeFetch`
`private final WebPageHandler`	`onAfterFetch`
`private final WebPageHandler`	`onBeforeParse`
`private final WebPageHandler`	`onBeforeHtmlParse`
`private final WebPageHandler`	`onBeforeExtract`
`private final HtmlDocumentHandler`	`onAfterExtract`
`private final HtmlDocumentHandler`	`onAfterHtmlParse`
`private final WebPageHandler`	`onAfterParse`
`private final WebPageHandler`	`onAfterLoad`

Constructor Summary

Constructors
Constructor	Description
DefaultLoadEventHandler(UrlFilterPipeline onFilterPipeline, UrlFilterPipeline onNormalizePipeline, UrlHandlerPipeline onBeforeLoadPipeline, WebPageHandlerPipeline onBeforeFetchPipeline, WebPageHandlerPipeline onAfterFetchPipeline, WebPageHandlerPipeline onBeforeParsePipeline, WebPageHandlerPipeline onBeforeHtmlParsePipeline, WebPageHandlerPipeline onBeforeExtractPipeline, HtmlDocumentHandlerPipeline onAfterExtractPipeline, HtmlDocumentHandlerPipeline onAfterHtmlParsePipeline, WebPageHandlerPipeline onAfterParsePipeline, WebPageHandlerPipeline onAfterLoadPipeline)

Method Summary

Modifier and Type	Method	Description
`final UrlFilterPipeline`	`getOnFilterPipeline()`
`final UrlFilterPipeline`	`getOnNormalizePipeline()`
`final UrlHandlerPipeline`	`getOnBeforeLoadPipeline()`
`final WebPageHandlerPipeline`	`getOnBeforeFetchPipeline()`
`final WebPageHandlerPipeline`	`getOnAfterFetchPipeline()`
`final WebPageHandlerPipeline`	`getOnBeforeParsePipeline()`
`final WebPageHandlerPipeline`	`getOnBeforeHtmlParsePipeline()`
`final WebPageHandlerPipeline`	`getOnBeforeExtractPipeline()`
`final HtmlDocumentHandlerPipeline`	`getOnAfterExtractPipeline()`
`final HtmlDocumentHandlerPipeline`	`getOnAfterHtmlParsePipeline()`
`final WebPageHandlerPipeline`	`getOnAfterParsePipeline()`
`final WebPageHandlerPipeline`	`getOnAfterLoadPipeline()`
`UrlFilter`	`getOnFilter()`
`UrlFilter`	`getOnNormalize()`
`UrlHandler`	`getOnBeforeLoad()`
`WebPageHandler`	`getOnBeforeFetch()`
`WebPageHandler`	`getOnAfterFetch()`
`WebPageHandler`	`getOnBeforeParse()`
`WebPageHandler`	`getOnBeforeHtmlParse()`
`WebPageHandler`	`getOnBeforeExtract()`	TODO: not used yet
`HtmlDocumentHandler`	`getOnAfterExtract()`	TODO: not used yet
`HtmlDocumentHandler`	`getOnAfterHtmlParse()`
`WebPageHandler`	`getOnAfterParse()`
`WebPageHandler`	`getOnAfterLoad()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultLoadEventHandler

DefaultLoadEventHandler(UrlFilterPipeline onFilterPipeline, UrlFilterPipeline onNormalizePipeline, UrlHandlerPipeline onBeforeLoadPipeline, WebPageHandlerPipeline onBeforeFetchPipeline, WebPageHandlerPipeline onAfterFetchPipeline, WebPageHandlerPipeline onBeforeParsePipeline, WebPageHandlerPipeline onBeforeHtmlParsePipeline, WebPageHandlerPipeline onBeforeExtractPipeline, HtmlDocumentHandlerPipeline onAfterExtractPipeline, HtmlDocumentHandlerPipeline onAfterHtmlParsePipeline, WebPageHandlerPipeline onAfterParsePipeline, WebPageHandlerPipeline onAfterLoadPipeline)

Method Detail

getOnFilterPipeline

 final UrlFilterPipeline getOnFilterPipeline()

getOnNormalizePipeline

 final UrlFilterPipeline getOnNormalizePipeline()

getOnBeforeLoadPipeline

 final UrlHandlerPipeline getOnBeforeLoadPipeline()

getOnBeforeFetchPipeline

 final WebPageHandlerPipeline getOnBeforeFetchPipeline()

getOnAfterFetchPipeline

 final WebPageHandlerPipeline getOnAfterFetchPipeline()

getOnBeforeParsePipeline

 final WebPageHandlerPipeline getOnBeforeParsePipeline()

getOnBeforeHtmlParsePipeline

 final WebPageHandlerPipeline getOnBeforeHtmlParsePipeline()

getOnBeforeExtractPipeline

 final WebPageHandlerPipeline getOnBeforeExtractPipeline()

getOnAfterExtractPipeline

 final HtmlDocumentHandlerPipeline getOnAfterExtractPipeline()

getOnAfterHtmlParsePipeline

 final HtmlDocumentHandlerPipeline getOnAfterHtmlParsePipeline()

getOnAfterParsePipeline

 final WebPageHandlerPipeline getOnAfterParsePipeline()

getOnAfterLoadPipeline

 final WebPageHandlerPipeline getOnAfterLoadPipeline()

getOnFilter
```
 UrlFilter getOnFilter()
```

getOnNormalize
```
 UrlFilter getOnNormalize()
```

getOnBeforeLoad
```
 UrlHandler getOnBeforeLoad()
```

getOnBeforeFetch
```
 WebPageHandler getOnBeforeFetch()
```

getOnAfterFetch
```
 WebPageHandler getOnAfterFetch()
```

getOnBeforeParse
```
 WebPageHandler getOnBeforeParse()
```

getOnBeforeHtmlParse
```
 WebPageHandler getOnBeforeHtmlParse()
```

getOnBeforeExtract
```
 WebPageHandler getOnBeforeExtract()
```
TODO: not used yet

getOnAfterExtract

 HtmlDocumentHandler getOnAfterExtract()

TODO: not used yet

getOnAfterHtmlParse

 HtmlDocumentHandler getOnAfterHtmlParse()

getOnAfterParse
```
 WebPageHandler getOnAfterParse()
```

getOnAfterLoad
```
 WebPageHandler getOnAfterLoad()
```

Class DefaultLoadEventHandler

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

DefaultLoadEventHandler

Method Detail

getOnFilterPipeline

getOnNormalizePipeline

getOnBeforeLoadPipeline

getOnBeforeFetchPipeline

getOnAfterFetchPipeline

getOnBeforeParsePipeline

getOnBeforeHtmlParsePipeline

getOnBeforeExtractPipeline

getOnAfterExtractPipeline

getOnAfterHtmlParsePipeline

getOnAfterParsePipeline

getOnAfterLoadPipeline

getOnFilter

getOnNormalize

getOnBeforeLoad

getOnBeforeFetch

getOnAfterFetch

getOnBeforeParse

getOnBeforeHtmlParse

getOnBeforeExtract

getOnAfterExtract

getOnAfterHtmlParse

getOnAfterParse

getOnAfterLoad