
public class CrawlFilter.Companion

Nested Classes
Modifier and Type	Class	Description

Fields
Modifier and Type	Field	Description
`private final Logger`	`LOG`
`private final Array<String>`	`MEDIA_URL_SUFFIXES`
`private final Array<Pattern>`	`INDEX_PAGE_URL_PATTERNS`
`private final Pattern`	`SEARCH_PAGE_URL_PATTERN`
`private final Array<Pattern>`	`DETAIL_PAGE_URL_PATTERNS`
`private final Pattern`	`MEDIA_PAGE_URL_PATTERN`
`public final static CrawlFilter.Companion`	`INSTANCE`

Constructors
Constructor	Description

Enum Constants
Enum Constant	Description

Modifier and Type	Method	Description
`final PageCategory`	`getPageCategory(String url)`
`final PageCategory`	`guessPageCategory(String url)`	A simple regex rule to sniff the possible category of a web page
`final Boolean`	`keyGreaterEqual(String test, String bound)`
`final Boolean`	`keyLessEqual(String test, String bound)`
`final Logger`	`getLOG()`
`final Array<String>`	`getMEDIA_URL_SUFFIXES()`	TODO : use suffix-urlfilter instead
`final Array<Pattern>`	`getINDEX_PAGE_URL_PATTERNS()`	The follow patterns are simple rule to indicate a url's category, this is a very simple solution, and the result is not accurate
`final Pattern`	`getSEARCH_PAGE_URL_PATTERN()`
`final Array<Pattern>`	`getDETAIL_PAGE_URL_PATTERNS()`
`final Pattern`	`getMEDIA_PAGE_URL_PATTERN()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

 final PageCategory getPageCategory(String url)

guessPageCategory
```
 final PageCategory guessPageCategory(String url)
```
A simple regex rule to sniff the possible category of a web page

 final Boolean keyGreaterEqual(String test, String bound)

 final Boolean keyLessEqual(String test, String bound)

getMEDIA_URL_SUFFIXES
```
 final Array<String> getMEDIA_URL_SUFFIXES()
```
TODO : use suffix-urlfilter instead

getINDEX_PAGE_URL_PATTERNS
```
 final Array<Pattern> getINDEX_PAGE_URL_PATTERNS()
```
The follow patterns are simple rule to indicate a url's category, this is a very simple solution, and the result is not accurate

 final Pattern getSEARCH_PAGE_URL_PATTERN()

 final Array<Pattern> getDETAIL_PAGE_URL_PATTERNS()

 final Pattern getMEDIA_PAGE_URL_PATTERN()

Object CrawlFilter.Companion