All Implemented Interfaces:
```
public final class CrawlFilters

                    
```
TODO : need full unit test TODO : Move to plugin, urlfilter/contentfilter, etc

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description
`public class`	`CrawlFilters.Companion`

Field Summary

Fields
Modifier and Type	Field	Description
`public final static String`	`CRAWL_FILTER_RULES`
`private final Map<String, String>`	`reversedKeyRanges`
`private final Array<String>`	`maxReversedKeyRange`
`private final List<CrawlFilter>`	`crawlFilters`
`private final ChainedUrlNormalizer`	`urlNormalizers`
`private final CrawlUrlFilters`	`urlFilters`
`private final String`	`scope`
`private final ImmutableConfig`	`conf`
`public final static CrawlFilters.Companion`	`Companion`

Constructor Summary

Constructors
Constructor	Description
`CrawlFilters(ImmutableConfig conf)`
`CrawlFilters(List<CrawlFilter> crawlFilters, ChainedUrlNormalizer urlNormalizers, CrawlUrlFilters urlFilters, String scope, ImmutableConfig conf)`

Enum Constant Summary

Enum Constants
Enum Constant	Description

Method Summary

Modifier and Type	Method	Description
`final Map<String, String>`	`getReversedKeyRanges()`
`final Array<String>`	`getMaxReversedKeyRange()`
`final List<CrawlFilter>`	`getCrawlFilters()`
`final ChainedUrlNormalizer`	`getUrlNormalizers()`
`final CrawlUrlFilters`	`getUrlFilters()`
`final String`	`getScope()`
`final ImmutableConfig`	`getConf()`
`final Boolean`	`isNormalizedValid(HyperlinkPersistable hyperlink)`
`final Boolean`	`isNormalizedValid(String url)`
`final String`	`normalizeToEmpty(String url, String scope)`
`final String`	`normalizeToEmpty(String url)`
`final String`	`normalizeToNull(String url, String scope)`
`final Boolean`	`testUrlSatisfied(String url)`
`final Boolean`	`testTextSatisfied(String text)`
`final Boolean`	`testKeyRangeSatisfied(String reversedUrl)`
`final Boolean`	`isAllowed(Node node)`	TODO : Tricky logic
`final Boolean`	`isDisallowed(Node node)`	TODO : Tricky logic
`final Boolean`	`veryLikelyBeDetailUrl(String url)`
`final Boolean`	`veryLikelyBeIndexUrl(String url)`
`final Boolean`	`veryLikelyBeMediaUrl(String url)`
`final Boolean`	`veryLikelyBeSearchUrl(String url)`	Notice : index url is not a search url even if it contains "search"
`final String`	`toJson()`
`String`	`toString()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlFilters
```
CrawlFilters(ImmutableConfig conf)
```

CrawlFilters

CrawlFilters(List<CrawlFilter> crawlFilters, ChainedUrlNormalizer urlNormalizers, CrawlUrlFilters urlFilters, String scope, ImmutableConfig conf)

Method Detail

getReversedKeyRanges

 final Map<String, String> getReversedKeyRanges()

getMaxReversedKeyRange

 final Array<String> getMaxReversedKeyRange()

getCrawlFilters

 final List<CrawlFilter> getCrawlFilters()

getUrlNormalizers

 final ChainedUrlNormalizer getUrlNormalizers()

getUrlFilters
```
 final CrawlUrlFilters getUrlFilters()
```

getScope
```
 final String getScope()
```

getConf
```
 final ImmutableConfig getConf()
```

isNormalizedValid

 final Boolean isNormalizedValid(HyperlinkPersistable hyperlink)

isNormalizedValid

 final Boolean isNormalizedValid(String url)

normalizeToEmpty

 final String normalizeToEmpty(String url, String scope)

normalizeToEmpty

 final String normalizeToEmpty(String url)

normalizeToNull

 final String normalizeToNull(String url, String scope)

testUrlSatisfied

 final Boolean testUrlSatisfied(String url)

testTextSatisfied

 final Boolean testTextSatisfied(String text)

testKeyRangeSatisfied

 final Boolean testKeyRangeSatisfied(String reversedUrl)

isAllowed
```
 final Boolean isAllowed(Node node)
```
TODO : Tricky logic

isDisallowed
```
 final Boolean isDisallowed(Node node)
```
TODO : Tricky logic

veryLikelyBeDetailUrl

 final Boolean veryLikelyBeDetailUrl(String url)

veryLikelyBeIndexUrl

 final Boolean veryLikelyBeIndexUrl(String url)

veryLikelyBeMediaUrl

 final Boolean veryLikelyBeMediaUrl(String url)

veryLikelyBeSearchUrl
```
 final Boolean veryLikelyBeSearchUrl(String url)
```
Notice : index url is not a search url even if it contains "search"

toJson
```
 final String toJson()
```

toString
```
 String toString()
```

Class CrawlFilters

Nested Class Summary

Field Summary

Constructor Summary

Enum Constant Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

CrawlFilters

CrawlFilters

Method Detail

getReversedKeyRanges

getMaxReversedKeyRange

getCrawlFilters

getUrlNormalizers

getUrlFilters

getScope

getConf

isNormalizedValid

isNormalizedValid

normalizeToEmpty

normalizeToEmpty

normalizeToNull

testUrlSatisfied

testTextSatisfied

testKeyRangeSatisfied

isAllowed

isDisallowed

veryLikelyBeDetailUrl

veryLikelyBeIndexUrl

veryLikelyBeMediaUrl

veryLikelyBeSearchUrl

toJson

toString