All Implemented Interfaces:


public final class CrawlFilter

TODO : configurable

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description
`public class`	`CrawlFilter.Companion`

Field Summary

Fields
Modifier and Type	Field	Description
`private final PageCategory`	`pageType`
`private final String`	`urlFilter`
`private final TextFilter`	`textFilter`
`private final BlockFilter`	`blockFilter`
`private final String`	`startKey`
`private final String`	`endKey`
`private final String`	`reversedStartKey`
`private final String`	`reversedEndKey`
`private final ImmutableConfig`	`conf`
`public final static CrawlFilter.Companion`	`Companion`

Constructor Summary

Constructors
Constructor	Description
`CrawlFilter(ImmutableConfig conf)`

Enum Constant Summary

Enum Constants
Enum Constant	Description

Method Summary

Modifier and Type	Method	Description
`final PageCategory`	`getPageType()`
`final String`	`getUrlFilter()`
`final TextFilter`	`getTextFilter()`
`final BlockFilter`	`getBlockFilter()`
`final String`	`getStartKey()`
`final String`	`getEndKey()`
`final String`	`getReversedStartKey()`
`final String`	`getReversedEndKey()`
`final ImmutableConfig`	`getConf()`
`final WebPage`	`filter(WebPage page)`
`final Boolean`	`testUrlSatisfied(String url)`
`final Boolean`	`testKeyRangeSatisfied(String reversedUrl)`
`final Boolean`	`testTextSatisfied(String text)`
`final Boolean`	`isAllowed(Node node)`
`final Boolean`	`isDisallowed(Node node)`
`final Boolean`	`isDetailUrl(String url)`
`final Boolean`	`isSearchUrl(String url)`
`final Boolean`	`isMediaUrl(String url)`
`final Boolean`	`isIndexUrl(String url)`
`String`	`toString()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail
- CrawlFilter
```
CrawlFilter(ImmutableConfig conf)
```

Method Detail

getPageType
```
 final PageCategory getPageType()
```

getUrlFilter
```
 final String getUrlFilter()
```

getTextFilter
```
 final TextFilter getTextFilter()
```

getBlockFilter
```
 final BlockFilter getBlockFilter()
```

getStartKey
```
 final String getStartKey()
```

getEndKey
```
 final String getEndKey()
```

getReversedStartKey
```
 final String getReversedStartKey()
```

getReversedEndKey
```
 final String getReversedEndKey()
```

getConf
```
 final ImmutableConfig getConf()
```

filter
```
 final WebPage filter(WebPage page)
```

testUrlSatisfied

 final Boolean testUrlSatisfied(String url)

testKeyRangeSatisfied

 final Boolean testKeyRangeSatisfied(String reversedUrl)

testTextSatisfied

 final Boolean testTextSatisfied(String text)

isAllowed
```
 final Boolean isAllowed(Node node)
```

isDisallowed
```
 final Boolean isDisallowed(Node node)
```

isDetailUrl
```
 final Boolean isDetailUrl(String url)
```

isSearchUrl
```
 final Boolean isSearchUrl(String url)
```

isMediaUrl
```
 final Boolean isMediaUrl(String url)
```

isIndexUrl
```
 final Boolean isIndexUrl(String url)
```

toString
```
 String toString()
```

Class CrawlFilter

Nested Class Summary

Field Summary

Constructor Summary

Enum Constant Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

CrawlFilter

Method Detail

getPageType

getUrlFilter

getTextFilter

getBlockFilter

getStartKey

getEndKey

getReversedStartKey

getReversedEndKey

getConf

filter

testUrlSatisfied

testKeyRangeSatisfied

testTextSatisfied

isAllowed

isDisallowed

isDetailUrl

isSearchUrl

isMediaUrl

isIndexUrl

toString