-
- All Implemented Interfaces:
-
java.lang.AutoCloseable
public interface Crawler implements AutoCloseable
-
-
Method Summary
Modifier and Type Method Description abstract Unitawait()Await for all tasks be done abstract IntegergetId()The crawl id abstract StringgetName()The crawl name abstract LoadOptionsgetDefaultOptions()The default load options StringgetDefaultArgs()abstract Function2<Integer, UrlAware, Duration>getRetryDelayPolicy()Delay policy for retry tasks abstract UnitsetRetryDelayPolicy(Function2<Integer, UrlAware, Duration> retryDelayPolicy)Delay policy for retry tasks -
-
Method Detail
-
getDefaultOptions
abstract LoadOptions getDefaultOptions()
The default load options
-
getDefaultArgs
String getDefaultArgs()
-
getRetryDelayPolicy
abstract Function2<Integer, UrlAware, Duration> getRetryDelayPolicy()
Delay policy for retry tasks
-
setRetryDelayPolicy
abstract Unit setRetryDelayPolicy(Function2<Integer, UrlAware, Duration> retryDelayPolicy)
Delay policy for retry tasks
-
-
-
-