Package ai.platon.pulsar.driver
Class Driver
-
- All Implemented Interfaces:
-
java.lang.AutoCloseable
public class Driver implements AutoCloseable
The pulsar driver
-
-
Field Summary
Fields Modifier and Type Field Description private Durationtimeoutprivate final StringscrapeBaseUrlprivate final StringscrapeApiprivate final StringstatusApiprivate final StringstatusesApiprivate final StringuserBaseUriprivate final StringdashboardApiprivate final StringcountApiprivate final StringfetchApiprivate final StringdownloadApiprivate final StringstatusQueryApi
-
Method Summary
Modifier and Type Method Description final DurationgetTimeout()final UnitsetTimeout(Duration timeout)final StringgetScrapeBaseUrl()final StringgetScrapeApi()final StringgetStatusApi()final StringgetStatusesApi()final StringgetUserBaseUri()final StringgetDashboardApi()final StringgetCountApi()final StringgetFetchApi()final StringgetDownloadApi()final StringgetStatusQueryApi()final Stringsubmit(String sql, Integer priority, Boolean asap)Submit an SQL to scrape final List<String>submitAll(Iterable<String> sqls, Integer priority, Boolean asap)Submit SQLs to scrape final Dashboarddashboard()Show my dashboard final ScrapeResponsefindById(String id)Find a scrape response by scrape task id which returned by submit final List<ScrapeResponse>findAllByIds(Iterable<String> ids)Find scrape responses by scrape task ids which returned by submit final Longcount()Count all submitted tasks final List<CompactedScrapeResponse>fetch(Long offset, Integer limit)Fetch limit scrape responses start from offset final Page<CompactedScrapeResponse>download(Integer pageNumber, Integer pageSize)Download scrape responses page by page final GsoncreateGson()Unitclose()-
-
Method Detail
-
getTimeout
final Duration getTimeout()
-
setTimeout
final Unit setTimeout(Duration timeout)
-
getScrapeBaseUrl
final String getScrapeBaseUrl()
-
getScrapeApi
final String getScrapeApi()
-
getStatusApi
final String getStatusApi()
-
getStatusesApi
final String getStatusesApi()
-
getUserBaseUri
final String getUserBaseUri()
-
getDashboardApi
final String getDashboardApi()
-
getCountApi
final String getCountApi()
-
getFetchApi
final String getFetchApi()
-
getDownloadApi
final String getDownloadApi()
-
getStatusQueryApi
final String getStatusQueryApi()
-
submitAll
final List<String> submitAll(Iterable<String> sqls, Integer priority, Boolean asap)
Submit SQLs to scrape
-
findById
final ScrapeResponse findById(String id)
Find a scrape response by scrape task id which returned by submit
-
findAllByIds
final List<ScrapeResponse> findAllByIds(Iterable<String> ids)
Find scrape responses by scrape task ids which returned by submit
-
fetch
final List<CompactedScrapeResponse> fetch(Long offset, Integer limit)
-
download
final Page<CompactedScrapeResponse> download(Integer pageNumber, Integer pageSize)
Download scrape responses page by page
-
createGson
final Gson createGson()
-
-
-
-