程序包 xin.jiangqiang.entities

类 Crawler

java.lang.Object

xin.jiangqiang.entities.Crawler

所有已实现的接口:

Serializable

直接已知子类:

Page

public class Crawler
extends Object
implements Serializable

定义公共属性和元数据

另请参阅:

序列化表格

构造器概要

构造器

构造器	说明
Crawler(String url)
Crawler(String url, String type)

方法概要

修饰符和类型	方法	说明
Crawler	addSeed(String url)	创建时子类爬虫深度会自动+1
void	addSeeds(List<String> urls, String type)	批量创建子爬虫，批量设置子类类型
boolean	equals(Object o)
Map<String,String>	getBodys()
Map<String,String>	getConfigs()
Map<String,String>	getData()
Map<String,String>	getHeaders()
Map<String,String>	getLines()
String	getMethod()
int	hashCode()
Crawler	initDataFromCrawler(Crawler crawler)	1.
Crawler	setBodys(Map<String,String> bodys)
Crawler	setConfigs(Map<String,String> configs)
Crawler	setData(Map<String,String> others)
Crawler	setHeaders(Map<String,String> headers)
Crawler	setLines(Map<String,String> lines)
Crawler	setMethod(RequestMethod method)

从类继承的方法 java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Crawler

public Crawler(String url)

Crawler

public Crawler(String url,
               String type)

方法详细资料

initDataFromCrawler

public Crawler initDataFromCrawler(Crawler crawler)

1. 从crawler构造Page对象,发送请求之后是Page对象,请求前是Crawler对象 2. 将Page中的元数据复制到Next对象

参数:

crawler - 种子对象，后续爬虫会继承他的设置

返回:

返回调用此方法的对象

setConfigs

public Crawler setConfigs(Map<String,String> configs)

getConfigs

public Map<String,String> getConfigs()

setData

public Crawler setData(Map<String,String> others)

getData

public Map<String,String> getData()

setHeaders

public Crawler setHeaders(Map<String,String> headers)

getHeaders

public Map<String,String> getHeaders()

setBodys

public Crawler setBodys(Map<String,String> bodys)

getBodys

public Map<String,String> getBodys()

setMethod

public Crawler setMethod(RequestMethod method)

getMethod

public String getMethod()

setLines

public Crawler setLines(Map<String,String> lines)

getLines

public Map<String,String> getLines()

addSeed

public Crawler addSeed(String url)

创建时子类爬虫深度会自动+1

参数:

url - url

返回:

返回子爬虫

addSeeds

public void addSeeds(List<String> urls,
                     String type)

批量创建子爬虫，批量设置子类类型

参数:

urls - url列表

type - 类型

equals

public boolean equals(Object o)

覆盖:

equals 在类中 Object

hashCode

public int hashCode()

覆盖:

hashCode 在类中 Object