scrapy spider框架download下来就可以用

一.通过命令行创建scrapy项目

1.scrapy startproject project_Spider

二.通过命令行创建spider

1.scrapy genspider firstspider

2.定义需要抓取的字段，在items.py文件中对目标字段进行定义

# Define here the models for your scraped items
#
# See documentation in:
# https://docs.scrapy.org/en/latest/topics/items.htmlimport scrapyclass ProjectSpiderItem(scrapy.Item):# define the fields for your item here like:link=scrapy.Field()title = scrapy.Field()timeDate=scrapy.Field()pag