資源簡介
項目應(yīng)用Scrapy框架,爬取51搜學(xué)網(wǎng)學(xué)校數(shù)據(jù),該demo僅作為技術(shù)學(xué)習(xí),勿用于其他渠道。
代碼片段和文件信息
#?-*-?coding:?utf-8?-*-
#?Define?here?the?models?for?your?scraped?items
#
#?See?documentation?in:
#?https://doc.scrapy.org/en/latest/topics/items.html
import?scrapy
class?SchoolspiderItem(scrapy.Item):
????#?define?the?fields?for?your?item?here?like:
????#?學(xué)校名稱
????schoolName?=?scrapy.Field()
????#?學(xué)校類型?中學(xué)、小學(xué)
????schoolType?=?scrapy.Field()
????#?地區(qū)
????schoolRegion?=?scrapy.Field()
????#?學(xué)校屬性?全國重點
????schoolAttribute?=?scrapy.Field()
????#?學(xué)校性質(zhì)?公辦
????schoolProperty?=?scrapy.Field()
????#?學(xué)校地址
????schoolAddress?=?scrapy.Field()
????#?學(xué)校聯(lián)系方式
????schoolMobile?=?scrapy.Field()
????#?學(xué)校省
????schoolProvince?=?scrapy.Field()
????#?學(xué)校市
????schoolCity?=?scrapy.Field()
????#?學(xué)校區(qū)
????schoolArea?=?scrapy.Field()
????pass
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????文件?????????13??2018-12-17?11:23??schoolSpider\.git\COMMIT_EDITMSG
?????文件????????333??2018-12-14?15:48??schoolSpider\.git\config
?????文件?????????73??2018-12-14?15:43??schoolSpider\.git\desc
?????文件????????101??2018-12-17?09:06??schoolSpider\.git\FETCH_HEAD
?????文件?????????23??2018-12-14?15:43??schoolSpider\.git\HEAD
?????文件????????478??2018-12-14?15:43??schoolSpider\.git\hooks\applypatch-msg.sample
?????文件????????896??2018-12-14?15:43??schoolSpider\.git\hooks\commit-msg.sample
?????文件????????189??2018-12-14?15:43??schoolSpider\.git\hooks\post-update.sample
?????文件????????424??2018-12-14?15:43??schoolSpider\.git\hooks\pre-applypatch.sample
?????文件???????1642??2018-12-14?15:43??schoolSpider\.git\hooks\pre-commit.sample
?????文件???????1348??2018-12-14?15:43??schoolSpider\.git\hooks\pre-push.sample
?????文件???????4951??2018-12-14?15:43??schoolSpider\.git\hooks\pre-reba
?????文件???????1239??2018-12-14?15:43??schoolSpider\.git\hooks\prepare-commit-msg.sample
?????文件???????3611??2018-12-14?15:43??schoolSpider\.git\hooks\update.sample
?????文件???????1221??2018-12-17?11:23??schoolSpider\.git\index
?????文件????????240??2018-12-14?15:43??schoolSpider\.git\info\exclude
?????文件????????479??2018-12-17?11:23??schoolSpider\.git\logs\HEAD
?????文件????????479??2018-12-17?11:23??schoolSpider\.git\logs\refs\heads\master
?????文件????????460??2018-12-17?11:23??schoolSpider\.git\logs\refs\remotes\origin\master
?????文件????????123??2018-12-14?15:44??schoolSpider\.git\ob
?????文件????????164??2018-12-14?15:44??schoolSpider\.git\ob
?????文件????1001733??2018-12-17?09:06??schoolSpider\.git\ob
?????文件????????554??2018-12-14?15:44??schoolSpider\.git\ob
?????文件????????419??2018-12-17?09:06??schoolSpider\.git\ob
?????文件????????123??2018-12-17?09:06??schoolSpider\.git\ob
?????文件????????172??2018-12-17?09:06??schoolSpider\.git\ob
?????文件???????1048??2018-12-17?11:23??schoolSpider\.git\ob
?????文件????????220??2018-12-17?09:06??schoolSpider\.git\ob
?????文件????????599??2018-12-14?15:44??schoolSpider\.git\ob
?????文件????????124??2018-12-17?11:23??schoolSpider\.git\ob
............此處省略99個文件信息
評論
共有 條評論