Python Scrapy 入门教程

2017-08-23

安装

1	$ pip install Scrapy

创建项目

$ scrapy startproject crawler

New Scrapy project 'crawler', using template directory '/Users/wxnacy/.pyenv/versions/3.5.0/envs/env_lightcircle/lib/python3.5/site-packages/scrapy/templates/project', created in:
    /Users/wxnacy/WebstormProjects/wxnacy.github.io/crawler

You can start your first spider with:
    cd crawler
    scrapy genspider example example.com

通过提示我们可以通过如下命令创建第一个spider

$ cd crawler
$ scrapy genspider youtube youtube.com

Created spider 'youtube' using template 'basic' in module:
  crawler.spiders.youtube

最近热读

Go 判断数组中是否包含某个 item

Vim 高级功能 vimgrep 全局搜索文件

办理北京工作居住证的一些细节

Go 语法错误：Non-declaration statement outside function body

Mac 电脑查看字体文件位置

扫码关注公众号，或搜索公众号“温欣爸比” 及时获取我的最新文章

jsonContent: meta: false pages: false posts: title: true date: true path: true text: false raw: false content: false slug: false updated: false comments: false link: false permalink: false excerpt: false categories: false tags: true