Windows7 Python3 搭建Scrapy 爬虫框架分析

哈哈 阅读:172 2021-03-31 21:06:11 评论:0

Windows7(64位) Python3.7 安装Scrapy 提示如下错误信息:

解决办法:

1.在python库中下载twisted相应的包(.whl文件) 

官网地址:https://www.lfd.uci.edu/~gohlke/pythonlibs/

2、python 通过pip 安装本地whl 软件包。

d:\whl>pip install wheel  #pip 安装whell 
Collecting wheel 
  Downloading https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fb 
e9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl 
Installing collected packages: wheel 
Successfully installed wheel-0.33.1 
 
d:\whl>pip install D:\whl\Twisted-18.7.0-cp37-cp37m-win_amd64.whl   #pip 本地安装**.whl软件

3、python 安装scrapy,并验证是否安装成功

d:\whl>pip install scrapy  #安装scrapy 爬虫框架 
d:\whl>scrapy     #验证scrapy 爬虫框架是否安装成功 
Scrapy 1.6.0 - no active project 
 
Usage: 
  scrapy <command> [options] [args] 
 
Available commands: 
  bench         Run quick benchmark test 
  fetch         Fetch a URL using the Scrapy downloader 
  genspider     Generate new spider using pre-defined templates 
  runspider     Run a self-contained spider (without creating a project) 
  settings      Get settings values 
  shell         Interactive scraping console 
  startproject  Create new project 
  version       Print Scrapy version 
  view          Open URL in browser, as seen by Scrapy 
 
  [ more ]      More commands available when run from project directory 
 
Use "scrapy <command> -h" to see more info about a command

 

声明

1.本站遵循行业规范,任何转载的稿件都会明确标注作者和来源;2.本站的原创文章,请转载时务必注明文章作者和来源,不尊重原创的行为我们将追究责任;3.作者投稿可能会经我们编辑修改或补充。

发表评论
搜索
排行榜
关注我们

一个IT知识分享的公众号