scrapy - cannot import name _parse_proxy (urllib2) -
i trying use scrapy python 2 , got error,
file "/library/python/2.7/site-packages/twisted/internet/defer.py", line 1386, in _inlinecallbacks result = g.send(result) file "/library/python/2.7/site-packages/scrapy/crawler.py", line 95, in crawl six.reraise(*exc_info) file "/library/python/2.7/site-packages/scrapy/crawler.py", line 77, in crawl self.engine = self._create_engine() file "/library/python/2.7/site-packages/scrapy/crawler.py", line 102, in _create_engine return executionengine(self, lambda _: self.stop()) file "/library/python/2.7/site-packages/scrapy/core/engine.py", line 69, in __init__ self.downloader = downloader_cls(crawler) file "/library/python/2.7/site-packages/scrapy/core/downloader/__init__.py", line 88, in __init__ self.middleware = downloadermiddlewaremanager.from_crawler(crawler) file "/library/python/2.7/site-packages/scrapy/middleware.py", line 58, in from_crawler return cls.from_settings(crawler.settings, crawler) file "/library/python/2.7/site-packages/scrapy/middleware.py", line 34, in from_settings mwcls = load_object(clspath) file "/library/python/2.7/site-packages/scrapy/utils/misc.py", line 44, in load_object mod = import_module(module) file "/system/library/frameworks/python.framework/versions/2.7/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) file "/library/python/2.7/site-packages/scrapy/downloadermiddlewares/httpproxy.py", line 4, in <module> urllib2 import _parse_proxy importerror: cannot import name _parse_proxy
i have urllib2 installed
name: urllib2 version: 1498656401.94 summary: checking out typosquatting state of pypi home-page: https://github.com/benjaoming author: benjamin bach author-email: benjamin@overtag.dk license: mit location: /usr/local/lib/python2.7/site-packages requires:
i have tried uninstalling , reinstalling urllib2 , requests.
you have 2 different python environments. scrapy seems live in /library/python/2.7/site-packages/scrapy
while urllib2 lives in /usr/local/lib/python2.7/site-packages
.
Comments
Post a Comment