🦓
ERROR: Spider error processing
作成日:
2021/11/12
1
【3日で学べる】PythonでWebスクレイピング・クローリングを極めよう!(Scrapy、Selenium編)
セクション17 102. SeleniumMiddlewareの初期設定
DEBUG: Crawled (200) <GET http://www.google.com/?hl=ja> (referer: None)
2021-11-12 12:26:23 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.google.com/?hl=ja> (referer: None)
Traceback (most recent call last):
File "/Users/do/.pyenv/versions/anaconda3-2019.10/envs/scrapy_env/lib/python3.8/site-packages/twisted/internet/defer.py", line 858, in _runCallbacks
current.result = callback( # type: ignore[misc]
File "/Users/do/Desktop/projects/google/google/spiders/google_python.py", line 15, in parse
driver = response.meta['driver']
KeyError: 'driver'
2021-11-12 12:26:23 [scrapy.core.engine] INFO: Closing spider (finished)
2021-11-12 12:26:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 220,
初学者です