🦓 ERROR: Spider error processing
scrapy python
作成日： 2021/11/12
1

【3日で学べる】PythonでWebスクレイピング・クローリングを極めよう！（Scrapy、Selenium編）

セクション17　 102. SeleniumMiddlewareの初期設定

DEBUG: Crawled (200) <GET http://www.google.com/?hl=ja> (referer: None)
2021-11-12 12:26:23 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.google.com/?hl=ja> (referer: None)
Traceback (most recent call last):
  File "/Users/do/.pyenv/versions/anaconda3-2019.10/envs/scrapy_env/lib/python3.8/site-packages/twisted/internet/defer.py", line 858, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
  File "/Users/do/Desktop/projects/google/google/spiders/google_python.py", line 15, in parse
    driver = response.meta['driver']
KeyError: 'driver'
2021-11-12 12:26:23 [scrapy.core.engine] INFO: Closing spider (finished)
2021-11-12 12:26:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 220,
hetare
初学者です