问题是SPLASH_URL
必须指向本地运行的Splash实例,通常运行在http://localhost:8050
,
而不是在scrapy-splash README中用作示例的值- http://192.168.59.103:8050
它出现在错误日志中:
Retrying(failed 1 times)
OP经过测试curl http://localhost:8050/render.html?url=http%3A%2F%2Fwww.examp????le.com%2F
,有效,所以设置应该说:
SPLASH_URL = 'http://localhost:8050'