1.出现的域名问题,可能yield request 中url允许的域名没有添加进去
allowed_domains = [‘www.search.51job.com’,‘www.jobs.51job.com’]
2.可以试试添加dont filter = true
yield scrapy.Request(url=url, callback=self.detail, dont_filter=True)
1.出现的域名问题,可能yield request 中url允许的域名没有添加进去
allowed_domains = [‘www.search.51job.com’,‘www.jobs.51job.com’]
2.可以试试添加dont filter = true
yield scrapy.Request(url=url, callback=self.detail, dont_filter=True)