[scrapy] 2024-04-29 圈点766
摘要:user_agent(随机)与iptool(IP随机功能)的不同点记录。user_agent与iptool的不同点记录,在scrapy的middlewares.py中
user_agent(随机)与iptool(IP随机功能)的不同点记录,在scrapy的middlewares.py中,user_agent的类可以这样写
from scrapy.downloadermiddlewares.useragent import UserAgentMiddleware
class CustomUserAgentMiddleware(UserAgentMiddleware):
也可以直接
class CustomUserAgentMiddleware(object):
#不用引用
但是:iptool下面这样写是错误的:
from scrapy.downloadermiddlewares.httpproxy import HttpProxyMiddleware
class Ipstool(HttpProxyMiddleware):
只要直接引用即可:
class Ipstool(object):