HTTP/2指纹遵循以下方案:
[SETTINGS]|WINDOW_UPDATE|PRIORITY|Pseudo-Header-Order|HEADERS_FRAME|WINDOW_UPDATE
如果您的爬虫被阻止,可能是由于这种识别技术。
Settings Frame |
{ "type": "SETTINGS", "length": 30, "settings": [ "HEADER_TABLE_SIZE = 65536", "ENABLE_PUSH = 0", "MAX_CONCURRENT_STREAMS = 1000", "INITIAL_WINDOW_SIZE = 6291456", "MAX_HEADER_LIST_SIZE = 262144" ] } |
Window Update |
{ "type": "WINDOW_UPDATE", "length": 4, "increment": 15663105 } |
Headers |
{ "type": "HEADERS", "stream_id": 1, "length": 376, "headers": [ ":method: GET", ":authority: tools.scrapfly.io", ":scheme: https", ":path: /api/fp/akamai?extended=1", "sec-ch-ua: \"Not.A/Brand\";v=\"8\", \"Chromium\";v=\"114\", \"Google Chrome\";v=\"114\", "sec-ch-ua-mobile: ?0", "user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36", "sec-ch-ua-platform: \"Windows\", "accept: */*", "origin: https://scrapfly.io", "sec-fetch-site: same-site", "sec-fetch-mode: cors", "sec-fetch-dest: empty", "referer: https://scrapfly.io/", "accept-encoding: gzip, deflate, br", "accept-language: en-US,en;q=0.9,zh-CN;q=0.8,zh;q=0.7" ], "priority": { "weight": 220, "depends_on": 0, "exclusive": 1 } } |