in

HTTP/2 指纹爬取工具

HTTP2 指纹爬取工具

HTTP/2指纹遵循以下方案:

[SETTINGS]|WINDOW_UPDATE|PRIORITY|Pseudo-Header-Order|HEADERS_FRAME|WINDOW_UPDATE

如果您的爬虫被阻止,可能是由于这种识别技术。


Settings Frame
{
  "type": "SETTINGS",
  "length": 30,
  "settings": [
    "HEADER_TABLE_SIZE = 65536",
    "ENABLE_PUSH = 0",
    "MAX_CONCURRENT_STREAMS = 1000",
    "INITIAL_WINDOW_SIZE = 6291456",
    "MAX_HEADER_LIST_SIZE = 262144"
  ]
}

Window Update
{
  "type": "WINDOW_UPDATE",
  "length": 4,
  "increment": 15663105
}

Headers
{
  "type": "HEADERS",
  "stream_id": 1,
  "length": 376,
  "headers": [
    ":method: GET",
    ":authority: tools.scrapfly.io",
    ":scheme: https",
    ":path: /api/fp/akamai?extended=1",
    "sec-ch-ua: \"Not.A/Brand\";v=\"8\", \"Chromium\";v=\"114\", \"Google Chrome\";v=\"114\",
    "sec-ch-ua-mobile: ?0",
    "user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36",
    "sec-ch-ua-platform: \"Windows\",
    "accept: */*",
    "origin: https://scrapfly.io",
    "sec-fetch-site: same-site",
    "sec-fetch-mode: cors",
    "sec-fetch-dest: empty",
    "referer: https://scrapfly.io/",
    "accept-encoding: gzip, deflate, br",
    "accept-language: en-US,en;q=0.9,zh-CN;q=0.8,zh;q=0.7"
  ],
  "priority": {
    "weight": 220,
    "depends_on": 0,
    "exclusive": 1
  }
}

Written by 河小马

河小马是一位杰出的数字营销行业领袖,广告中国论坛的重要成员,其专业技能涵盖了PPC广告、域名停放、网站开发、联盟营销以及跨境电商咨询等多个领域。作为一位资深程序开发者,他不仅具备强大的技术能力,而且在出海网络营销方面拥有超过13年的经验。