• 请不要在回答技术问题时复制粘贴 AI 生成的内容
cxy1234
V2EX  ›  程序员

数据采集遇到困难了

  •  
  •   cxy1234 · May 24, 2020 · 4129 views
    This topic created in 2354 days ago, the information mentioned may be changed or developed.

    目标网站是,后台返回接口,前端渲染。现在需要爬取 渲染后的样式及数据,除了用 selenium 还有啥其他办法么?

    jugelizi
    jugelizi
    May 24, 2020
    1
    node
    patx
    patx
    May 24, 2020 via Android
    2
    无头浏览器 puppeteer
    Hansah
    Hansah
    May 24, 2020 via Android
    3
    火车浏览器
    gz911122
    gz911122
    May 24, 2020
    4
    webview
    yrj
    yrj
    May 24, 2020 via iPad
    5
    要么渲染 js 要么根据数据自己渲染成指定样式结构
    qinfensky
    qinfensky
    May 24, 2020
    6
    superagent + cheerio
    wzwwzw
    wzwwzw
    May 24, 2020
    7
    Splash.
    ericls
    ericls
    May 25, 2020
    8
    puppeteer +1

    如果是 python 可以用 request-html
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   5356 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 36ms · UTC 02:12 · PVG 10:12 · LAX 18:12 · JFK 21:12
    ♥ Do have faith in what you're doing.