cornelia
V2EX  ›  问与答

[求助]要爬一个网站,但是网站只有 ie 访问才会正常显示数据

  •  
  •   cornelia · Oct 13, 2014 · 3041 views
    This topic created in 4410 days ago, the information mentioned may be changed or developed.
    链接:http://61.143.53.130/zhpubweb/SaleCount3.aspx

    用nodejs+phantomjs可以爬其他页面,
    但是这个页面解决不了,

    请问如何解决,或者有什么思路么?
    thx
    4 replies  •  2014-10-13 10:44:18 +08:00
    kongkongyzt
    kongkongyzt
    Oct 13, 2014 via Android
    1
    修改爬虫的ua?
    bigdude
    bigdude
    Oct 13, 2014❤️1
    2
    直接抓ajax POST请求结果,修改下面链接中的参数就行了

    http://61.143.53.130/zhpubweb/SaleCount3.aspx?readstate=ajax&type=7&year=2014&month=10
    em70
    em70
    Oct 13, 2014
    3
    user-agent
    iam36
    iam36
    Oct 13, 2014 via Android
    4
    改爬虫Header
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   1014 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 30ms · UTC 18:42 · PVG 02:42 · LAX 10:42 · JFK 13:42
    ♥ Do have faith in what you're doing.