lonelygo
V2EX  ›  囧

Baidu 这个去重逻辑是怎么考虑的?

  •  
  •   lonelygo · Jul 21, 2016 · 3627 views
    This topic created in 3763 days ago, the information mentioned may be changed or developed.

    有图有真相。

    2 replies  •  2016-07-21 15:08:53 +08:00
    just4test
    just4test
    Jul 21, 2016
    1
    有 google 为何要用百度
    Esec
    Esec
    Jul 21, 2016 via Android
    2
    每层楼的编号(eg:1#,2#...)处都有个定位到该层的超链接, 然后"那时候的"百度把每个链接都当作一个独立的页面统统爬了一次...
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   4389 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 103ms · UTC 09:17 · PVG 17:17 · LAX 01:17 · JFK 04:17
    ♥ Do have faith in what you're doing.