This is true, but the big win is being able to cull out a list of URLs that have... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

gregable on March 30, 2011 | parent | context | favorite | on: Google indexes Stack Overflow at a rate of 10 requ...

This is true, but the big win is being able to cull out a list of URLs that have not been updated and thus do not need recrawling.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact