Amazonbot is finally respecting robots.txt

 (xeiaso.net)

160 points | by xena 16 hours ago ago

44 comments