# robots.txt User-agent: MSNBOT/0.1 (http://search.msn.com/msnbot.htm) Disallow: / User-agent: Googlebot/2.X (+http://www.googlebot.com/bot.html) Disallow: User-agent: Mediapartners-Google* Disallow: User-agent: MSNBot Disallow: / User-agent: msnbot Disallow: / User-agent: UniservalRobot/1.0 Disallow: User-agent: main-Robot Disallow: User-agent: StackRambler Disallow: User-agent: searchpreview Disallow: / User-agent: * Disallow: User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: /