# robots.txt for http://www.49th.net (updated: 04-APR-2008) User-agent: searchpreview Disallow: / User-agent: SnapPreviewBot Disallow: / User-agent: panscient.com Disallow: / User-agent: msnbot Crawl-delay: 21600 User-agent: * Disallow: /cgi-bin/ # This is a private directory Disallow: /images/ # This is a private directory Disallow: /logs/ # This is a private directory Disallow: /styles/ # This is a private directory