User-agent: msnbot Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: ia_archiver Disallow: User-agent: W3C-checklink Disallow: User-agent: gsa-crawler Disallow: User-agent: Googlebot Disallow: User-agent: Teoma Disallow: User-agent: WebCrawler Disallow: User-agent: Robozilla Disallow: User-agent: Indy Library Disallow: / User-agent: * Disallow: /cgi-bin Disallow: /wps/portal/nrcs/site/trainresource/ Disallow: /wps/portal/nrcs/main/trainresource/ Disallow: /wps/portal/nrcs/detail/trainresource/ Disallow: /wps/portal/nrcs/detailfull/trainresource/ Disallow: /wps/portal/nrcs/news/trainresource/ Disallow: /wps/portal/nrcs/sitenav/trainresource/ Disallow: /wps/portal/nrcs/asr/trainresource/ Disallow: /wps/portal/nrcs/list/trainresource/ Disallow: /wps/portal/nrcs/photogallery/trainresource/ Disallow: /wps/portal/nrcs/advancedsearch/trainresource/ Disallow: /wps/portal/nrcs/contactus/trainresource/ Disallow: /wps/portal/nrcs/newsarchives/trainresource/ Disallow: /wps/portal/nrcs/surveylist/trainresource/ Disallow: /wps/portal/nrcs/publications/trainresource/ Disallow: /wps/portal/nrcs/pmreleases/trainresource/ Disallow: /wps/portal/nrcs/rpublications/trainresource/ Disallow: /wps/portal/nrcs/research/trainresource/ Disallow: /wps/portal/nrcs/rca/trainresource/ Disallow: /wps/portal/nrcs/cigsearch/trainresource/