User-agent: * Disallow: /scripts_css Disallow: /errors Disallow: /clientdocs Disallow: /personal Disallow: /any_other_folder_you_dont_want_crawled