User-agent: * Disallow: /assets/css Disallow: /assets/images Disallow: /assets/js Disallow: /assets/swf Disallow: /assets/xml Disallow: /parsed/