User-agent: * Disallow: /assets/ Disallow: /cms/ Disallow: /framework/ Disallow: /mysite/ Disallow: /themes/ Disallow: /vendor/