# All robots will spider the domain User-agent: * Disallow: # Disallow directory /cp/ User-agent: * Disallow: /cp/ # Disallow directory /apps/ User-agent: * Disallow: /apps/ # Disallow directory /templates/ User-agent: * Disallow: /templates/ User-agent: Mediapartners-Google* Disallow: