# All robots will spider the domain User-agent: * Disallow: # Disallow directory /chat/ User-agent: * Disallow: /chat/ # Disallow directory /dev/ User-agent: * Disallow: /dev/ # Disallow directory /templates/ User-agent: * Disallow: /templates/