# Used for Excluding Robots from certain urls User-agent: * Disallow: /banner Disallow: /images Disallow: /jobs Disallow: /scripts Disallow: /stats Disallow: /sysmsg