# All robots will spider the domain User-agent: * Disallow: /websites/ Disallow: /sites/ Disallow: /images/ Disallow: /sales/ Disallow: /databases/ Disallow: /livehelp/