User-Agent: * Disallow: /customer/ Disallow: /db/search.html Disallow: /product/basket.html