User-agent: * Disallow: /admin Disallow: /500.html Disallow: /404.html Disallow: /422.html Disallow: /my-account Disallow: /login Disallow: /register Disallow: /checkout Disallow: /basket