User-Agent: *# Disallow all crawlers access to certain pages. Disallow: /adminkp Disallow: /*ref=* Allow: /