User-Agent: *# Disallow all crawlers access to certain pages.
Disallow: /adm
Disallow: /admin
Allow: /