I just saw someone mention Google's robot.txt on twitter. If you go to ggogle.com/robots.txt and scroll to the bottom you'll see this:

User-agent: Kids
Disallow: /tricks
Allow: /treats