[Sean]

I was thinking more about robot.txt, which also play a nice part. Also sitemap concern, you will need to guide them out properly too in order for the search engines to read them carefully.