- "Allow" directives
- wildcards in URLs
- Sitemap Location
- NOODP (don't use ODP information for this page).
But there's nothing from the robots mailing list or the RobotsTxt.org which is a shame.
This is also a test for all site and intranet search crawlers -- any abandoned software will not recognize these new directives.
I'll dig further into this in the next week and provide more analysis and details.