We can, but:
This is a request, not an enforcement; bots can and do simply ignore this and crawl the paths there anyway, and;
We want indexers such as bingbot and google's spiders to crawl the resources section for their search indexes, but these are the only kind of bot that actually pay any...