Setting Robots Tags on Amazon S3 Objects Robots meta directives (sometimes called "meta tags") are pieces of code that provide crawlers instructions for how to crawl or index web p…