Prevent search engines from accessing certain content with robots.txt

Sometimes you don’t want Google or other search engines indexing some content on your site. Here’s an article to help set up a robots.txt file.

How to write and submit a robots.txt file