Blocking WordPress Pages from Being Indexed by Google with Robots.txt

The Robots.txt file is a file every WordPress site comes with, which tells Bots and Search Engines which pages you want them to index. It’s more of a request (rather than a demand), but the Robots.txt file is publicly accessible at www.yourdomain.com/robots.txt so be aware the disallowing a page won’t make it hidden from the web. In … Continued