Not sure how to use your robots.txt file? Believe it or not, it’s one of the most important files in terms of SEO. You need to use the file to specify which sections of your site should and which should not be accessible to search engines. For example, you don’t need the wp-admin directory to be crawled and indexed by search engines because it’s intended for internal use only. Robots.txt is a plain text (.txt) file that should be placed in the root directory on your server, which means you need to place it in the same folder where you have your website files and folders on the server. You need to specifically call it robots.txt . Otherwise it won’t work. (more…)