Custom Robots.txt is a file that we add to a blog/site to improve SEO. By this file, we can guide search engine crawler which page to crawl or which not to. With this tutorial, you must Setup Custom Header Tags in Blogger. It is also similar to Custom Robots.txt.
How To Add Custom Robots.txt File in Blogger
1. Sign in to blogger and choose blog which you want to customize.
2. Go to "Search Preferences" > "Settings".
3.
Find "Custom robots.txt" under the "Crawlers and Indexing" section. Click on "Edit" on the right side of the option. Select "Yes". A blank box will appear. Copy the below code and, paste into the box.
4. After that, click on "Save changes".