Which Is How To Create Custom Robots TXT Blogger.
What Is Robot.txt File?
According To Moz.
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website. The robots.txt file is part of the the robots exclusion protocol (REP), a group of web standards that regulate how robots crawl the web, access and index content, and serve that content up to users. The REP also includes directives like meta robots, as well as page-, subdirectory-, or site-wide instructions for how search engines should treat links (such as “follow” or “nofollow”).
How To Add Custom Robot.txt to your blog.
1.Go to your blogger blog.
2.Navigate to Settings, Click On Search Preferences,
Click On Custom Robot.txt Edit Then Click Yes. It Will Show Empty Box Enter The Details Below.
User-agent: Mediapartners-Google
User-agent: *
Disallow: /search
Allow: /
Sitemap: https://yourblogurl.com/feeds/posts/default?orderby=UPDATED
Enter The Code And Replace Yourblogurl.com with your blog link. To check your Robot.txt file enter https://yourblogurl.com/robot.txt on your browser.
Note: The Sitemap added in custom robot. Text will only tell the web crawlers about the recent 25 posts. If you want to increase the number of link in your sitemap then replace default sitemap with below one. It will work for first 500 recent posts.
Read Also: Blogger SEO Settings 2019
Read Also: How To Edit Blogger Template With Mobile.
Sitemap1: http://yourblogurl.com/atom.xml?redirect=false&start-index=1&max-results=500
If you have more than 500 published posts in your blog then you can should add this site map too
Sitemap2: http://yourblogurl.com/atom.xml?redirect=false&start-index=500&max-results=1000
After you are done then click on custom robot header tags on same page and set it up according to the picture below.
Conclusion: Finally Come To The End Of The Post How To CREATE CUSTOM ROBOTS TXT BLOGGRR.
Thanks for reading this.
Please Share And Also Click On The Allow Button On This Site Thanks. 🙏🙏
No comments