Wednesday, November 7, 2007

Blogger Robot Troubleshooting

Problem

I use Blogger. Why is my robots.txt file blocking everything?

I tried to add a Google Sitemap for my blog and got this error:

URL restricted by robots.txt
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

Bad http://?????.blogspot.com/robots.txt:
User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Disallow: /

Solution:
  1. Go to Settings > Publishing.
  2. Set Send Pings to Yes.
  3. Leave some love in the form of a comment. :-D
Good http://?????.blogspot.com/robots.txt:
User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

Sitemap: http://?????.blogspot.com/feeds/posts/default?orderby=updated

5 comments:

Voyagerfan5761 said...

Hey, hey, hey! Nice post! Glad I (you, really) finally solved the crawling problem I was having. Expect a backlink from me, too. :)

free for all said...

this is not a solution , and how i can change disallow to allow and what is the difference
thanks

Siddhc said...

Wow !!...I really liked your post...good work...do check out my blog at http://robots4all.blogspot.com and write in your comments there !!

cardallya said...

damn man it helped me. i was searching for this from like 4 hours. check out my blog for more latest updates. its http://latestsmscollection.blogspot.com/

SEOtrick said...

But right now I cannot find it. Is it google already remove it.