Yahoo! Help > Search Help >

Related Links · Search Basics Help · Search Indexing Help · Search Ranking Help · Webmaster Resources · Spam and Deletions Help · Sponsor Results Help · Search Preferences & Shortcuts · Local Search Help · Image Search Help · News Search Help · Video Search Help · Audio Search Help · Yahoo! Directory Help · Yahoo! Help Central   Have a question about Yahoo! Search?   Ask Yahoo! Help. Tips

Yahoo! Slurp - Yahoo!'s Web Crawler Why are you crawling my site? How do I prevent my site or certain subdirectories from being crawled? How does the Yahoo! Web Crawler handle redirects? How can I reduce the number of requests you make on my web site? How do I prevent you from indexing certain pages? How do I allow you to index pages, but not place them in your cache? I'm seeing repeated download requests, why is this? Why is your crawler is asking for strange URLs that have never existed on my site? Why can't I find my web pages in your search engine? How does your crawler find documents on my site? Does your crawler follow dynamic links?