Yahoo has helpfully provided some tips on saving
bandwidth for your sites, Yahoo slurp is known to hit hard on dynamic
sites consuming a lot of bandwidth, Now there is a good solution for
it provided by the yahoo search guys itself,
Some effective features they mention,
Gzipped files
Crawl Delay
Smart Caching:
