Search Engine Optimization Forum - SEO Refugee  

Go Back   Search Engine Optimization Forum - SEO Refugee > SEO and Online Marketing > Yahoo, Bing (MSN) and Other Search Engines

 
 
LinkBack Thread Tools Display Modes
Prev Previous Post   Next Post Next
  #1 (permalink)  
Old 01-08-2006, 03:44 PM
Pegster's Avatar
Registered member
 
Join Date: Nov 2005
Location: Ohio
Posts: 52
Pegster is on probation LOLz
Yahoo Bot

I import my logs into a SQL Dbase for later reporting in crystal & i've noticed one thing when i only look at major bot visits... Yahoo seems to hit my robots.txt file all the time, like there will be 4 hits to that inbetween a hit to an actual page. Anyone noticed this? And it seems like they seem to hit the same pages over & over again and not hitting a lot of the interior pages. I have a sitemap and i have tons of links within the site, not sure why it can't seem to find othe pages to hit.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
 

  Search Engine Optimization Forum - SEO Refugee > SEO and Online Marketing > Yahoo, Bing (MSN) and Other Search Engines

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -8. The time now is 10:48 AM. - Contact Us - SEOrefugee.com - a Search Engine Optimization Forum - Top

Powered by vBulletin®
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.
SEO Refugee