The MU forums have moved to WordPress.org

what the Googlebot doing? (2 posts)

  1. conpeo
    Member
    Posted 15 years ago #

    I check my blog backend apache log, and surprise me that the http GET command is almost occupy the bandwidth usage, the log file shows alot of data transaction is done by yahoo, MSN, google SEO, etc.

    I realise that the following log record showing that the blog address which is not found in my blog, but googlebot can find it.

    (*HTTP:1.1 Status Code Definitions "200" means OK)

    any idea, my blog site has been spammed or something?

  2. 66.249.70.243 - - [20/Aug/2008:16:44:46 +0800] "GET /buy/hotel/reservation/about/cruises.htm/ HTTP/1.1" 200 1336 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
  3. cafespain
    Member
    Posted 15 years ago #

    Did you have an old site on that domain?

    Try loading that page on your site and check that your 404 error page is actually returning a 404 not found header. If it isn't then you need to set it up to do so, that will "eventually" stop google from looking for those pages.

About this Topic

  • Started 15 years ago by conpeo
  • Latest reply from cafespain