The MU forums have moved to WordPress.org

robots.txt (3 posts)

  1. drmike
    Member
    Posted 16 years ago #

    Per request via email:

    daria.be's robots.txt file

    /staff/ is our help desk login for staff.
    google-etc is the file we use for Sitemap verifications
    anything with a phps is for a thread here or elsewhere.

    Anyone else got anything else in there?

    Thanks,
    -drmike

  2. suleiman
    Member
    Posted 15 years ago #

    drmike, where did you place your robots.txt file?

    Google is still reporting that my sitemap is being blocked by robots.txt

  3. Ovidiu
    Member
    Posted 15 years ago #

    put it into your webroot folder.

    you said you use google webmaster tools, go there there are options for robots.txt you can test it there,... give it a url to your sitemap and test that url against that robots.txt

About this Topic