Forum Rules - Formats - Spotlights  -  Home - Library - New Additions

[FIXED] why does robots.txt ban ia_archiver?

AnonymousAnonymous
edited July 2014 in Site Issues
winworldpc's robots.txt blocks the Wayback Machine. Why is this?
URL: winworldpc.com/robots.txt

edit by stitch: this is no longer an issue with the new site.

Comments

  • DuffDuff
    I likely did this at some point working on the site ages ago, I probably copied files for a different site accidentally which included said robots.txt.

    There's actually more of the older site on the Wayback Machine via our ancient (but still working) VZE subdomain (winworld.vze.com).
This discussion has been closed.