robots.txt wayback machine

edited November 2014 in Site Issues
Whenever I try to view winworldpc through the eayback machine it gives me this error: http://web.archive.org/web/*/http://winworldpc.com

Comments

  • Seems like the robots.txt on the site bans the IA archiver, but I don't see a robots.txt.
  • That message hasn't been there before. Seens like winworldpc removes the robots.txt.
  • most likley the file was lost during the server transfer or some shit like that. but if someone finds a backup then Yipee
  • Whenever I try to view winworldpc through the eayback machine it gives me this error: http://web.archive.org/web/*/http://winworldpc.com

    This has been like this for months on end now. Search the boards I'm pretty sure there's other topics on this. We have not had a robots.txt since the new site and I'm not sure why archive.org is not picking up on that. Regardless in my giant list of things to do around here this has no real priority.
    most likley the file was lost during the server transfer or some shit like that. but if someone finds a backup then Yipee

    I'm not at all a fan of baseless speculation on things you know nothing about. If you don't have the facts, you do not need to add to the topic. I can't emphasize enough that post counts are irrelevant here. You will have the same privileges here whether you have 1 post or 1000 posts.
  • stitch wrote:
    most likley the file was lost during the server transfer or some shit like that. but if someone finds a backup then Yipee

    I'm not at all a fan of baseless speculation on things you know nothing about. If you don't have the facts, you do not need to add to the topic. I can't emphasize enough that post counts are irrelevant here. You will have the same privileges here whether you have 1 post or 1000 posts.
    Furthermore, of all the things that are worth backing up, a 1-2 line robots.txt file is at the bottom of my list.
Sign In or Register to comment.