duckmansweb Posted April 1, 2011 Share Posted April 1, 2011 hi guys , ive been watching my 'Customers Online" section and have noticed this robot called" crawling.us.archive.org" crawling my site prety much 24/7 , does anyone know anything about this Robot ? Quote Link to comment Share on other sites More sharing options...
bsmither Posted April 1, 2011 Share Posted April 1, 2011 I believe archive.org is also known as the "Wayback Machine". They take snapshots of webpages and then present them as a series of links - generally one a month for years. You can go back to see what AOL looked like in 1990 or whatever. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.