[Foundation-l] robots.txt and archive.org

Milos Rancic millosh at gmail.com
Sun Sep 18 10:29:06 UTC 2011


May someone ask Internet Archive to open histories of the Main Pages
of Wikipedias in their Time Machine? If they harvested it at all.

Their Time Machine is usually the only exact way to find when early
Wikipedias were created, but histories of the pages are blocked
because of our robots.txt.




More information about the wikimedia-l mailing list