[Foundation-l] robots.txt and archive.org

Daniel ~ Leinad danny.leinad at gmail.com
Sun Sep 18 10:44:04 UTC 2011


Hmmm... a few days ago we didn't have any problems to retrieve history
(2001-2011) of Main Pages of Polish Wikipedia:
http://www.facebook.com/media/set/?set=a.10150309409533189.363981.147056473188
- similar should be with other versions :>

--
Daniel // Leinad


2011/9/18 Milos Rancic <millosh at gmail.com>:
> May someone ask Internet Archive to open histories of the Main Pages
> of Wikipedias in their Time Machine? If they harvested it at all.
>
> Their Time Machine is usually the only exact way to find when early
> Wikipedias were created, but histories of the pages are blocked
> because of our robots.txt.
>
> _______________________________________________
> foundation-l mailing list
> foundation-l at lists.wikimedia.org
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l
>



More information about the foundation-l mailing list