Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
The last time I looked, I was able to find an image dump from 2007? Now I have a hard time finding that... can someone help me out / point me to a recent torrent?
My 300+G copy from 2007 was deleted in an unfortunate fileserver cleanup, by someone who said "hey, you can always download another copy later." Perhaps I waited too long...
SJ
On Sun, Feb 22, 2009 at 7:49 AM, River Tarnell river@loreley.flyingparchment.org.uk wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
hi,
currently the dump process is a bit broken. what is the Foundation's position on this?
<
(for an example of a problem, there is *no* successful enwiki dump at all on download.wikimedia.org--the last 5 dumps, going back to 2008-03-12, all failed.)
On 2/23/09 5:31 PM, Samuel Klein wrote:
Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
Awesome -- can you work with an rsync3-over-ssh setup? Email me and we'll set it up.
(Reminds me -- Greg, can we make sure we've got yours going again?)
-- brion
Its not at all clear why the english wikipedia dump or other large dumps need to be compressed. It is far more absurd to spend hundreds of days compressing a file than it is to spend tens of days downloading one.
On Tue, Feb 24, 2009 at 10:45 AM, Brion Vibber brion@wikimedia.org wrote:
On 2/23/09 5:31 PM, Samuel Klein wrote:
Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
Awesome -- can you work with an rsync3-over-ssh setup? Email me and we'll set it up.
(Reminds me -- Greg, can we make sure we've got yours going again?)
-- brion
foundation-l mailing list foundation-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l
On Tue, Feb 24, 2009 at 12:56 PM, Brian Brian.Mingus@colorado.edu wrote:
Its not at all clear why the english wikipedia dump or other large dumps need to be compressed. It is far more absurd to spend hundreds of days compressing a file than it is to spend tens of days downloading one.
Um. You're all that keen on downloading 1TB of data rather than 10GB?
On Tue, Feb 24, 2009 at 12:45 PM, Brion Vibber brion@wikimedia.org wrote:
On 2/23/09 5:31 PM, Samuel Klein wrote:
Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
Awesome -- can you work with an rsync3-over-ssh setup? Email me and we'll set it up.
(Reminds me -- Greg, can we make sure we've got yours going again?)
Have someone send me a SSH key. :)
Excellent -- following up offlist. SJ
On Tue, Feb 24, 2009 at 12:45 PM, Brion Vibber brion@wikimedia.org wrote:
On 2/23/09 5:31 PM, Samuel Klein wrote:
Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
Awesome -- can you work with an rsync3-over-ssh setup? Email me and we'll set it up.
(Reminds me -- Greg, can we make sure we've got yours going again?)
-- brion
Commons-l mailing list Commons-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/commons-l
Samuel Klein wrote:
Copying the Commons list.
I am interested in hosting (and running some scripts on) copies of the commons media dump on offline regional servers for offline-reading purposes. This is difficult without an image dump.
The last time I looked, I was able to find an image dump from 2007? Now I have a hard time finding that... can someone help me out / point me to a recent torrent?
My 300+G copy from 2007 was deleted in an unfortunate fileserver cleanup, by someone who said "hey, you can always download another copy later." Perhaps I waited too long...
SJ
Note that now it's not 300GB but 1.6TB. Have disk space ready.