Toolserver-l

toolserver-l@lists.wikimedia.org

1612 discussions

Static dump of German Wikipedia
by Marco Schuster 28 Sep '10

28 Sep '10

Hi all, just a quick status update: The dump is currently running at 2req/s and ignores all pages which have is_redirect set; also I changed the storage method: the new files are appended to /mnt/user-store/dewiki_static/articles.tar, as I noticed I was filling up the inodes of the file system; doing the storage inside a tarball will prevent this and I don't have to waste time downloading the tons of files to my PC, only one huge tarball when its done. I also managed to get a totally stripped down version of the Vector skin file loading an article via JSON (I won't release it now though, it's a damn hack - nothing except loading works, as I have removed every JS file... should be pretty till Sunday). Current dump position is at 92927, stripping out the redirects 53171 articles have really been downloaded, resulting in 770MB of uncompressed tar (I expect gzip or bz2 compression to save lots of space though). For the redirects: how do I get the redirect target page (maybe even the #section)? Marco PS: Are there any *fundamental* differences between the Vector skin files of different languages except the localisation? Could this maybe be converted to Javascript, maybe $("#footer-info-lastmod").html("page was last changed at foobar")? -- VMSoft GbR Nabburger Str. 15 81737 München Geschäftsführer: Marco Schuster, Volker Hemmert http://vmsoft-gbr.de

1 0

Static dump of German Wikipedia
by Marco Schuster 25 Sep '10

25 Sep '10

Hi all, I have made a list of all the 1.9M articles in NS0 (including redirects / short pages) using the Toolserver; now I have the list I'm going to download every single of 'em (after the trial period tonight, I want to see how this works out. I'd like to begin with downloading the whole thing in 3 or 4 days, if noone objects) and then publish a static dump of it. Data collection will be on the Toolserver (/mnt/user-store/dewiki-static/articles/); the request rate will be 1 article per second and I'll download the new files once or twice a day to my home PC, so there should be no problem with the TS or Wikimedia server load. When this is finished in ~ 21-22 days, I'm going to compress them and upload them to my private server (well, if Wikimedia has an archive server, that 'd be better) as a tgz file so others can play with it. Furthermore, though I have no idea if I'll succeed, I plan on hacking a static Vector skin file which will load the articles using jQuery's excellent .load() feature, so that everyone with JS can enjoy a truly offline Wikipedia. Marco PS: When trying to invoke /w/index.php?action=render with an invalid oldid, the server returns HTTP/1.1 200 OK and an error message, but shouldn't this be a 404 or 500? -- VMSoft GbR Nabburger Str. 15 81737 München Geschäftsführer: Marco Schuster, Volker Hemmert http://vmsoft-gbr.de

9 17

Perl 5.10 removed
by River Tarnell 24 Sep '10

24 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Perl 5.10 has now been removed from the Solaris login servers. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkycQ3YACgkQIXd7fCuc5vIoxQCgo5+uWmAWXMZEKNsKxOSxNl6Q wNsAn1ugrNCzBtmBhckvfjTpFLExnu9Q =9o8F -----END PGP SIGNATURE-----

1 0

Python 3.1
by River Tarnell 24 Sep '10

24 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Python 3.1 is now available on the Solaris login servers as /usr/bin/python3 (or /usr/bin/python3.1 to require a specific version). The only module installed so far is "oursql", to provide MySQL connectivity. (MySQLdb is not installed, since it does not work with Python 3.) - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkycQpYACgkQIXd7fCuc5vIRrQCfQIuLAfVLAcPDlMDHGW7lZTNm mWYAoLr89cgB3VMW1X3zAEtTgTGrYsUA =zjqB -----END PGP SIGNATURE-----

1 0

Maintenance notice for Tuesday, 21st
by River Tarnell 22 Sep '10

22 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 This is a maintenance notice for today, Tuesday the 21st. Service | Expected impact - ----------------------------------+------------------------------------- ptolemy: OpenStreetMap | Complete outage for under 10 minutes PostgreSQL (sql-mapnik), | mod_tile, Tirex, | http://toolserver.org/tiles/ | All other services | No impact Start time: Wednesday, 21st September, 12AM (0000h) UTC End time: Wednesday, 21st September, 1AM (0100h) UTC Details: We will upgrade the OS on ptolemy, the OSM database and tile server, to Solaris 10 Update 9. This will require downtime for a reboot after the upgrade is completed. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkyYrFYACgkQIXd7fCuc5vLObwCcClnsS0iHGXc5owmXlHNNJuBS xdAAn2sd2HRT6OnRqIzKHh7s/EQ2GCIG =J9wf -----END PGP SIGNATURE-----

1 1

nightshade reboot
by River Tarnell 21 Sep '10

21 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, nightshade was rebooted at 5:05 AM on Tuesday (UTC) for a kernel update. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkyYPR4ACgkQIXd7fCuc5vLpAQCeNEff17OzRYlfvIXhunm+3+xU QnAAnjByPEDEijD1Pm7waivrNUdhX5QI =N3th -----END PGP SIGNATURE-----

1 0

Mono upgrade on Solaris
by River Tarnell 21 Sep '10

21 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Mono on the Solaris login servers has been upgraded from 2.4.2.2 to 2.6.7. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkyX/5MACgkQIXd7fCuc5vJ7fACfVJDz3q/ZhLtHmfbaqmDjbXMZ kGAAnjqs6m699q31R0LmDTvQcgpFxLwc =GOnY -----END PGP SIGNATURE-----

1 0

Perl upgrade to 5.12.2
by River Tarnell 16 Sep '10

16 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Perl on the Solaris systems will shortly be upgraded from 5.12.1 to 5.12.2. This should have no impact on users. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkySPGEACgkQIXd7fCuc5vLuPQCfawQtGLeDnCqTHC/3kdU/gPCF 1+MAmwdVvKK4tpYdimOeye8iivjvDEVM =5Hr4 -----END PGP SIGNATURE-----

1 0

using local perl
by Ted Timmons 16 Sep '10

16 Sep '10

okay, so installing MediaWiki::API is supposed to be done locally. I'm following the instructions: https://wiki.toolserver.org/view/Perl The problem is that there's no local Config.pm at the given location. In other words, /etc/perl/CPAN/Config.pm in step 3 does not exist. That makes it hard to follow step 4 and beyond. I'm on willow. And about "no perl experts": I've only spent 10 years writing OO perl, I've just always used root access or a CM config that handles packages. I recently bought Randal Schwartz a drink- OTOH, Ward Cunningham then bought me a drink, so I can't complain. -ted

4 3

Removal of Perl 5.10 on Solaris systems
by River Tarnell 16 Sep '10

16 Sep '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Some time ago we changed the default Perl on Solaris login servers to 5.12. Since then, no one has reported any problems with 5.12; we will therefore be removing Perl 5.10 later this week (that is, /usr/bin/perl5.10 and /opt/ts/perl/5.10/bin/perl). Applications that use /usr/bin/perl will not require any changes because of this. - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkyONE8ACgkQIXd7fCuc5vKT0wCfab2WDZbRcGTSE5RidytNxbxJ IEsAni3jzrsn9kdCJ+kWukv49zXAlbvB =iEv0 -----END PGP SIGNATURE-----

2 2

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l