Hi all,
I have a script running collecting data in multiple wikipedia(s), I started
to notice that revision table in lbwiki_p has some incorrect data.
Here is an example:
mysql> select rev_id, rev_user, rev_page, rev_deleted, rev_len,
rev_timestamp from revision where rev_id = 185751;
+--------+----------+----------+-------------+---------+----------------+
| rev_id | rev_user | rev_page | rev_deleted | rev_len | rev_timestamp |
+--------+----------+----------+-------------+---------+----------------+
| 185751 | 580 | 83446 | 0 | NULL | 20061203231418 |
+--------+----------+----------+-------------+---------+----------------+
mysql> select rev_id, rev_page, rev_len from revision where rev_page =
83446 and rev_timestamp < 20061203231418;
+--------+----------+---------+
| rev_id | rev_page | rev_len |
+--------+----------+---------+
| 115478 | 83446 | NULL |
| 118003 | 83446 | NULL |
| 118009 | 83446 | NULL |
| 138010 | 83446 | NULL |
+--------+----------+---------+
According to my understanding if a record exist rev_len shouldn't be NULL,
if the revision deleted then rev_deleted should get flag but rev_length
should remain as it is.
Hope someone can look into this, because people who are doing analysis
might end up getting wrong results.
Best;
--
Anuradha Uduwage (Anu)
First of all thanks for toolserver, it's a great service!
(I posted this question on jira as well but I'm not sure I found a way to
"assign" it to someone and so if anyone saw it. The issue on Jira is at
https://jira.toolserver.org/browse/DBQ-202 )
I have a script which computes statistics on the gender of users in the
different language wikipedias.
https://github.com/volpino/toolserver-scripts/blob/master/python_scripts/ge…
Now it gets some errors for some wikis.
arwiki_p, hewiki_p, ...
It seems in the databases for this wikis (possibly all the wikis in cluster
7, I am not sure) the table "user_properties" is missing (and my script
does a JOIN on that table).
Can you verify if this is the case, please? I have a deadline for writing a
paper based on these data on Friday 15 (tomorrow) and currently I'm missing
the data for few wikis ;(
Below a simple example that shows how the table user_properties is missing
for arwiki (on sql7) and it is not missing on abwiki (on sql3).
Thanks!
------------------------------
sonet@wolfsbane:~/gender_table$ mysql -h sql-s7-user.toolserver.org
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 5754236
Server version: 5.1.66 Source distribution
Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input
statement.
mysql> use arwiki_p;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
^[[ADatabase changed
mysql> show tables LIKE 'user_properties';
Empty set (0.00 sec)
sonet@wolfsbane:~/gender_table$ mysql -h sql-s3-user.toolserver.org
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 5413150
Server version: 5.1.66 Source distribution
Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input
statement.
mysql> use abwiki_p;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> show tables LIKE 'user_properties';
--------------------------------------
Tables_in_abwiki_p (user_properties)
--------------------------------------
user_properties
--
--
Paolo Massa
Email: paolo AT gnuband DOT org
Blog: http://gnuband.org
Hello all,
as announced the s1-cluster will be the next for re-setup. It will begin with
thyme which handles sql-s1-rr at the moment. The re-setup of thyme will begin
today evening or tomorrow and will take the whole weekend. During the time
rosemary will handle sql-s1-rr (and sql-s1-user), so no problems should occur.
Somewhen next week I will move over the user-databases than to re-setup
rosemary – that will cause some read-only-time; I will send another mail for
that.
You can follow the progress at [1].
Sincerely,
DaB.
[1] https://jira.toolserver.org/browse/MNT-1305
--
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885
Hi!
Just a short note to remind you of the upcoming MediaWiki Hackathon in
Amsterdam: http://www.mediawiki.org/wiki/Amsterdam_Hackathon_2013
Marc Pelletier, Sumana Harihareswara, me and *many* others will be there
to meet you: We'll give a status update and a migration workshop for
tool developers. The existing documentation will be updated on-the-fly.
If you want help to get started at the Hackathon, please *get your Labs
Account beforehand*. Here is how:
https://wikitech.wikimedia.org/wiki/Help:Contentshttps://wikitech.wikimedia.org/wiki/Help:Getting_Started
If you happen to be from Austria, you might still want to apply for a
travel scholarship from Wikimedia Austria:
https://www.wikimedia.at/content/stipendien-f%C3%BCr-den-amsterdam-hackatho…
(in German).
Hope to see you there!
Best, Silke
--
Silke Meyer
Systemadministratorin und Projektassistenz Wikidata
Wikimedia Deutschland e.V. | Obentrautstr. 72 | 10963 Berlin
Tel. (030) 219 158 260
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg
unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt
für Körperschaften I Berlin, Steuernummer 27/681/51985.
Hi there!
To support DaB and Nosy, WMDE is ready to pay another person for
toolserver administration. Please spread the word and don't hesitate to
apply!
English: https://www.wikimedia.de/wiki/System_Administrator_%28m/f%29
German: https://www.wikimedia.de/wiki/Systemadministrator_%28m/w%29
Best, Silke
--
Silke Meyer
Systemadministratorin und Projektassistenz Wikidata
Wikimedia Deutschland e.V. | Obentrautstr. 72 | 10963 Berlin
Tel. (030) 219 158 260
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg
unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt
für Körperschaften I Berlin, Steuernummer 27/681/51985.
"Toto, I've a feeling we're not on the toolserver any more."
So, things are progressing at a fair clip; there is now a database
available to the tools, which means that most tools that do not depend
on the presence of the database replicas should be workable in the new
environment. Maintainers are welcome to poke me (by email or on IRC) if
they want to start playing in the new environment, and I'll be glad to
show them around and set them up.
My plate this week is going to be occupied mostly with helping people
with the new environment, setting up puppet classes to subsume the
tools- instances' configuration, and writing documentation aimed at tool
maintainers looking to join the project. (The latter being driven a
great deal by what the actual maintainers do in fact stumble on).
It's a low update week, much of the work this past week and in the next
few is going to be in the "boring gruntwork" category; but that's a good
thing because it means we're reaching cruising altitude. You may now
use your personal electronic devices and move around the cabin; but for
safety reasons, the captain requests that you keep your seatbelt on
whenever you are at your seat.
-- Marc
This year, consider speaking at Open Source Bridge
<http://opensourcebridge.org/> in Portland, Oregon, USA, June 18-21.
OSB is tech talks & hack sessions with hands-on technologists we want,
for Foundation staff recruiting and for volunteer recruiting and
collaboration. Good talks, clueful people, great food. :-)
If you submit a talk and it gets accepted, you can request subsidy from
Wikimedia Foundation
<https://meta.wikimedia.org/wiki/Participation:Support> for your travel
and hotel.
Call for talks:
<http://opensourcebridge.org/blog/2013/03/were-extending-our-call-for-propos…>
They especially encourage inexperienced speakers.
We already have proposals from or featuring Brandon Harris, Andre
Klapper, Trevor & Roan, me, Priyanka Nag, Quim Gil, Alolita Sharma, and
Noopur Raval.
Please forward.
--
Sumana Harihareswara
Volunteer Development Coordinator
Wikimedia Foundation
Hi everyone,
Wikimedia Nederland invites all developers to the Wikimedia Hackathon.
The Wikimedia Hackathon will be in 2013 from 24-26 May. The registration
is now open and also includes the possibility to apply for a travel,
accommodation or full scholarship. You can find the form at
https://docs.google.com/spreadsheet/viewform?formkey=dFg2SmRRbkpxNmxCcFNFdl…
The hackathon is an opportunity for all Wikimedia community developers
and sysadmins to come together, squash bugs and write great new features
& tools. Unlike the previous years (2012, 2011, etc.) this Hackathon
won't be in Berlin, but in Amsterdam.
The event is open to a wide range of developers. We welcome both
seasoned and new developers as well as people working on MediaWiki,
tools, pywikipedia, Wikidata, gadgets, extensions, templates … . Please
suggest and discus topics at
https://www.mediawiki.org/wiki/Amsterdam_Hackathon_2013/Topics .
You can indicate that you're coming at
https://www.mediawiki.org/wiki/Amsterdam_Hackathon_2013/Attendees and/or
https://www.facebook.com/events/167285526755104/ . This doesn't replace
registration, it's just to let others know what you're up to.
Keep an eye on https://www.mediawiki.org/wiki/Amsterdam_Hackathon_2013
for updates!
Maarten
Greetings, programs!
This week's update will be brief, if optimistic:
On the news front, there have been performance and reliability issues
with Gluster than are being worked on by Ryan Lane. He is experimenting
with an upcoming network driver and tweaking with automount timing to
improve the situation. Along with the database replication, the shared
storage is one of the key component of the infrastructure that are going
to receive the most attention in the short term.
There is now a new project (named, predictably enough, "tools") that is
the intended destination of the new architecture for the Tool Labs. We
have a functionnal webservice environment, as well as a workable compute
cluster to support work and long running processes. Already, a few
brave souls have stepped forward to test that new environment; others
are welcome to peek in or join the project with the usual "beta" caveats.
I'm not ready to open the gates entirely yet, since none of the
management is currently automatized (that's a big part of my TODO for
the week); but tools which have no dependencies on access to databases
should already be able to be experimentally moved to the new project.
This week, I plan to concentrate on the first draft of an interface
through which tool maintainers can manage their assets on the project,
and do a first documentation pass regarding how to write and/or move a
tool on the new project.
-- Marc