Wikitech-l July 2013

wikitech-l@lists.wikimedia.org

158 participants
162 discussions

Re: [Wikitech-l] [Wikimedia-l] Updates on VE data analysis
by James Salsman 27 Jul '13

27 Jul '13

On Fri, Jul 26, 2013 at 7:28 PM, Dario Taraborelli < dtaraborelli(a)wikimedia.org> wrote: >... > We do have a graph of total hourly edits on enwiki across mainspaces here: > http://ee-dashboard.wmflabs.org/graphs/enwiki_edits_api - it's trivial to bin > by day and filter to the main namespace only, I'll add this to my todo list. Thank you! Here is a daily graph of edits by source and visual editor with totals: http://i.imgur.com/2f0tmEu.png It would be great to know what the average total edits per day was in June.

1 0

Re: [Wikitech-l] [Pywikipedia-l] We are officially using Gerrit now :)
by Merlijn van Deen 27 Jul '13

27 Jul '13

On 26 July 2013 23:35, Amir Ladsgroup <ladsgroup(a)gmail.com> wrote: > SVN server is now read-only and I made a test commit in gerrit system > [1] you can read more about the migration in the blog post [2] I also just shut down the SVN-to-git migration script! some > changes are made too: > *"pywikibot-commits" mailing list are created and replaced > "pywikipedia-svn" you can join in [3] (we are working on importing > users from the old mailing list) this mailing list announces when a > change merges > *Nightly distributor is up now [4] you can download core and compat > (with their submoduls) in tar.gz and .zip files and you can browse > into the codes too [5] > *A manual is provided for using and hacking in this new system [6] > Thanks for all your help, Amir (and all others who helped!)! Merlijn

1 0

Announcement: Mark y Markus leading MediaWiki Release Management
by Greg Grossmeier 27 Jul '13

27 Jul '13

Full announcement on the blog: http://blog.wikimedia.org/2013/07/26/future-third-party-releases-mediawiki/ > Today, the Wikimedia Foundation is pleased to announce that we have > contracted with two long-time members of the MediaWiki community–Mark > Hershberger and Markus Glaser–to manage and drive forward third-party > focused releases of MediaWiki. > Over a month ago, the Wikimedia Foundation sent out a request for > proposals (RFP) to help us fill an important and underserved role in > the development of MediaWiki. Two very solid proposals were produced, > the community weighed in with questions and comments, and there was an > open IRC office hour with the authors and interested community > members. The Wikimedia Foundation is pleased with the outcome of this > RFP and excited to begin this new chapter in the life of MediaWiki. Join me in congratulating Mark and Markus! Greg -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |

6 5

Help me write the July monthly report
by Sumana Harihareswara 26 Jul '13

26 Jul '13

I need to start assembling the July Wikimedia engineering report next week so we can put it out on Friday August 2nd. https://www.mediawiki.org/wiki/Wikimedia_engineering_report/2013/July If you use https://www.mediawiki.org/wiki/Wikimedia_Engineering/Project_documentation_… to add a summary of what a particular team did in July, I'll fix typos and grammar, make your writing more readable, and prepare the plain-English summary. Thanks for your help! I'd love updates by the end of Wednesday, July 31st so I can work on it Thursday and send it out Friday. -- Sumana Harihareswara Engineering Community Manager Wikimedia Foundation P.S. Usually Guillaume does this but he's busy on the VisualEditor rollout.

1 0

Re: [Wikitech-l] [MediaWiki-l] Announcement: Mark y Markus leading MediaWiki Release Management
by Markus Glaser 26 Jul '13

26 Jul '13

Wjhonson, you can find the log here: http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-office/20130620.txt Cheers, Markus -----Ursprüngliche Nachricht----- Von: mediawiki-l-bounces(a)lists.wikimedia.org [mailto:mediawiki-l-bounces@lists.wikimedia.org] Im Auftrag von Wjhonson Gesendet: Freitag, 26. Juli 2013 18:57 An: mediawiki-l(a)lists.wikimedia.org Cc: wikitech-l(a)lists.wikimedia.org; mediawiki-announce(a)lists.wikimedia.org Betreff: Re: [MediaWiki-l] Announcement: Mark y Markus leading MediaWiki Release Management It would be helpful if someone could link to the IRC log of this -----Original Message----- From: Yury Katkov <katkov.juriy(a)gmail.com> To: MediaWiki announcements and site admin list <mediawiki-l(a)lists.wikimedia.org> Cc: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>; mediawiki-announce <mediawiki-announce(a)lists.wikimedia.org> Sent: Fri, Jul 26, 2013 9:53 am Subject: Re: [MediaWiki-l] Announcement: Mark y Markus leading MediaWiki Release Management It's great that Wikimedia Foundation have started to care more about 3rd parties! ----- Yury Katkov, WikiVote On Fri, Jul 26, 2013 at 7:41 PM, Greg Grossmeier <greg(a)wikimedia.org> wrote: > Full announcement on the blog: > http://blog.wikimedia.org/2013/07/26/future-third-party-releases-media > wiki/ > >> Today, the Wikimedia Foundation is pleased to announce that we have >> contracted with two long-time members of the MediaWiki community–Mark >> Hershberger and Markus Glaser–to manage and drive forward third-party >> focused releases of MediaWiki. > >> Over a month ago, the Wikimedia Foundation sent out a request for >> proposals (RFP) to help us fill an important and underserved role in >> the development of MediaWiki. Two very solid proposals were produced, >> the community weighed in with questions and comments, and there was >> an open IRC office hour with the authors and interested community >> members. The Wikimedia Foundation is pleased with the outcome of this >> RFP and excited to begin this new chapter in the life of MediaWiki. > > Join me in congratulating Mark and Markus! > > Greg > > -- > | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | > | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D | > > _______________________________________________ > MediaWiki-l mailing list > MediaWiki-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mediawiki-l _______________________________________________ MediaWiki-l mailing list MediaWiki-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l _______________________________________________ MediaWiki-l mailing list MediaWiki-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l

1 0

Listing missing words of wiktionnaries
by Mathieu Stumpf 26 Jul '13

26 Jul '13

Hello, Here is what I would like to do : generating reports which give, for a given language, a list of words which are used on the web with a number evaluating its occurencies, but which are not in a given wiktionary. How would you recommand to implemente that within the wikimedia infrastructure? -- Association Culture-Libre http://www.culture-libre.org/

6 6

Pywikipediabot migrating to git today
by Sumana Harihareswara 26 Jul '13

26 Jul '13

Today the pywikipedia project is migrating from Subversion to Git. If you operate a bot, and you are currently checking out pywikipedia's source code from Subversion, please see http://www.mediawiki.org/wiki/Manual:Pywikipediabot/Gerrit to learn how to switch. Thank you, pywikipediabot community, for this important tool! I hope you get even more contributions after switching to Git. -Sumana -------- Original Message -------- Subject: [Wikitech-ambassadors] Pywikipediabot is migrating to git Date: Tue, 23 Jul 2013 20:38:18 +0430 From: Amir Ladsgroup <ladsgroup(a)gmail.com> Reply-To: Coordination of technology deployments across languages/projects <wikitech-ambassadors(a)lists.wikimedia.org> To: wikitech-ambassadors(a)lists.wikimedia.org Hi folks, As you probably know pywikipedia is migrating to git and after 26 July SVN checkouts can't be updated so if bot operators don't switch to git, their bots might not work properly. I already sent global message for all targets but It's good to inform local bot operators and put a message in bots' noticeboards There is a blog post: http://blog.wikimedia.org/2013/07/23/pywikipediabot-moving-to-git-on-july-2… A technical manual for bot operators: http://www.mediawiki.org/wiki/Manual:Pywikipediabot/Gerrit If people have question, they can ask in mailing list or IRC channel of pywikipedia Best -- Amir _______________________________________________ Wikitech-ambassadors mailing list Wikitech-ambassadors(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors

1 0

Happy Sysadmin Appreciation Day!
by Manuel Schneider 26 Jul '13

26 Jul '13

my congratulations and all the best! /Manuel -- Wikimedia CH - Verein zur Förderung Freien Wissens Lausanne, +41 (21) 34066-22 - www.wikimedia.ch

2 1

New PATCH_TO_REVIEW status in Wikimedia Bugzilla
by Andre Klapper 26 Jul '13

26 Jul '13

Hi, as a result of the discussion in [1] we now have a PATCH_TO_REVIEW status in Bugzilla, which has replaced the "patch-in-gerrit" keyword. The plan is to soon make Gerrit set this status automatically in a bug report in Bugzilla (via the patch in [2]) when a patch mentions a bug number (see the commit message guidelines in [3]). Hence knowing which bug report already has some kind of patch to work with will become less error-prone and less "untidy". As before, people working on fixing a bug report are very welcome to set themselves as the assignee of the bug report. andre PS: Related: The legacy keywords "patch", "patch-need-review" [4] and "patch-reviewed" continue to exist for older tickets which have old patches in Bugzilla (which could be reviewed and transferred to Gerrit if they still make sense), as there's no easy solution to that problem. [1] http://lists.wikimedia.org/pipermail/wikitech-l/2013-June/069805.html [2] https://gerrit.wikimedia.org/r/#/c/75834/ [3] http://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines [4] https://bugzilla.wikimedia.org/buglist.cgi?keywords=patch-need-review&keywo… -- Andre Klapper | Wikimedia Bugwrangler http://blogs.gnome.org/aklapper/

1 2

dirty diffs and VE
by John Vandenberg 26 Jul '13

26 Jul '13

On Wed, Jul 24, 2013 at 2:06 AM, Subramanya Sastry <ssastry(a)wikimedia.org> wrote: > Hi John and Risker, > > First off, I do want to once again clarify that my intention in the previous > post was not to claim that VE/Parsoid is perfect. It was more that we've > fixed sufficient bugs at this point that the most significant "bugs" (bugs, > not missing features) that need fixing (and are being fixed) are those that > have to do with usability tweaks. How do you know that? Have you performed automated tests on all Wikipedia content? Or are you waiting for users to find these bugs? > My intention in that post was also not > one to put some distance between us and the complaints, just to clarify that > we are fixing things as fast as we can and it can be seen in the recent > changes stream. > > John: specific answers to the edit diffs you highlighted in your post. I > acknowledge your intention to make sure we dont make false claims about > VE/Parsoid's usability. Thanks for taking the time for digging them up. > My answers below are made with an intention of figuring out what the issues > are so they can be fixed where they need to be. > > > On 07/23/2013 02:50 AM, John Vandenberg wrote: >> >> On Tue, Jul 23, 2013 at 4:32 PM, Subramanya Sastry >> <ssastry(a)wikimedia.org> wrote: >>> >>> On 07/22/2013 10:44 PM, Tim Starling wrote: >>>> >>>> Round-trip bugs, and bugs which cause a given wikitext input to give >>>> different HTML in Parsoid compared to MW, should have been detected >>>> during automated testing, prior to beta deployment. I don't know why >>>> we need users to report them. >>> >>> >>> 500+ edits are being done per hour using Visual Editor [1] (less at this >>> time given that it is way past midnight -- I have seen about 700/hour at >>> times). I did go and click on over 100 links and examined the diffs. I >>> did >>> that twice in the last hour. I am happy to report clean diffs on all >>> edits >>> I checked both times. >>> >>> I did run into a couple of nowiki-insertions which >>> is, strictly speaking not erroneous and based on user input, but is more >>> a >>> usability issue. >> >> What is a dirty diff? One that inserts junk unexpectedly, unrelated >> to the user's input? > > > That is correct. Strictly speaking, yes, any changes to the wikitext markup > that arose from what the user didn't change. > >> The broken table injection bugs are still happening. >> >> >> https://en.wikipedia.org/w/index.php?title=Sai_Baba_of_Shirdi&curid=144175&… >> >> If the parser isnt going to be fixed quickly to ignore tables it >> doesnt understand, we need to find the templates and pages with these >> broken tables - preferably using SQL and heuristics and fix them. The >> same needs to be done for all the other wikis, otherwise they are >> going to have the same problems happening randomly, causing lots of >> grief. > > > This maybe related to this: > https://bugzilla.wikimedia.org/show_bug.cgi?id=51217 and I have a tentative > fix for it as of y'day. Fixes are of course appreciated. The pace of bugfixes is not the problem ... > VE and Parsoid devs have put in a lot and lot of effort to recognize broken > wikitext source, fix it or isolate it, My point was that you dont appear to be doing analysis of how of all Wikipedia content is broken; at least I dont see a public document listing which templates and pages are causing the parser problems, so the communities on each Wikipedia can fix them ahead of deployment. I believe there is bug about automated testing of the parser against existing pages, which would identify problems. I scanned the Spanish 'visualeditor' tag's 50 recentchanges earlier and found a dirty diff, which I believe hasnt been raised in bugzilla yet. https://bugzilla.wikimedia.org/show_bug.cgi?id=51909 50 VE edits on eswp is more than one day of recentchanges. Most of the top 10 wikis have roughly the same level of testing going on. That should be a concern. The number of VE edits is about to increase on another nine Wikipedias, with very little real impact analysis having been done. That is a shame, because the enwp deployment has provided us with a list of problems which will impact those wikis if they are using the same syntax, be it weird or broken or otherwise troublesome. > and protect it across edits, and > roundtrip it back in original form to prevent corruption. I think we have > been largely successful but we still have more cases to go that are being > exposed here which we will fix. But, occasionally, these kind of errors do > show up -- and we ask for your patience as we fix these. Once again, this > is not a claim to perfection, but a claim that this is not a significant > source of corrupt edits. But, yes even a 0.1% error rate does mean a big > number in the absolute when thousands of pages are being edited -- and we > will continue to pare this down. Is 0.1% a real data point, or a stab in the dark? Because I found two in 100 on enwp; Robert found at least one in 200 on enwp; and I found 1 in 50 on eswp. >> In addition to nowikis, there are also wikilinks that are not what the >> user intended >> >> >> https://en.wikipedia.org/w/index.php?title=Ben_Tre&curid=1822927&diff=56543… >> >> https://en.wikipedia.org/w/index.php?title=Celton_Manx&curid=28176434&diff=… > > > You are correct, but this is not a dirty diff. I dont want to claim this is > an user error entirely -- but a combination of user and software error. fwiw, I wasnt claiming these or the ones that followed were dirty diffs; these are other problems which the software is a contributor to, *other* than the nowiki cases we know so well. >> Here is three edits to try to add a section header and a sentence, >> with a wikilink in the section header. >> (In the process they added other junk into the page, probably >> unintentionally.) >> >> >> https://en.wikipedia.org/w/index.php?title=Port_of_Davao&action=history&off… > > What is the problem here exactly? (that is a question, not a challenge). > The user might have entered those newlines as well. The VE UI is confusing, and did many silly things during those edits. The user had to resort to editing in source editor to clean it up. Step through the diffs. -- John Vandenberg

5 18

← Newer
1
2
3
4
5
6
7
8
9
...
17
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l July 2013