Wikitech-l July 2016

wikitech-l@lists.wikimedia.org

81 participants
87 discussions

logstash.wikimedia.org upgraded
by Erik Bernhardson 19 Jul '16

19 Jul '16

Kibana, the software running logstash.wikimedia.org, as well as elasticsearch, the server behind the scenes storing all the logs, have both been upgraded today to their latest versions. Several historical indices could not be directly loaded into the new servers and instead have been dumped and are being reloaded. This reloading process may take some time, so please be patient. The data will be there sooner or later :) Play around with them, and create tickets in the wikimedia-logstash project for any issues you find.

1 0

The Revision Scoring weekly update
by Amir Ladsgroup 19 Jul '16

19 Jul '16

Hey, This is the (12 + 1)th [1] weekly update from revision scoring team that we have sent to this mailing list. New developments: - ORES review tool is deployed as a beta feature in Turkish Wikipedia. Now six Wikis have this tool. [2] - CopyPatrol tool soon will show ORES scores if they pass a certain threshold. [3] - We are talking about integration with Detox, feel free to chime in. [4] Maintenance and robustness: - Currently we are dealing with increasing memory pressure on scb nodes. Actions we did to reduce this pressure: - We migrated most of RandomForrest models to GradientBoosting, which will reduce memory pressure greatly without affecting accuracy of models noticeably [5] - It seems there is a memory leak issue with celery. We bypassed that by setting a periodic restart of workers. [6] - We reduced maximum number of precaching requests in order to prevent spikes that might cause memory pressure on other services. [7] - We reduced number of web processes to 2/3. It is still fine. [8] - We finished up the refactor and it will soon goes to the production cluster. [9] - Damaging and goodfaith models had issue in Dutch Wikipedia. Got fixed. [10] - Our metrics collector now sends timed requests. We will have a dashboard in grafana for that soon. [11] - There will be a link to "ORES review tool" page [12] in legend of RecentChanges and Watchlist. [13] - When revscoring fails for any unknown reason, ORES return a proper message now. [14] - We fixed a puppet issue that caused trouble while creating new web instances. Got fixed [15] 1. It's 13. We are not superstitious, just kidding ;) 2. https://phabricator.wikimedia.org/T139992 3. https://phabricator.wikimedia.org/T139009 4. https://phabricator.wikimedia.org/T139007 5. https://phabricator.wikimedia.org/T139963 6. https://phabricator.wikimedia.org/T140020 7. https://gerrit.wikimedia.org/r/299559 8. https://gerrit.wikimedia.org/r/298739 9. https://github.com/wiki-ai/ores/pull/155 10. https://phabricator.wikimedia.org/T140038 11. https://phabricator.wikimedia.org/T137442 12. https://www.mediawiki.org/wiki/ORES_review_tool 13. https://phabricator.wikimedia.org/T140361 14. https://phabricator.wikimedia.org/T140301 15. https://phabricator.wikimedia.org/T140265 Sincerely, Amir from the Revision Scoring team

1 0

Re: [Wikitech-l] [Wikimedia-l] 100k articles written with Content Translation tool
by Pine W 19 Jul '16

19 Jul '16

Nice to see. Thank you, Runa and Language Engineering. I like video clip too. Thank you, Victor. Pine On Jul 18, 2016 04:15, "Runa Bhattacharjee" <rbhattacharjee(a)wikimedia.org> wrote: > Hello everyone, > > Our barely 1-year old Content Translation Tool just passed 100,000 > translations < > https://en.wikipedia.org/wiki/Special:ContentTranslationStats>. > We've made a video to celebrate the achievement: > Wikimedia Commons: > > https://commons.wikimedia.org/wiki/File:The_Wikipedia_Content_Translation_T… > Facebook: > https://www.facebook.com/wikipedia/ > Twitter: > https://twitter.com/Wikipedia/status/754377307377197060 > YouTube: > https://www.youtube.com/watch?v=3btQ5fpn4sA > Vimeo: > https://vimeo.com/174526242 > > You can read more about it on the blog: > https://blog.wikimedia.org/2016/07/16/content-translation-milestone/ > > Thanks > Runa > > -- > Language Engineering Manager > Outreach and QA Coordinator > Wikimedia Foundation > _______________________________________________ > Wikimedia-l mailing list, guidelines at: > https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines > New messages to: Wikimedia-l(a)lists.wikimedia.org > Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, > <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>

1 0

Discovery Weekly Update for the week starting 2016-07-11
by Chris Koerner 16 Jul '16

16 Jul '16

Hello again, I hope your day is going well. Here is this week's update from the Discovery department. == Search == * Mikhail completed a review of the language-identification A/B test (using TextCat). The full report is on Commons. [1] * Trey has more language-identification–related stuff: notes on how to introduce confidence to TextCat [2] (comments and ideas especially welcome!), a re-review of the languages of poorly performing queries on English Wikipedia [3] using our now-standard corpus creation process (TL; DR: quite similar to earlier results); and similar first-time reports for Portuguese and Russian Wikipedias [4], with Japanese and Indonesian in the pipeline. * Trey and Jan collaborated on a new design of the TextCat demo [5] * Team discussing deploying the new TextCat language detection to wikis: en, it, fr, de, es with more language wikis to come in the future [6] * a cute picture of a cat and dog, just because [7] == Maps == * Map's geoshapes service is now available in graphs: Interactive maps with regions [8] * Wikivoyage map customizations have moved into the extension code, now available on all WV languages. Customize it via MediaWiki:Kartographer.js and MediaWiki:Kartographer.css [9] [10] == Wikipedia.org Portal== * Conversation with the community continuing for new Wikipedia.org portal page layout with a new language by article count dropdown. [11] ** The page has been translated, so far, in 8 languages and posted on various Village Pump sites; ** a new working prototype has been added [12] ** and a new mock up design has been added which was based off of community feedback. [13] * Released findings and conclusions of the recent survey ran on the Wikipedia.org portal page - how did you arrive at Wikipedia - that also contains good feedback on the portal design page, the sister project links with descriptive text, search and usage on various platforms. [14] * Conversation with the community on handling search queries with question marks also continues [15] ** this page has been translated into 5 additional languages * Team conversations started about how to package portions of the wikipedia portal page to make it easier to re-use across all projects that want it. [16] * Team conversations started about how to automate stats updates on the wikipedia portal page [17] == Events and News== * Erik was promoted to Senior Software Engineer, yay! * Discovery Quarterly review was held [18] * Geo Search was launched by the Discovery Search team on behalf of the Reading team [19] [1] https://commons.wikimedia.org/wiki/File:Report_on_Cirrus_Search_TextCat_AB_… [2] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/TextCat_and_Confiden… [3] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/TextCat_Re-optimizat… [4] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/TextCat_Optimization… [5] https://tools.wmflabs.org/textcatdemo/ [6] https://phabricator.wikimedia.org/T121541 [7] https://commons.wikimedia.org/wiki/File:Foxteriér_a_kocúr.jpg [8] https://www.mediawiki.org/wiki/Template:Graph:Country_with_regions_and_capi… [9] https://en.wikivoyage.org/wiki/MediaWiki:Kartographer.js [10] https://en.wikivoyage.org/wiki/MediaWiki:Kartographer.css [11] https://www.mediawiki.org/wiki/Wikipedia.org_updated_page_layout [12] https://people.wikimedia.org/~jdrewniak/collapsed-languages/index.html [13] https://www.mediawiki.org/wiki/File:Wikipedia.org_portal_more_languages_but… [14] https://www.mediawiki.org/wiki/File:Discovery_-_Wikipedia.org_Portal_Study_… [15] https://meta.wikimedia.org/wiki/Discovery/Handling_question_marks_in_search… [16] https://phabricator.wikimedia.org/T136151 [17] https://phabricator.wikimedia.org/T140159 [18] https://docs.google.com/presentation/d/1gVXPwLtUZc1H5V82wv1TJU-abmmfaZkXYlo… [19] https://www.mediawiki.org/wiki/Help:CirrusSearch#Geo_Search ---- The full update, and archive of past updates, can be found on Mediawiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates -- Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

Re: [Wikitech-l] Gerrit 2.12.2 test instance - PLEASE TEST
by Markus Glaser 15 Jul '16

15 Jul '16

This update will definitely improve our experience with git. As others have said before, the inline editing will greatly speed up the review process and improve code quality. This is especially true for the extensions, as you now do not have to clone a repo or reject the commit just to fix a typo or some coding conventions. Thanks for making this happen! I found that the behavior of my old search filters has changed. I used to look for bluespice status:open to get all open commits in all bluespice repos. This however does not work in the test instance, I only get a small subset of the commits I need to see. There are ways around this, e.g. ownerin:bluespice status:open, so I am not too concerned about it. Am not sure whether it affects other extension writers, though. Cheers, Markus (mglaser)

1 0

The Revision Scoring weekly update
by Amir Ladsgroup 15 Jul '16

15 Jul '16

Hey, This is the 12th weekly update from revision scoring team that we have sent to this mailing list. New developments: - We deployed ORES review tool in Russian and Portuguese Wikipedia! [1] [2] - Basic support for English Wiktionary and Czech Wikipedia is live in labs.[3] Soon production will follow. - Damaging model for Polish Wikipedia is ready and soon be available (then we can enable ORES review tool as well) [4] - ORES extension now highlights the whole row for Enhanced recent changes too. It will be live in two weeks [5] - We built prototype of a small web app to show progress of wikilabels campaigns at https://tools.wmflabs.org/dexbot/tools/wikilabels_stats.php. Feedback is welcome [6] Maintenance and robustness: - If a web node goes down in labs, we get icigna warnings [7] - We re-launched wikilabels campaigns for French and Azeri Wikipedia [8] [9] - We are starting to use tsv2json to load the whole data when adding new campaigns in wikilabels [10] - "Hide/Show good edits" soon will be changed to "Hide/Show probably good edits" in recent changes and watchlists to reflect ORES scores more accurately [11] 1. https://phabricator.wikimedia.org/T139541 2. https://phabricator.wikimedia.org/T139692 3. https://phabricator.wikimedia.org/T139789 4. https://phabricator.wikimedia.org/T139207 5. https://phabricator.wikimedia.org/T139924 6. https://phabricator.wikimedia.org/T139874 7. https://phabricator.wikimedia.org/T134782 8. https://phabricator.wikimedia.org/T107730 9. https://phabricator.wikimedia.org/T139875 10. https://phabricator.wikimedia.org/T139939 11. https://phabricator.wikimedia.org/T139754 Sincerely, Amir from the Revision Scoring team

3 4

Phabricator monthly statistics - 2016-06
by communitymetrics＠wikimedia.org 15 Jul '16

15 Jul '16

Hi Community Metrics team, This is your automatic monthly Phabricator statistics mail. Accounts created in (2016-06): 240 Active users (any activity) in (2016-06): 836 Task authors in (2016-06): 471 Users who have closed tasks in (2016-06): 252 Projects which had at least one task moved from one column to another on their workboard in (2016-06): 199 Tasks created in (2016-06): 2478 Tasks closed in (2016-06): 2141 Open and stalled tasks in total: 30571 Median age in days of open tasks by priority: Unbreak now: 18 Needs Triage: 173 High: 318 Normal: 470 Low: 777 Lowest: 594 (How long tasks have been open, not how long they have had that priority) TODO: Numbers which refer to closed tasks might not be correct, as described in https://phabricator.wikimedia.org/T1003 . Yours sincerely, Fab Rick Aytor (via community_metrics.sh on iridium at Thu Jul 14 22:31:51 UTC 2016)

1 0

2016W29 ArchCom-RFC meeting: Plan for a cross-wiki watchlist back-end
by Rob Lanphier 15 Jul '16

15 Jul '16

Hi all, The plan for next week's ArchCom office hour is to discuss T126641: [RFC] Devise plan for a cross-wiki watchlist back-end. There's been a fair amount of discussion already on T126641 which is trying to sort out the following questions: * Is keeping a central table of all recent changes for all wikis a doable option? * Is doing separate queries for each wiki a better or worse idea? * Are there ways that we could mitigate the impact of either of those options? * Are there other options that we haven't even thought about yet? #wikimedia-office: 2016-07-20 (Wednesday) 21:00 UTC (2pm PDT, 23:00 CEST) More details about the meeting: <https://phabricator.wikimedia.org/E235> More details about the topic: <https://phabricator.wikimedia.org/T126641> Of course, no one needs to wait for the meeting to comment. Please make your thoughts known on this list, or in Phab on T126641. Rob

1 0

geo search is now live
by Erik Bernhardson 15 Jul '16

15 Jul '16

This week we shipped a new feature at the request of the mobile apps team, geo search. (bare bones) Documentation: https://www.mediawiki.org/wiki/Help:CirrusSearch#Geo_Search Quick example usage for bounded geo search: https://people.wikimedia.org/~ebernhardson/mapsearch.html#Pittsburgh|intitl… https://people.wikimedia.org/~ebernhardson/mapsearch.html#San Francisco|hastemplate:"National Register of Historic Places in California" https://people.wikimedia.org/~ebernhardson/mapsearch.html#200km,Moscow|inca… Direct search example: https://en.wikipedia.org/w/index.php?fulltext=1&search=incategory%3AKremlin… Also implemented a "boost" version which increases the search score of pages within a particular area, rather than the default which limits to a geographic area. Compare: https://en.wikipedia.org/w/index.php?fulltext=1&search=boost-neartitle%3A%2… vs. https://en.wikipedia.org/w/index.php?fulltext=1&search=museum

1 0

Re: [Wikitech-l] [action required] We are removing inactive projects.
by Andrew Bogott 15 Jul '16

15 Jul '16

Reminder: There are still 73 unclaimed projects listed on https://wikitech.wikimedia.org/wiki/Purge_2016. Please claim your projects today! (Or, better yet, mark them as unused so I can start reclaiming space.) Thanks! -Andrew On 7/8/16 11:09 AM, Andrew Bogott wrote: > If you are exclusively a user of tool labs, you can ignore this email. > If you use or administer another labs project, this email REQUIRES > ACTION ON YOUR PART. > > We are reclaiming unused resources due to an ongoing shortage. > > Visit this page and add a signature under projects you know to be active: > > https://wikitech.wikimedia.org/wiki/Purge_2016 > > Associated wmflabs.org <http://wmflabs.org> domains are included to > identify projects by offered services. > > We are not investigating why projects are needed at this time. If one > person votes to preserve then we will do so in this round of cleanup. > > In a month, projects and associated instances not claimed will be > suspended or shutdown. A month later if no one complains these > projects will be deleted.. > > - Andrew (on behalf of all Labs Admins everywhere)

1 0

← Newer
1
2
3
4
5
6
7
8
9
Older →

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l July 2016