Wikitech-l September 2016

wikitech-l@lists.wikimedia.org

105 participants
111 discussions

The Revision Scoring weekly update
by Aaron Halfaker 28 Sep '16

28 Sep '16

Hey, This is the 23rd weekly update from revision scoring team that we have sent to this mailing list. New development - We implemented and demonstrated a linguistic/stylometric processing strategy that should give us more signal for finding vandalism and spam[1]. See the discussion on the AI list[2]. - As part of our support for the Collaboration Team, we've been producing tables of model statistics that correspond to set of thresholds[3]. This helps their designers work on strategies for reporting prediction confidence in an intuitive way. Maintenance and robustness - We had a major downtime event that was caused by our logs being too verbose. We've recovered and turned down the log level[4]. - We made sure that halfak got pings when ores.wikimedia.org goes down[5] Datasets - We created a database on Wikimedia Labs that provides access to a dataset containing a complete set of article quality predictions for English Wikipedia[6]. See our announcements[7,8,9]. 1. https://phabricator.wikimedia.org/T146335 -- Implement a basic scoring strategy for PCFGs 2. https://lists.wikimedia.org/pipermail/ai/2016-September/000098.html 3. https://phabricator.wikimedia.org/T146280 -- Produce tables of stats for damaging and goodfaith models 4. https://phabricator.wikimedia.org/T146581 -- celery log level is INFO causing disruption on ORES service 5. https://phabricator.wikimedia.org/T146720 -- Ensure that halfak gets emails when ores.wikimedia.org goes down 6. https://phabricator.wikimedia.org/T106278 -- Setup a db on labsdb for article quality that is publicly accessible 7. https://phabricator.wikimedia.org/T146156 -- Announce article quality database in labsdb 8. https://lists.wikimedia.org/pipermail/ai/2016-September/000091.html 9. https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_14… Sincerely, Aaron from the Revision Scoring team

1 0

2016-09-28 Scrum of Scrums meeting notes
by Grace Gellerman 28 Sep '16

28 Sep '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-09-28 = 2016-09-28 = == Product == === Reading === ==== Mobile Content Service (MCS) ==== * Fixed video anchors * No deploys this week due to ops offsite * Starting discussions versioning sections endpoint ==== Android native app ==== * Current sprint board: https://phabricator.wikimedia.org/project/view/2238/ * Next sprint board: TBA * Navigation overhaul work for beta release is complete. Release will go out the door today (9/28). ** We'll likely promote to stable quickly if no significant issues emerge. ==== Reading Web ==== * Current sprint board: **Begin rolling out wikidata descriptions to top 6 wikis **Move Related Pages to stable mobile web Wikipedias (all but top 6) **Investigate hovercards instrumentation issues around 9 Sep - https://phabricator.wikimedia.org/T146620 *** Big drop in EL events in a few extensions - https://phabricator.wikimedia.org/T146840 ==== iOS native app ==== * Current release board: https://phabricator.wikimedia.org/project/board/2220/ ** 5.3 is in development ** Release date is expected to be before end of October ** WIll include migration to MCS feed endpoint ==== Reading Infrastructure ==== * blocking: TemporaryPasswordPrimaryAuthenticationProviderTest is flaky https://phabricator.wikimedia.org/T146498 * blocked: nothing * updates: last call for comments on the proposed api.php integration for ORES and pageviews: https://phabricator.wikimedia.org/T143895 https://phabricator.wikimedia.org/T144865 === Community Tech === * No blockers * Moving CopyPatrol to French Wikipedia https://phabricator.wikimedia.org/T145431 * Adding account creation to Striker https://phabricator.wikimedia.org/T144710#2674663 * Updating CentralAuth tables for cross-wiki watchlist https://phabricator.wikimedia.org/T142507 (Gerrit review needed: https://gerrit.wikimedia.org/r/#/c/309553/ ) * Adding start/end times to WikiEd Programs Dashboard https://phabricator.wikimedia.org/T125546 * 11-year old task to send a cookie with each block https://phabricator.wikimedia.org/T5233 * Slowly deploying PageAssessments to English Wikipedia https://phabricator.wikimedia.org/T146679 === Editing === ==== Language (not present, only notes) ==== * Blocked ** Would appreciate comments from ops or puppet-knowledgeable person how to override restbase url in puppet for a service in labs *** https://phabricator.wikimedia.org/T129284#2674533 *** The goal is to be able to text content translations on deployment-prep with real articles from different wikipedias. * Blocking: not aware ==== Parsing ==== * Tim working on updates to the parser tests infrasatructure ( https://gerrit.wikimedia.org/r/#/c/312969/3 and related ) * Scott continuing work on having Parsoid parse language variant markup (close to moving out of WIP status) * Planning to deploy Parsoid's native <gallery> implementation in a backward compatible way and have VE pick it up when they are ready to use it -- if it doesn't happen next week, it will only happen in 3 weeks time (since we have parsing team and editing dept offsites starting oct 10). ==== Collaboration ==== * Blocked ** Continuing collaboration with Services team on ReviewStream * Blocking * Updates ** Will have a meeting with the Wiki Labels team on Friday to discuss how we can collaborate ** Continuing work on Flow back-end, including caching refactor and bug fixes for opt-in on user talk ** Continuing Echo work, including instrumentation to track the number of page views before viewing notifications. === UI Standardization === * Working on ** Align Minerva (Mobile Frontend) to overhauled color palette: MobileFrontendhttps://phabricator.wikimedia.org/T146799 ** Review current style and integrate messages and message boxes as MediaWiki UI component https://phabricator.wikimedia.org/T127405 ** MediaWiki theme: Use `color-progressive` for switched-on binary inputs https://phabricator.wikimedia.org/T145629 * Finished ** Published new color palette https://phabricator.wikimedia.org/M82 with WCAG 2.0 level AA compliant colors ** Button styles differ in mediawiki.UI from design templates and OOjs UI https://phabricator.wikimedia.org/T146823 ** Align Wikimedia Portal UI elements to improved color palette https://phabricator.wikimedia.org/T146231 == Technology == === Analytics === * Deployed new throttling limits to Pageview API, doing real well with super low latencies, we will add capacity to double requests served next week: https://grafana.wikimedia.org/dashboard/db/aqs-elukey?from=1474479314693&to… * Erik Z vetting data from edit reconstruction project on simplewiki, after edit reconstruction calculating metrics is much easier. We can calculate metrics frm very beginning: https://analytics.wikimedia.org/dashboards/standard-metrics/#simplewiki * Load testing druid and about to put pivot in production accesible internally to wmf, this is a UI to some of our data in hive, mostly pageviews, no need to use sql == Security == * Intake and interviews for security roles continue * Investigating appearance of 400 errors in logs: https://phabricator.wikimedia.org/T144100 * Lego, Timo: https://gerrit.wikimedia.org/r/#/c/310257/ === Services === * Blocking: none * Blocked: none * Updates: ** Working on ServiceWorker page composition service ** Working on supporting Change Propagation and RESTBase for private wikis - === ArchCom === * Full status: https://www.mediawiki.org/wiki/ArchComStatus * Last week: [[Phab:E273]] - Multi-Content Revisions ([[Phab:T107595]]) * This week [[Phab:E285]] - [[WikiDev17]] ** discussion about use of Phab for topics is happening now on wikitech-l === Discovery === * No blockers * Analyzing BM25 A/B test, if results are positive deployment will be somewhere early October * Working on multiwiki indexes * Working on file properties indexing (size, type, dimensions, etc.) * ICU folding analysis: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Upgrading_ASCII_Fold… ** TLDR: positive effect, implementation in progress * Completion with DEFAULTSORT demo: http://mw-sug-subpages-relforge.wmflabs.org/w/default_sort_demo.html === RelEng === * Blocking ** none * Blocked ** none * Updates ** New scap (3.3.0) *** scap caches local config for it's deployment (machines don't have to reach back to tin) ** Reminder: no deploys week of Sept 26th ** Reminder: no train week of Oct 17th (but SWATs OK) ===Wikidata==== * wiktionary - automated interwiki links * structured commons - federation, multiple repos === Fundraising Tech === * Need help with potential MessageCache issue relating to CentralNotice ** https://phabricator.wikimedia.org/T144952 ** See Adam's investigation notes pointing to i18n / cache flukiness ** Andrew Green thinks it might even have something to do with TranslationExtension * Still trying to kill stubborn remaining ActiveMQ queues * More CiviCRM data cleanup and tweaks to deduplication process * Migrating old PayPal IPN listener to SmashPig framework

1 0

CREDIT Showcase, Wednesday, 5-October-2016 - call for demos
by Adam Baso 28 Sep '16

28 Sep '16

Greetings - The next CREDIT showcase is Wednesday, 5-October-2016 at 1800 UTC (1100 San Francisco). https://www.mediawiki.org/wiki/CREDIT_showcase We look forward to seeing your demos! Please add them to the Etherpad and mark your calendars: https://etherpad.wikimedia.org/p/CREDIT We welcome works in progress and would be thrilled to see works from Wikimedia community members, as well as staff. If you missed last month's CREDIT, here it is! https://www.youtube.com/watch?v=rfBQ6H14_SM&t=54 Finally, If you would like to invite anyone to CREDIT, feel free to use this template. *Hi <FNAME>* *I hope all is well with you! I wanted to let you know about CREDIT, a monthly demo series that we’re running to showcase open source tech projects from Wikimedia Community, Reading, Editing, Discovery, Infrastructure and Technology.* *CREDIT is open to the public, and we welcome questions and discussion. The next CREDIT will be held on October 5th at 11am PT / 2pm ET / 18:00 UTC. * *Here’s a link to the YouTube live stream <https://www.youtube.com/watch?v=PCn-oeHQnpU>, which will be available shortly before the event starts. There’s more info on MediaWiki.org <https://www.mediawiki.org/wiki/CREDIT_showcase>, and on Etherpad <https://etherpad.wikimedia.org/p/CREDIT>, which is where we take notes and ask questions. You can also ask questions on IRC in the Freenode chatroom #wikimedia-office (web-based access here <https://webchat.freenode.net/?channels=%23wikimedia-office>). * *Please feel free to pass this information along to any interested folks. Our projects tend to focus on areas that might be of interest to folks working across the open source tech community: language detection, numerical sort, large data visualizations, maps, and all sorts of other things.* *Thanks, and I hope to see you at CREDIT.* - *YOURNAME* -Adam

1 0

Intro to "Committee" and "Diversity" section approved, "Conflict of interest" needs more work
by Matthew Flaschen 28 Sep '16

28 Sep '16

The community approved the introduction to the Committee section (https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Page:_Code_of_Conduct.…) (the part after "Committee" and before the "Diversity" section), as well as the "Diversity" section (https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Diversity). There was not consensus to approve the "Conflict of interest" (https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Conflict_of_interest) section. Work will continue on this section. See the top of https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Finalize_.22Confl… (including the sections linked from those bullet points). Thanks, Matt Flaschen

1 1

Gerrit screen size
by Bináris 28 Sep '16

28 Sep '16

Hi, I try to familiarize myself with Gerrit which is not a good example for user-friendly interface. I noticed a letter B in the upper right corner of the screen, and I suspected it could be a portion of my login name. So I looked at it in HTML source, and it was. I pushed my mouse on it and I got another half window as attached. So did somebody perhaps wire the size of a 25" monitor into page rendering? My computer is a Samsung notebook. -- Bináris

11 18

Re: [Wikitech-l] SQLite Mediawiki support
by Jefsey 27 Sep '16

27 Sep '16

At 00:36 27/09/2016, Brian Wolff wrote: >Content-Transfer-Encoding: base64Mediawiki supports sqlite. And you >can pretty much use with any webserver - >so are you basically asking for an installer? Some sort of xulrunner-esque >thing so the interface doesnt look like a web browser? I did not know XULetc... So, some parts could be related. Actually the need I have is quite opposite to mediawiki but with the same tools: not to support a community with common knowledge, but to support a single/a small group of users/authors, with sustainable knowledge, i.e. texts I can consantly augment and update, so I can structure my "mneme" and build upon it, for me, for others. The key issue seems to be individual (wikilite) versus community mneme (wikipedia) I need the wikipedia proven tools and practices under the form of a compact and robuts system I can rely upon and run on my different machines through my dropbox directory (the way I actually use the same wiki on three machines). However, the difficulty are : 1. mediawiki is not documented in that perspective for technically agnostic end-users 2. some of the php tools are not complete for SQLite 3. installation of a new wikilite is still complex and long, I would like to be able to install 30 different ones in one minute for a group of students, with pre-entered pages, forms, docs,mailing lists, etc. 4. a review of extensions into that perspective - introduced as perpetual off-the-shelve part of the experience. 5. farming management and updates (I run around 200 wikilites using symlinks for the current release, each in its own directory) 6. I would like to develop specialized bots for content management and interfacing, etc. that do not necessarily make sense in broad uses. etc. What I would like to get is an end-user oriented (extension and bot included) documentation anyone can read, understand and use. Yes, an installation and maintenance tool, with various types of use configurations, Then a clear documentation of the maintenance and extension tools with quality control and support. To become an end-user textbase++ system, consultants should be available and turn-click deliveries available (home and in the cloud). Thx for suggestions. jefsey >-- >Brian > >On Monday, September 26, 2016, Jefsey <jefsey(a)jefsey.com> wrote: > > The personal way I am using wikimedia as an SQLite textbase I can easily >copy/backup from machine to machine and modifiy through external bundled >applications leads me to consider there is a need for a wikimedia user 100% >compatible "WIKILite" integrated/maintained solution set. > > >K has something like that been investigated in the past? > 2. I would be interested by comments on the idea? > > 3. also about the approach that can best help users and possibly >wikimedia dévelopmentHÝH]\ÈH]ÛÜÙ@d individual/professionnal I >am interested in >multi-agent oriented interwares and would like to investigate "wikilite" >networking capabilities (both about what networked architectures could >bring, and aboout capacity based content security/protection). > > > > Thank you for your attention. >\Ý£âõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõõð___________ > > Wikitech-l mailing list >ÚZÚ]XÚ[\ÝËwikimedia.org >ÎËÛ\ÝËÚZÚ[YYXKÜËÛXZ[X[Û\Ý@nfo/wikitech-l >_______________________________________________ >Wikitech-l mailing list >Wikitech-l(a)lists.wikimedia.org >https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

Re: [Wikitech-l] SQLite Mediawiki support
by Aran 27 Sep '16

27 Sep '16

I developed a MediaWikiLite system many years ago which worked reasonably well. It was for having a wiki on a memory stick that included the content and ability to edit it in the field without net access. It ran on SQLite and use Nanoweb, a web-server written in PHP to reduce dependencies further. It's very out of date now, but may be helpful: https://www.organicdesign.co.nz/MediaWikiLite On 26/09/16 11:00, Jefsey wrote: > The personal way I am using wikimedia as an SQLite textbase I can > easily copy/backup from machine to machine and modifiy through > external bundled applications leads me to consider there is a need for > a wikimedia user 100% compatible "WIKILite" integrated/maintained > solution set. > > 1. has something like that been investigated in the past? > 2. I would be interested by comments on the idea? > 3. also about the approach that can best help users and possibly > wikimedia dévelopment? > > I note that as a networked individual/professionnal I am interested in > multi-agent oriented interwares and would like to investigate > "wikilite" networking capabilities (both about what networked > architectures could bring, and aboout capacity based content > security/protection). > > Thank you for your attention. > Best > jfc > > > > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l

2 1

Re: [Wikitech-l] SQLite Mediawiki support
by Brian Wolff 26 Sep '16

26 Sep '16

Mediawiki supports sqlite. And you can pretty much use with any webserver - so are you basically asking for an installer? Some sort of xulrunner-esque thing so the interface doesnt look like a web browser? -- Brian On Monday, September 26, 2016, Jefsey <jefsey(a)jefsey.com> wrote: > The personal way I am using wikimedia as an SQLite textbase I can easily copy/backup from machine to machine and modifiy through external bundled applications leads me to consider there is a need for a wikimedia user 100% compatible "WIKILite" integrated/maintained solution set. > > 1. has something like that been investigated in the past? > 2. I would be interested by comments on the idea? > 3. also about the approach that can best help users and possibly wikimedia dévelopment? > > I note that as a networked individual/professionnal I am interested in multi-agent oriented interwares and would like to investigate "wikilite" networking capabilities (both about what networked architectures could bring, and aboout capacity based content security/protection). > > Thank you for your attention. > Best > jfc > > > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

SQLite Mediawiki support
by Jefsey 26 Sep '16

26 Sep '16

The personal way I am using wikimedia as an SQLite textbase I can easily copy/backup from machine to machine and modifiy through external bundled applications leads me to consider there is a need for a wikimedia user 100% compatible "WIKILite" integrated/maintained solution set. 1. has something like that been investigated in the past? 2. I would be interested by comments on the idea? 3. also about the approach that can best help users and possibly wikimedia dévelopment? I note that as a networked individual/professionnal I am interested in multi-agent oriented interwares and would like to investigate "wikilite" networking capabilities (both about what networked architectures could bring, and aboout capacity based content security/protection). Thank you for your attention. Best jfc

1 0

Wikipedia dumps for Article with Category
by Abdulfattah Safa 26 Sep '16

26 Sep '16

Hi, In Wikipedia dumps for Arabic (arwiki), which dump does contain the article categories along with article metadata (namespace, redirects, content, etc..)? -- Regards, Abdulfattah Safa Senior Software Engineer Mobile: (+972)(599)231600 Skype: fattah.safa *P **Please consider the environment before printing this email*

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l September 2016