I was happy to read about the new features in the latest release of the Wikimedia Commons app for Android. My understanding is the app is developed and maintained by community members with funding from WMF and GSoC in addition to volunteer time.
Also, I was happy to see GSoC participants introducing themselves and their projects on Wikitech-l.
I am grateful to the WMF staff who are listening and responding civilly to the questions and comments on MediaWiki regarding the page previews feature. The project plan appears to have been designed thoughtfully.
Finally, I liked reading portions of English Wikipedia's article about CubeSats.
What's making you happy this week? You are welcome to comment in any language.
Pine
( https://meta.wikimedia.org/wiki/User:Pine )
https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-05-02
==2018-05-02 ==
== Callouts ==
* Fundraising campaigns
https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up:
Netherlands 2018-04-10through 2018-05-08
* Services: If someone maintains/knows JobQueue Job code that posts jobs
cross-wiki, please tell us.
* Language -> Platform: Need help in
https://phabricator.wikimedia.org/T193008(MediaWiki\MediaWikiServices::rese…
doesn't reset database connection state)
* If you have a WMF service that uses WDQS, please document at
https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Usage and
consider whether it should be using internal cluster or public endpoint.
* Research: If you speak English, French, or Spanish, you're welcome to
label some unsourced statements at http://labels.wmflabs.org. Look for the
"Labeling Unsourced Statements" (or its equivalent in other languages)
campaign.
* Research: If you speak two languages from the list of Arabic, English,
Spanish, Japanese, French, and Russian, you're also welcome to help us with
mapping section titles.
https://docs.google.com/spreadsheets/d/1KjUiMERifNvoqxaXYo3aymjELHrIkyX9wgC…
* Research: We would love to hear about a robust way of sending out user
talk page messages across wikis, not just enwiki.
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
**Point release should be code complete this week; mostly small bug fixes +
Wikidata magic word override (https://phabricator.wikimedia.org/T191347)
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
**Working on multilingual extensions. Planning to complete before
Hackathon, and perform user testing there.
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
**Some rather involved improvements to infobox alignment
https://phabricator.wikimedia.org/T189688
**Refactoring jQuery collapsible elements to use CSS instead of JavaScript
https://phabricator.wikimedia.org/T42812
**Improvements, bug fixes, and analyses to page previews; better RTL support
https://phabricator.wikimedia.org/T192928https://phabricator.wikimedia.org/T190831https://phabricator.wikimedia.org/T193058https://phabricator.wikimedia.org/T192773https://phabricator.wikimedia.org/T188734https://phabricator.wikimedia.org/T193053
**Miscellaneous watchstar bug fixes wrapping up
https://phabricator.wikimedia.org/T191454
**Reviewing applicants for full stack engineer backfill
**Page issues instrumentation planning
https://phabricator.wikimedia.org/T191532
**Little slow this week due to holidays and vacations
**Ongoing minor improvements to MobileFrontend and MinervaNeue
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** Updated summary output to use the correct description if it was
overridden. Same for mobile-sections plus also added the description_source
so the apps can see where the description came from. (deployed as of
Monday, going to roll out to pages as they are edited)
** ReadingLists response times went up 10x, might be related to
ChronologyProtector change (there is a fix, thanks Performance!)
https://phabricator.wikimedia.org/T193417
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
***Reading Infra depends on Parsing, Services
===== Maps =====
* Blocked by:
* Blocking:
* Updates:
**
==== Multimedia ====
* Updates
** Continuing work on prototype for file-page integration for MediaInfo
** Search work progressing well - moving on from properties to qualifiers
** Still considering instrumentation possibilities
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare
for launch of the first Structured Data on Commons feature (multilingual
file captions)
***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- T171252
***Research depends on Multimedia
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
** Starting a new project, AFC improvement
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
**
==== Editing ====
* Blocked by:
* Blocking:
** Updates:
**
==== Parsing ====
* Blocked by: Operations on https://phabricator.wikimedia.org/T193414 --
Production Debian stretch servers are running a different version of Tidy
compared to Debian Jessie servers
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing depends on MediaWiki Platform, Services
**** Work Ongoing. (1) Tidy will be gone by end of quarter, and in touch
with Platform team about it (2) Language variants work is apace. Services &
Parsing are yet to meet to work about API spec for what Services wants
Parsing to implement.
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
Increase code sharing of client apps by coalescing and moving more logic to
the server.
*** Reading Infra depends on Parsing, Services
**** Not aware of anything that Parsing needs to do (unless it is language
variants, which is already being addressed as part of our own goal above).
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
**** Services, Parsing, Editing need to meet and resolve if data-mw blob
separation is happening this quarter or not.
==== Collaboration ====
* Blocked by:
* Blocking:
* Updates:
**
==== Language ====
* Blocked by: See callouts
* Blocking: None
* Updates:
** ContentTranslation Version 2 work continue.
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.1]] Improve and consolidate our unified editing platform so that it's
great on all devices
***Language depends on Editing
=== Audiences Design ===
* Blocked by:
* Blocking:
* Updates:
**
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
**
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** Druid has been upgraded to 0.10 (on the road to 0.11, allowing to move
to java8 and therefore stretch instead of jessie)
** http://pivot.wikimedia.org is having problems for some datasources
(banner-impressions) - We ask people to start using Superset (
superset.wikimedia.org - wikitech account + ping to analytics needed)
** Geowiki (editors per country) is now named GeoEditors. Data has been
vetted against old data (see https://wikitech.wikimedia.org
*/wiki/Analytics/Systems/GeoEditors)
** Mirror Maker still has issues. We are upgrading jumbo to Kafka 1.1
before rolling it to the main cluster, with ops collaboration
** EventBus logs are pushed to logstash
** On the way to upgrade ua-parser, the library we use to classify user
agents
** Dashiki can now pivot data (example of configuration change:
https://meta.wikimedia.org/w/index.php?title=Config%3ADashiki%3AInterlangua…,
example of dashboard using it:
https://language-reportcard.wmflabs.org/interlanguage/#desktop)
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** Infrastructure for transition to EventLogging for data on FR cluster
** Fixing up some errors in the donations queue
** Setting up BitPay
** Ongoing fixes and improvements in existing systems: CiviCRM, Ingenico,
Grafana dashboard
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
** MCR
*** Task wrangling
*** Working to resolve architectural disagreements
*** Migration script to populate the new MCR tables is done, waiting for
MCR people to review.
*** ar_text/ar_flags removal is blocked on Cloud Services:
https://phabricator.wikimedia.org/T189141
*** Wrote a maintenance script to deduplicate ar_rev_id, needs review:
https://gerrit.wikimedia.org/r/q/topic:%2522bug%252FT193180-cleanup-archive…
*** API updates for query modules are in Gerrit:
https://gerrit.wikimedia.org/r/#/c/413223/
*** Started working on the API "templated parameters" patch again. Almost
ready to put it in Gerrit. Described in
https://phabricator.wikimedia.org/T174032#3990488.
** MediaWiki 1.31 blocker work
** Usual code review and bug work
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer,
[[phab:T174043|T174043]]Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
=== Performance ===
* Blocked by:
**
* Blocking:
**
* Updates:
**
=== Release Engineering ===
* Blocked by: none
* Blocking: none?
* Updates:
** Announcing Quibble!
https://phabricator.wikimedia.org/phame/post/view/99/introducing_quibble/
** MediaWiki core and extensions 1.32.0-wmf.2 going out this week [
https://phabricator.wikimedia.org/T191048 blocker task] if you spot blockers
** New Scap Release coming Soon™
*** git-lfs updates for ORES
*** better canary stuff for MediaWiki deploys
*Quarterly goal dependency update:
** no updates
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
=== Research ===
* Blocked by: None
* Blocking: None
* Updates:
** Sending out invitations to multilingual Wikipedia users and asking their
help in mapping article section titles into different languages (ar, en,
es, fr, ja, ru). Would love to hear if anyone knows about a robust way of
sending talk page messages across wikis, not just enwiki. You're welcome to
contribute too:
https://docs.google.com/spreadsheets/d/1KjUiMERifNvoqxaXYo3aymjELHrIkyX9wgC…
** Running a Wikilabels campaign for unsourced statements (en, fr, it). So
far we have 25 independent annotators and more than 300 labels. Your
contributions are also welcome: http://labels.wmflabs.org
*Quarterly goal dependency update:
Jonathan is driving these initiatives.
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- [[phab:T171252|T171252]]
***Research depends on Multimedia
=== Scoring Platform ===
* Blocked by: None
* Blocking: None
* Updates:
**git-lfs is almost finished
**wp10 data is available on beta cluster and will go to prod soon
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
** WDQS internal cluster is up and serving traffic.
** Fixed error in negating keywords:
https://phabricator.wikimedia.org/T193208
** Working on Polish analyzer: https://phabricator.wikimedia.org/T186046
** Evaluating feature generation by `query_explorer` functionality of LTR
plugin: https://phabricator.wikimedia.org/T187148
** Working on improving sharding of Elastic cluster:
https://phabricator.wikimedia.org/T192972
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
** Working on indexing more statements in Wikidata:
https://phabricator.wikimedia.org/T99899
** WDQS GUI auto-build working, thanks again RelEng!
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
=== Security ===
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]]: Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
=== Services ===
* Blocked by: none
* Blocking: none
* Updates:
** RESTBase storage clenups ongoing
** Job Queue migration continues
*** The job type config must be global for all the jobs that are posted
cross-wiki,
so our normal switchover process doesnt work for them. We've identifie most
of cases, but we need help if someone knows a job we might have missed.
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server.]]
***Reading Infra/Parsing, Services
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
=== Site Reliability Engineering ===
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
== Wikidata ==
* Blocked by:
** MediaWiki core's selenium tests flaky when run as part of
mwext-mw-selenium-node-composer-jessie job -
https://phabricator.wikimedia.org/T191537
**CI infrastructure Issues
*** What level of service is expected, what to do when the service level
"drops" too much?
*** What amount of contribution can/should be expected from our team, how
much can/should we get involved?
* Blocking:
* Updates:
**Release of Lexeme is still on schedule - May 23rd.
**
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer,
[[phab:T174043|T174043]]Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
**
== SoS Meeting Bookkeeping ==
* Updates:
**
Hello,
Running all tests for MediaWiki and matching what CI/Jenkins is running
has been a constant challenge for everyone, myself included. Today I am
introducing Quibble, a python script that clone MediaWiki, set it up and
run test commands.
It is a follow up to the Vienna Hackathon in 2017. We had a lot of
discussion to make the CI jobs reproducible on a local machine and to
unify the logic at a single place. Today, I have added a few jobs to
mediawiki/core.
An immediate advantage is that they run in Docker containers and will
start running as soon as an execution slot is available. That will be
faster than the old jobs (suffixed with -jessie) that had to wait for a
virtual machine to be made available.
A second advantage, is one can exactly reproduce the build on a local
computer and even hack code for a fix up.
The setup guide is available from the source repository
(integration/quibble.git):
https://gerrit.wikimedia.org/r/plugins/gitiles/integration/quibble/
The minimal example would be:
git clone https://gerrit.wikimedia.org/r/p/integration/quibble
cd quibble
python3 -m pip install -e .
quibble
A few more details are available in this post on the QA list:
https://lists.wikimedia.org/pipermail/qa/2018-April/002699.html
Please give it a try and send issues, support requests to Phabricator:
https://phabricator.wikimedia.org/tag/quibble/
Next week I will polish up support for MediaWiki extensions and skins
and eventually Quibble will take over most of the CI jobs running for
MediaWiki related projects.
--
Antoine "hashar" Musso
Hi All,
We ended up scheduling this a little late so it didn't go out on the
TechCom Radar.
There is a IRC meeting on 2018-05-09 at 2pm PST(22:00 UTC, 23:00 CET) on
#wikimedia-office channel for RFC: Come up with a strategy for handling
interface changes <https://phabricator.wikimedia.org/T193613>
Thanks,
-Kate
--
Kate Chapman
TechCom Facilitator (Contractor)
Hello Everyone!
I am Ujjwal Agrawal, third-year B.Tech. Undergraduate at Indian
Institue of Technology (ISM), Dhanbad, and I've been selected for GSoC
2018. I have a keen interest in Android App development and I will be
implementing a feature to browse/search the Wikimedia Commons
Repository from Commons App <https://phabricator.wikimedia.org/T188597
<https://phabricator.wikimedia.org/T189788#4153895>>, as a part of my
intern program.
I’d like to thank my mentors Nicolas Raoul and Neslihan for giving me
this wonderful opportunity!
Regards
Ujjwal Agrawal
Greetings,
I'm Prssanna Desai, an undergraduate student from NMIMS University, Mumbai,
India and I've been selected for GSoC '18.
*My Project:* *Improve Data Explorer for query.wikidata.org
<http://query.wikidata.org>*
The project consists of making usability improvements to the Explorer
Dialog and the Graph Explorer of WDQS.
You can read my full proposal here:
https://phabricator.wikimedia.org/T189669
I’d like to thank my mentors Jonas Kress, Stas Malyshev and Lucas
Werkmeister for giving me this wonderful opportunity!
Regards,
Prssanna Desai