Привет!
Another update from the Search Platform team for the week starting 2018-05-07
**Programming note:** Due to the upcoming Wikimedia Hackathon and some
(personal) holiday time, the next update will be the week of
2018-05-28. Until then, and as always, feedback and questions are
welcome.
== Highlights==
* Map internationalization launched everywhere, and embedded maps
(mapframe) are now live on 276 Wikipedias [0]
* ''"Hello, my name is _____"'' is an in-depth blog post by Trey that
was published earlier this week where he details the irony that
searching for names is not always as straightforward as you might
think. [1]
== Discussions ==
=== Search ===
* Erik updated a script that was populating lots of 500 errors in the logs [2]
* Erik also did a lot of research to evaluate impact of adding ~2700
new shards to production cluster (there is a pdf attached to the last
comment in the ticket that contains more information) [3] There is a
follow-up ticket as well for the next steps [4]
* Trey worked on the analysis config for the new Slovak stemmer that
was deployed this week—but the plugin still needs to be deployed and
the wikis re-indexed. [5]
* Stas and others worked on looking up entities by external
identifiers - the work is done for now, but it needs a re-index to be
fully ready [6]
* David worked on externalizing the parsing logic from
SimpleKeywordFeature and FullTextQueryStringQueryBuilder and it was
pushed into production in April 2018 [7]
== Other Noteworthy Stuff ==
* Trey's most recent updates to transliteration on the Crimean Tatar
Wikipedia are live; after a year of part-time 10% project work, the
transliteration infrastructure for Crimean Tatar is done and the
accuracy is in the high 90% range. [8]
== Did you know? ==
* The English word “dove”, as the past tense of “dive”, is one of the
rare cases where a conjugation has become more irregular over time.
The verb “dive” picked up the strong conjugation [9] by analogy with
other strong verbs, particularly “drive/drove”. [10] Going in the more
typical direction of regularization, Swedish strong verbs slowly lost
some of their distinctive plural forms. [11] The change started in the
16th century, and was still in progress as late as the 1940s. From
the search perspective, regular forms are easier to deal with—so, way
to go Swedish!
[0] https://lists.wikimedia.org/pipermail/wikitech-l/2018-May/089964.html
[1] https://blog.wikimedia.org/2018/05/08/searching-for-names-is-not-always-str…
[2] https://phabricator.wikimedia.org/T179266
[3] https://phabricator.wikimedia.org/T192972
[4] https://phabricator.wikimedia.org/T193654
[5] https://phabricator.wikimedia.org/T191544
[6] https://phabricator.wikimedia.org/T99899
[7] https://phabricator.wikimedia.org/T188530
[8] https://phabricator.wikimedia.org/T188321
[9] https://en.wikipedia.org/wiki/Germanic_strong_verb
[10] https://en.wiktionary.org/wiki/dove#Etymology_2
[11] https://en.wikipedia.org/wiki/Swedish_grammar#Historical_plural_forms
---
Subscribe to receive on-wiki (or opt-in email) notifications of the
Discovery weekly update.
https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly
The archive of all past updates can be found on MediaWiki.org:
https://www.mediawiki.org/wiki/Discovery/Status_updates
Interested in getting involved? See tasks marked as "Easy" or
"Volunteer needed" in Phabricator.
[1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R
Yours,
Chris Koerner
Community Liaison
Wikimedia Foundation
Hello. Is there a way to deactivate a hyperlink using CSS? I tried
pointer-events: none, but wiki does not recognize it. Thank you.
Igal (User:Ikhitron)
As of today, interactive (Kartographer) maps no longer display in the language of the territory mapped; instead, you’ll read them in the content language of the wiki where they appear—or in the language their authors specify (subject to availability of multilingual data). In addition, mapframe, the feature that automatically embeds dynamic maps right on a wiki page, is now live on most Wikipedias that lacked the feature. (Not included in the mapframe launch are nine Wikipedias [1] that use the stricter version of Flagged Revisions).
If you you’re new to mapframe, this Kartographer help page [2] shows how to get started putting dynamic maps on your pages. If you’d like to read more about map internationalization: this Special Update [3] explains the feature and its limiations; this post [4] and this one [5] describe the uses of the new parameter, lang=”xx”, which lets you specify a map’s language. And here are some example maps [6] to illustrate the new capabilities.
These features could not have been created without the generous programming contributions and advice of our many map-loving volunteers, including Yurik, Framawiki, Naveenpf, TheDJ, Milu92, Astirlin, Evad37, Pigsonthewing, Mike Peel, Eran Roz, Gareth and Abbe98. My apologies to anyone I’ve missed.
The Map Improvements 2018 [7] project wraps up at the end of June, so please give internationalized maps and mapframe a try soon and give us your feedback on the project talk page [8]. We’re listening.
[1] https://phabricator.wikimedia.org/T191583
[2] https://www.mediawiki.org/wiki/Help:Extension:Kartographer
[3] https://www.mediawiki.org/wiki/Map_improvements_2018#April_18,_2018,_Specia…
[4] https://www.mediawiki.org/wiki/Map_improvements_2018#April_25,_2018,_You_ca…
[5] https://www.mediawiki.org/wiki/Map_improvements_2018#April_26,_2018:_OSM_na…
[6] https://test2.wikipedia.org/wiki/Map_internationalization_examples
[7] https://www.mediawiki.org/wiki/Map_improvements_2018
[8] https://www.mediawiki.org/wiki/Talk:Map_improvements_2018
_____________________
Joe Matazzoni
Product Manager, Collaboration
Wikimedia Foundation, San Francisco
"Imagine a world in which every single human being can freely share in the sum of all knowledge."
Hello everyone,
We've released OOUI version 0.27.0 last evening. It will be in
MediaWiki core from 1.32.0-wmf.3, which will be deployed to Wikimedia
production in the regular train, starting on Tuesday 16 May. As there
are five breaking changes in this release, at least nominally, please
carefully consider if they affect your code.
Breaking changes since last release:
* GroupElement: Remove getItem(s)FromData (Prateek Saxena)
We rename a number of getters when asking for one of 0+ items for
consistency reasons.
This and the following two changes are all on this topic.
* MultiSelectWidget: Remove getSelectedItems and getSelectedItemsData
(Prateek Saxena)
* SelectWidget: Remove getSelectedItem (Prateek Saxena)
* TagItemWidget: Replace 'disabled' items with 'fixed' (Moriel Schottlender)
For consistency of behavior and separation of UX concerns, we don't
allow for individual tag items in a TagMultiselectWidget to be
individually disabled. Instead, allow defining 'fixed' values that
cannot be removed. We are not aware of any instance of the
TagMultiselectWidget featuring 'disabled' items, nevertheless marking
it as breaking change.
* indicators: Remove 'alert', deprecated in v0.25.2 (James D. Forrester)
'alert' indicator has been deprecated a while ago and is unused in all
known implementations, therefore we've removed it completely.
Deprecations since last release:
* icons: Deprecate 'editing-citation' icons from 'content' (Volker E.)
We've added an explicit 'editing-citation' icon pack, that helps us
standardize citation icons. Therefore we have moved existing related
icons to its own pack.
* icons: Rename 'settings' to 'pageSettings' (Volker E.)
Clarify intended usage of icon by renaming it.
Please update your icon pack references accordingly in case you're
using one of those icons.
New features, icons and highlights in this release:
* An infusable PHP NumberInputWidget was implemented by volunteer mainframe98.
* icons: 'editing-citation' pack was added (Volker E.)
* ProcessDialog: Fix footer height when actions or dialog size changes
(Bartosz Dziewoński)
Additional details on 45 code-level and accessibility changes, 34
styling and interaction design amendments, and all improvements since
v0.26.0 are in the full changelog[0]. If you have any further queries
or need help dealing with breaking changes, please let me know.
As always, library documentation is available on mediawiki.org[1], and
there is some comprehensive generated code-level documentation and
interactive demos hosted on doc.wikimedia.org[2].
Thanks to all contributors involved, especially volunteers mainframe98
and Daimona Eaytoy!
Best,
Volker
[0] - https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
[1] - https://www.mediawiki.org/wiki/OOUI
[2] - https://doc.wikimedia.org/oojs-ui/master/
--
Senior User Experience Engineer
Wikimedia Foundation
volker.e(a)wikimedia.org | @Volker_E
https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-05-09
= 2018-05-09 =
== Callouts ==
*UI Standardization: OOUI – v0.27.0 breaking change release
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v…
As there are 5 breaking changes & 2 deprecations in this release, at
least nominally, please carefully consider if they affect your code.
*RelEng: Please review my patch! https://gerrit.wikimedia.org/r/#/c/415886/
<3 -mdh (RI)
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Nearly ready with Multilingual prototype for user-testing at the
Hackathon.
==== Readers Web ====
* Blocked by:
**Ruby to JS Cucumber refactor needs help from the RelEng team:
https://phabricator.wikimedia.org/T190710
**Proton instrumentation needs help from the Services team:
https://phabricator.wikimedia.org/T189307
***We need help setting up the test environment (send production traffic to
new server to find out how it performs); let's discuss in the Thursday sync!
* Blocking:
* Updates:
**Merged refactoring jQuery collapsible elements to use CSS instead of
JavaScript https://phabricator.wikimedia.org/T42812
**Merged miscellaneous watchstar bug fixes wrapping up
https://phabricator.wikimedia.org/T191454
**Working with anti-harassment team for improvements to messaging for
blocked users https://phabricator.wikimedia.org/T165535
**Miscellanous post-page previews en/dewiki launch clean up
https://phabricator.wikimedia.org/T192622
**Some rather involved improvements to long infobox presentation and
inlined article thumbnails https://phabricator.wikimedia.org/T189688
**Miscellaneous MobileFrontend and Popups refactors
**Proton (Chromium rendering service) instrumentation in progress
https://phabricator.wikimedia.org/T189307
**Reviewing applicants for full stack engineer backfill
**Continuing on improving the page issues experience
https://phabricator.wikimedia.org/T159262
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** Updated mobile-sections, summary, and action=mobileview to take
overridden local short descriptions into account (also provide the source
where the description came from: local or central wiki; the first two
endpoints are already deployed, the action=mobileview is riding the train
this week)
** Added announcement for production Android app to point to a survey about
reading list sync, running for one week since Tuesday.
** Add to Reading List browser extensions awaiting legal review
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
***Reading Infra depends on Parsing, Services
===== Maps =====
* Blocked by:
* Blocking:
* Updates:
==== Multimedia ====
* Blocked by:
* Blocking:
* Updates:
** Working on frontend changes for MediaInfo (changing forms to OOUI)
** Added instrumentation to UploadWizard via EventLogging
** Continuing work on search indexing of properties and qualifiers
** Discussion in progress about what parts of MCR need to be completed for
initial SDoC launch with multi-lingual file captions
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
==== Editing ====
* Blocked by:
* Blocking:
* Updates:
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
==== Collaboration ====
* Blocked by:
* Blocking:
* Updates:
** Internationalized maps are live
** <mapframe> live on almost all Wikipedias (waiting for a Parsoid restart
before we announce)
==== Language ====
* Blocked by: https://phabricator.wikimedia.org/T151116 - Abuse filters set
to warn users require two captchas - affecting CX.
* Blocking: None
* Updates:
** ContentTranslation version 2 work continue.
=== Audiences Design ===
* Blocked by:
* Blocking:
* Updates:
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
** OOUI – v0.27.0 breaking change release:
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v…
*** 5 breaking changes & 2 deprecations in this release! Additionally 7
style changes, 4 code & 3 accessibility improvements. Among those
**** Infusable PHP NumberInputWidget is now added and part of core
(mainframe98)
**** ProcessDialog: Fix footer height when actions or dialog size changes
(Bartosz Dziewoński)
**** icons: Add 'editing-citation' pack (Volker E.)
**** SelectFileWidget: Use `<label>` for select ButtonElement (Volker E.)
** Continued work on Design Style Guide
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
**Kafka upgrade on main Kafka cluster (tier 1)
**Upgrading druid to 0.11 and running into trouble, testing in labs.
**Working on geoeditors (the improved geowiki data - #editors per country).
**Work continues to update UA Parser.
**Recruiting for SRE, Audiences and data analysts team.
**Surfacing virtual pageviews in aggregated form in Hive and in Druid/pivot.
**switching on EL sanitization in Hive, not yet deleting data, just
creating another sanitized copy.
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** CiviCRM
*** another version upgrade - https://phabricator.wikimedia.org/T194210
*** imports for new bitcoin processor -
https://phabricator.wikimedia.org/T192953
*** fixes for audit file processing (refunds to recurring payments) -
https://phabricator.wikimedia.org/T190098
*** recurring charge processing for main CC processor's new API -
https://phabricator.wikimedia.org/T170973
** CentralNotice
*** Still working out mechanics of new banner impression / EventLogging
backend pipeline - https://phabricator.wikimedia.org/T186048
*** CSP on banner previews breaking some workflows, investigating whether
those should stay broken - https://phabricator.wikimedia.org/T193332
** DonationInterface
*** squashing last blocker bug for public-facing trial of main CC
processor's new API - https://phabricator.wikimedia.org/T190871
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Performance ===
* Blocked by: None
* Blocking:None
* Updates:
** Continuing to migrate our tools, making good progress there.
** Evaluating several different mobile testing services, hoping to find one
that allows us to do regular testing but haven't yet done so.
** Beginning to do performance testing on Android phones (mobile site, not
app)
** Had an issue with NavTiming extension that resulted in some data
collection being dropped. Fixed at the end of last week.
** Beginning some ResourceLoader refactoring to reduce overhead. Related,
looking in to deferring jQuery until somewhat later in the page load
process.
** Blocked the train last week, had to roll back a change to
DBTransactionError
** Refactoring varnish log processing for better reusability
** Planning an offsite for June
=== Release Engineering ===
* Blocked by:
* Blocking:
* Updates:
=== Research ===
* Blocked by: None
* Blocking: None
* Updates:
** Started implementing the CitationUsage schema instrumentation:
https://phabricator.wikimedia.org/T191086
** Started identifying areas of improvement for the recommendation API:
https://phabricator.wikimedia.org/T190774
=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
** Trey published a blog post about names & search:
https://blog.wikimedia.org/2018/05/08/searching-for-names-is-not-always-str…
** Wikidata indexing for more properties enabled, pending reindex:
https://phabricator.wikimedia.org/T163642
** More wikis get deepcategory search enabled soon (~next week):
https://phabricator.wikimedia.org/T194139
** Working on Polish analyzer: https://phabricator.wikimedia.org/T186046
** Working on using Serbian analyzer for more languages:
https://phabricator.wikimedia.org/T192395
** Working on improving sharding of Elastic cluster:
https://phabricator.wikimedia.org/T192972
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
=== Security ===
* Blocked by:
* Blocking:
* Updates:
=== Services ===
* Blocked by: none
* Blocking: PDF service
* Updates:
** Kafka 1.1 🎉 Cheers to Analytics
** A lot of RESTBase patches are getting deployed
** A big thank for everyone who reached to us regarding the jobs callout
from last week
=== Site Reliability Engineering ===
* Blocked by:
* Blocking:
* Updates:
== Wikidata ==
* Blocked by:
** nodejs selenium tests to be stable and voting on ci they still fail most
of the time due to issues that are in mediawiki core or other extensions
and generally seem super flaky
** Enhanced recent changes don't format external usernames well in
contributors summary https://gerrit.wikimedia.org/r/#/c/428712/ (Any
objections?)
* Blocking:
* Updates:
** Normalize change tag schema - https://phabricator.wikimedia.org/T185355
** 2 weeks until Lexeme is live.
== German Technical Wishlist ==
* Blocked by:
** UCA category collation got declined because of …?
https://phabricator.wikimedia.org/T128806
* Blocking:
* Updates:
** AdvancedSearch is enabled as a Beta feature on all wikis:
https://phabricator.wikimedia.org/T193182
** Finalizing deepcategory search integration in AdvancedSearch:
https://phabricator.wikimedia.org/T194256
** Fixed a OOUI bug in IE10+: https://phabricator.wikimedia.org/T191287
** Raised test coverage of FileImporter to over 60%:
https://doc.wikimedia.org/cover-extensions/FileImporter/
** Working on a core fix needed for FileImporter:
https://phabricator.wikimedia.org/T193621
** Looking forward to the Hackathon
== SoS Meeting Bookkeeping ==
* Updates:
Hi all!
Several members of the Structured Data on Commons team will be at the
Wikimedia Hackathon in Barcelona next week. Join us there!
We will do an introduction and Q&A session, a session focused on GLAM
projects, and you are warmly welcomed to join us at the dedicated
Structured Commons corner/table(s) we'll have on location. Come and have
a chat!
More info here:
https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018/Structured_Commons
- please add your username to the list of participants if you're interested.
All the best! Sandra - on behalf of the team :-)
Hello,
I'm trying to ban @aol.com for signing up to wikimediacz-l. This is a
member-only list for Wikimedia Czech Republic members and as aol.com is
pretty unfrequent in Czechia, I don't expect any problems (and if there
will be some, members of the list are added by a list administrator). There
is a big sign-up spam, so that's the reason why I decided to issue the
block.
If there is a way how to enforce manual adding by a list administrator,
I'll be happy, but helping how to add whole aol.com to ban_list will be
useful. I tried to add "^.*(a)aol.com$" (a regex) to the ban_list variable,
but this apparently do not help, still some aol addresses are able to sign
up.
Thank you in advance for any help.
Martin