Discovery February 2018

discovery@lists.wikimedia.org

6 participants
8 discussions

Fwd: [Maps-l] Map improvements 2018

by Deborah Tankersley

Cross posting on this mailing list: Map Improvements in 2018 have been announced: https://www.mediawiki.org/wiki/Map_improvements_2018. Cheers, Deb -- deb tankersley Program Manager, Engineering Wikimedia Foundation ---------- Forwarded message ---------- From: Albin Larsson <albin.post(a)gmail.com> Date: Mon, Feb 26, 2018 at 11:13 PM Subject: [Maps-l] Map improvements 2018 To: Maps <maps-l(a)lists.wikimedia.org> The WMF has announced that they will be making improvements to the map infrastructure during the first half of 2018. Improvements includes making the infrastructure more stable and "All map location names should be shown in the user's language" (I'm not sure if the later is about the data?). Project page on Mediawiki.org: https://www.mediawiki.org/wiki/Map_improvements_2018 Board on Phabricator: https://phabricator.wikimedia.org/project/board/2828/query/rSWQ9zrVUVS0/ // Albin User:Abbe98 _______________________________________________ Maps-l mailing list Maps-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l

5 years

Discovery Weekly Update for the week starting 2018-02-12

by Chris Koerner

Hello, This is the weekly update from the Search Platform team for the weeks of 2018-02-12 and 2018-02-19. As always, feedback and questions welcome. == Discussions == === Search === * SPARQL client has been added to core [0] * Deep category search (deepcategory: keyword) is implemented now [1] [2] * Profile management in CirrusSearch has been refactored and documented. [3] [4] * Gehel and Erik worked on collecting and displaying per node latency percentiles for the ElasticSearch cirrus clusters [5] [6] * Erik built an end to end integration test for Mjolnir [7] * David worked on fixing a failure with the language fallback for search that sometimes failed when the rescore profile doesn't exist on the target wiki [8] === Wikidata Query Service === * WDQS Mediawiki API service now supports continuations [9] [0] https://phabricator.wikimedia.org/T185127 [1] https://www.mediawiki.org/wiki/Help:CirrusSearch#Deepcategory [2] https://phabricator.wikimedia.org/T184840 [3] https://phabricator.wikimedia.org/T183279 [4] https://www.mediawiki.org/wiki/Extension:CirrusSearch/Profiles [5] https://phabricator.wikimedia.org/T183451 [6] https://grafana.wikimedia.org/dashboard/db/elasticsearch-per-node-percentil… [7] https://phabricator.wikimedia.org/T186157 [8] https://phabricator.wikimedia.org/T184008 [9] https://phabricator.wikimedia.org/T178712 --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R

5 years

Google removes "View image" button from image search results

by Chris Koerner

Preemptive apology for the cross-post I haven't seen this noted anywhere in our community and thought it was worthy of discussion. Google has removed an easily accessible button that would take you directly to the image file in search results. I wonder what impact this may have, if any, on the discovery and use of images hosted on Wikimedia projects (most notably Commons) that appear in these Google search results. https://twitter.com/searchliaison/status/964226180776845312 See also: https://www.theverge.com/2018/2/15/17017864/google-removes-view-image-butto… Hat tip to Quim Gil for sharing. Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years

Fwd: [Maps-l] "Why OpenStreetMap is in Serious Trouble"

by Deborah Tankersley

Apologies for cross-posting... Cheers, Deb -- deb tankersley Program Manager, Engineering Wikimedia Foundation ---------- Forwarded message ---------- From: Chris Koerner <ckoerner(a)wikimedia.org> Date: Fri, Feb 23, 2018 at 10:14 AM Subject: [Maps-l] "Why OpenStreetMap is in Serious Trouble" To: maps-l(a)lists.wikimedia.org In a blog post by Serge Wroclawski, a long time OpenStreetMap contributor and the founder of the OpenStreetMap US organization, outlines reasons why he believes OSM is in trouble. https://blog.emacsen.net/blog/2018/02/16/osm-is-in-trouble/ A choice quote. "The first problem that I feel plagues OSM is that the OpenStreetMap Foundation views the mission of the project to provide the world a geographic database, but not geographic services." See also this thread on the OSM-talk mailing list: https://lists.openstreetmap.org/pipermail/talk/2018-February/080161.html Yours, Chris Koerner Community Liaison Wikimedia Foundation _______________________________________________ Maps-l mailing list Maps-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l

5 years, 1 month

Discovery Weekly Update for the week starting 2018-02-05

by Chris Koerner

Heya, Below you'll find the weekly update from the Search Platform team for the week starting 2018-02-05. As always, feedback and questions welcome. == Discussions == === Search === * Gehel took on the task of porting elasticsearch metrics to Prometheus [0] * Erik investigated a replacement for our automated relevance labeling and created a potential summer of code task [1] == Other Noteworthy Stuff == * Trey deployed Cyrillic/Latin transliteration (using Language Converter [2]) for Crimean Tatar–language wikis.[3] == Did you know? == * There are an estimated 7,000+ languages [4] spoken or signed in the world. Over 800 of them are found in Papua New Guinea, [5] making it the most linguistically diverse place on earth. The most widely used language of PNG is Tok Pisin, [6] which is a creole language, [7] which is a language derived from a mixture of other languages. Tok Pisin takes much of its vocabulary from English, but also from German, Malay, Portuguese and local Austronesian languages. [0] https://phabricator.wikimedia.org/T181627 [1] https://phabricator.wikimedia.org/T186742 [2] https://www.mediawiki.org/wiki/Parsoid/Language_conversion [3] https://crh.wikipedia.org/wiki/Ba%C5%9F_Saife [4] https://en.wikipedia.org/wiki/Lists_of_languages#Published_lists [5] https://en.wikipedia.org/wiki/Languages_of_Papua_New_Guinea [6] https://en.wikipedia.org/wiki/Tok_Pisin [7] https://en.wikipedia.org/wiki/Creole_language --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 1 month

Fwd: [Wikimania-program] Wikimania 2018 Call for Submissions

by Deborah Tankersley

Hello, The call for submissions for Wikimania 2018 <https://wikimania2018.wikimedia.org/wiki/Wikimania> is now open (with apologies for cross-posting), woohoo! Full instructions on making a proposal is here: https://wikimania2018.wikimedia.org/wiki/Submissions (deadline is March 18th, 2018) and additional event information is in the email below. We're looking forward to seeing you all in Cape Town, South Africa this July! Cheers, Deb -- deb tankersley Program Manager, Engineering Wikimedia Foundation ---------- Forwarded message ---------- From: Liam Wyatt <liamwyatt(a)gmail.com> Date: Sun, Feb 4, 2018 at 11:21 PM Subject: [Wikimania-program] Wikimania 2018 Call for Submissions To: "Wikimania general list (open subscription)" < wikimania-l(a)lists.wikimedia.org>, Wikimedia Mailing List < wikimedia-l(a)lists.wikimedia.org> Cc: Program committee list <wikimania-program(a)lists.wikimedia.org> Dear Wikimedia community, We are pleased to announce that Wikimania 2018 is now accepting proposals for workshops, discussions, presentations, or research posters to give during the conference. To read the full instructions visit the event wiki and click on the link provided there to make your proposal: https://wikimania2018.wikimedia.org/wiki/Submissions The deadline for submissions is 23:59 UTC on *Sunday March 18, 2018*. This is approximately 6 weeks away. Whether you are a community member of one of the Wikimedia projects, or a fellow open content creator or consumer, we welcome your proposal for a session. *Theme* This year, the conference will be taking place in Cape Town, South Africa, where the organisers are giving this Wikimania a unique flavor — an explicit theme based in African philosophy: “Bridging knowledge gaps, the *ubuntu* way forward.” Read more about this theme, why it was chosen, and what it means for the conference program at the Wikimedia blog: *https://blog.wikimedia.org/2018/02/05/wikimania-cape-town-ubuntu/ <https://blog.wikimedia.org/2018/02/05/wikimania-cape-town-ubuntu/>* Throughout the conference program, this theme will be tightly held, but loosely defined - in order to encourage a diverse range of responses to the theme. It is our hope that this theme will give us the opportunity to further our goal of creating the “sum of human knowledge”, by encouraging greater diversity and inclusion in who participates and what we discuss at Wikimania. To learn more, and to make a proposal for the conference, please visit: https://wikimania2018.wikimedia.org/wiki/Submissions Please forward this announcement to other lists and groups across the Wikimedia movement. <https://wikimania2018.wikimedia.org/wiki/Submissions> We look forward to reading your submissions. Sincerely, *Program committee co-chairs Emna Mizouni, Felix Nartey, and Liam Wyatt.* _______________________________________________ Wikimania-program mailing list Wikimania-program(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimania-program

5 years, 1 month

Readers core metrics for Q2 (Oct-Dec 2017)

by Tilman Bayer

The slide deck from yesterday's quarterly metrics presentation of the Wikimedia Foundation's Readers team has been published.[1] This deck gives an overview of core metrics regarding readership of Wikimedia sites, including some data about search and maps usage. It is an appendix to the Readers team's main quarterly check-in presentation, which is available at [2]. [1] https://commons.wikimedia.org/wiki/File:Wikimedia_Foundation_Readers_metric… [2] https://commons.wikimedia.org/wiki/File:Readers_Q2_check-in_January_2018.pdf -- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB

5 years, 1 month

Discovery Weekly Update for the week starting 2018-01-29

by Chris Koerner

Hello again, Below you'll find the weekly update from the Search Platform team for the week starting 2018-01-29. == Highlights== * Several members of the Search Platform team participated in the annual Developer Summit held January 22-23, 2018 in Berkeley, California. [0] * During the WMF's All Hand's two day event, the Search Platform team met with the WMDE team and the Multimedia team to talk about the future of search and how the teams can work together on Structured Data on Commons. * The Search Platform team had their team offsite the two days after the All Hands meetings — lots of great conversations about the future of search were had. * Q3 Goals can be found on MediaWiki.org [1] == Discussions == === Search === * Chris Schilling opened a Phab ticket (T185721) on the difficulties of searching in the Khmer script. [2] [3] The Unicode encoding for the script uses many diacritics, and (with proper font support) the same glyph can be properly written with the underlying Unicode characters in any of several different orders, which complicates searching. If you are interested in learning more—or if you have any experience with computing in Khmer—please check out the Phab ticket. * Erik made a new utility script that reads in the spark dataframe and emits binary xgboost datasets to hdfs; all in order to switch Mjolnir to file based training [4] * Gehel cleaned up multiple definitions of logstash endpoint in puppet / hiera so that almost all references to the logstash host are now consolidated in a single variable [5] * Stas added hidden status to category dumps, to be deployed on Feb 7 [6] === Analysis === * Chelsy finished up a draft analysis result on a MLR test on Hebrew wiki that is being reviewed by the Search Platform team [7] [8] === WDQS === * Gehel took on the large-ish task of defining the constraints of the new WDQS cluster and getting that information on wiki. [9] [10] * Stas added support for continuations to WDQS queries to Mediawiki API [11] == Did you know? == English has a very large vocabulary—possibly larger than any other language. [12] In part this is because English likes to "[pursue] other languages down alleyways to beat them unconscious and rifle their pockets for new vocabulary," [13] and in part because of its history [14]—particularly the Norman conquest, which brought in a ruling class that spoke a dialect of Old French. An interesting consequence of this history is that English has distinct words for the animal, "cow," and for the meat of that animal, "beef." Surprisingly, both come from the same Proto-Indo-European [15] root: "gʷṓws". [16] The word "cow" derives from Proto-Germanic "kūz," while "beef" was borrowed from Old French "boef", derived in turn from Latin "bōs". Both "kūz" and "bōs" come from PIE "gʷṓws," though they obviously followed very different sound change [17] paths along the way. [0] https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit/2018 [1] https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2017-18_Q3#Progra… [2] https://phabricator.wikimedia.org/T185721 [3] https://en.wikipedia.org/wiki/Khmer_alphabet [4] https://phabricator.wikimedia.org/T184547 [5] https://phabricator.wikimedia.org/T182304 [6] https://phabricator.wikimedia.org/T173980 [7] https://phabricator.wikimedia.org/T183024 [8] https://analytics.wikimedia.org/datasets/discovery/reports/Second_MLR_Test_… [9] https://phabricator.wikimedia.org/T184083 [10] https://www.mediawiki.org/wiki/Wikidata_query_service/Implementation#Usage_… [11] https://phabricator.wikimedia.org/T178712 [12] https://en.wikipedia.org/wiki/English_language#Vocabulary [13] https://en.wikiquote.org/wiki/English_language [14] https://en.wikipedia.org/wiki/History_of_English [15] https://en.wikipedia.org/wiki/Proto-Indo-European_language [16] https://en.wiktionary.org/wiki/Reconstruction:Proto-Indo-European/g%CA%B7%E… [17] https://en.wikipedia.org/wiki/Sound_change --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 1 month

2023

2022

2021

2020

2019

2018

2017

2016

2015

Discovery February 2018