Discovery January 2018

discovery@lists.wikimedia.org

6 participants
5 discussions

bias in ores from the is_anonymous feature

by Erik Bernhardson

We talked about this briefly in our meeting today, i got the links from Aaron for the original slides[1] and talk[2] (starts about half way through). i don't think we are using any features with as strong of a bias as the logged in bit for ores, but still something to think about. [1] https://www.mediawiki.org/wiki/File:Deploying_and_maintaining_AI_in_a_socio… [2] https://www.youtube.com/watch?v=rsFmqYxtt9w

5 years, 1 month

Discovery Weekly Update for the week starting 2018-01-15

by Chris Koerner

Hello, A quick update this week. Below you'll find the weekly update from the Search Platform team for the week starting 2018-01-15. *Programming note*: Due to the Wikimedia Foundation Developers Summit and All-hands event there won't be an update for the week of 22 Jan. We'll resume the week after, 29 Jan. === Search === * Trey put together a 45 minute presentation covering the very basics on how full-text search works. There's more information in the description on Commons. [0] == Did you know? == * Basque, [1] spoken in the Basque Country between France and Spain, is a linguistic isolate, [2] meaning that it is not known to be related to any other language. Korean [3] is also a linguistic isolate. The origin of most spoken isolates like these is lost to history—though many linguists believe they are in fact related to other spoken languages, just so distantly that the relationship cannot be conclusively proven. However, a signed isolate—Nicaraguan Sign Language [4]—came into existence among deaf children in Nicaragua in the 1970s and 1980s, and linguists were able to document its fascinating development! [0] https://commons.wikimedia.org/wiki/File:BareBonesSearch.webm [1] https://en.wikipedia.org/wiki/Basque_language [2] https://en.wikipedia.org/wiki/Language_isolate [3] https://en.wikipedia.org/wiki/Korean_language [4] https://en.wikipedia.org/wiki/Nicaraguan_Sign_Language --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 2 months

Discovery Weekly Update for the week starting 2018-01-08

by Chris Koerner

Hello, This is the weekly update from the Search Platform team for the week starting 2018-01-08. == Highlights== * Latvian and Arabic Wikipedia's enabled mapframe on their respective wiki's (completed by community volunteers) [0] [1] == Discussions == === Search === * David tuned the wikidata fulltext search similarity parameters [2] * Stas fixed an issue with the IDs option in forceSearchIndex.php is broken [3] * Trey finished his initial analysis of phonetic algorithms available in Elasticsearch. [4] === Portal === * The portal's stats and translations were updated on January 8, 2018 via our mostly automated process [5] [6] * Jan updated "liguru" to "lìgure" on the Wikipedia portal [7] == Did you know? == * Last October, the President of Kazakhstan announced that the country would switch from the Cyrillic to Latin alphabet.[8] As a result, over the course of about 100 years, the writing system for Kazakh will have changed from Arabic to Latin to Cyrillic and back to Latin. Several Turkic languages[9] spoken in former Soviet Republics have gone through similar shifts, including Azerbaijani,[10] Turkmen,[11] and Uzbek [12]—with the most recent shift to Latin for some beginning in the 1990s. Thus some speakers of those languages lived through all three changes to their official writing system. == FY 2017-18 Q3 (Jan-Mar) goals == This status was last updated 2018-01-08. [13] [0] https://phabricator.wikimedia.org/T183981 [1] https://phabricator.wikimedia.org/T183764 [2] https://phabricator.wikimedia.org/T182293 [3] https://phabricator.wikimedia.org/T183197 [4] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Overview_of_Phonetic… [5] https://phabricator.wikimedia.org/T128546 [6] https://phabricator.wikimedia.org/T142582 [7] https://phabricator.wikimedia.org/T180772 [8] https://en.wikinews.org/wiki/Kazakhstan:_President_Nazarbayev_signs_decree_… [9] https://en.wikipedia.org/wiki/Turkic_languages [10] https://en.wikipedia.org/wiki/Azerbaijani_alphabet [11] https://en.wikipedia.org/wiki/Turkmen_alphabet [12] https://en.wikipedia.org/wiki/Uzbek_alphabet [13] https://www.mediawiki.org/wiki/Discovery/Status_updates/2018-01-08#FY_2017-… --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 2 months

Re: [discovery] [Wikidata] Code level documentation / reporting for Wikidata Query Service

by Guillaume Lederrey

Thanks for the feedback! On Tue, Jan 16, 2018 at 12:10 AM, Alessio Melandri <alessiom92(a)gmail.com> wrote: > Thanks Guillaume, I really appreciate it! > > Reading them I've found that all the links in > https://doc.wikimedia.org/wikidata-query-rdf/parent/ are pointing to > https://doc.wikimedia.org/index.html currently a 404. Yes, I know about the issue, but I have not had time to dig into it yet. Maven does some strange magic to convert links to relative links, but it fails in this case. Strangely enough, the links on the left menu point to the same page, but work... I'll try to find some time to fix this, but it isn't very high on my priority list at the moment. Patches are always welcomed! Have fun! Guillaume > Thanks, > > Alessio > > 2018-01-04 10:27 GMT+01:00 Guillaume Lederrey <glederrey(a)wikimedia.org>: >> >> Hello all! >> >> We are now publishing a bunch of documentation / reports on the code >> behind Wikidata Query Service [1]. All this is very developer >> oriented, so skip the rest of this email if you just want to use the >> service. >> >> All the reports are generated via Maven, and reflect the current state >> of the master branch of the project [2]. Reports are organized by >> modules. Feel free to browse through them and see if you find anything >> interesting. A few pointers to get started (links provided to the >> "tools" module, the same reports are available for other modules as >> well): >> >> * JaCoCo code coverage [3]: line and branch unit test coverage >> * JDepend [4]: a few slightly obscure code metrics. Package cycles and >> "distance" are interesting ones. >> * Dependency updates [5]: which of our dependencies could be upgraded >> (yes, we have some work to do on that side) >> >> If you know about other interesting reports that could be added to >> that collection, feel free to reach out to me. And if you want to >> start addressing some of those issues, patches are always welcomed! >> >> Thanks for your time... >> >> Guillaume >> >> >> [1] https://doc.wikimedia.org/wikidata-query-rdf/parent/ >> [2] https://github.com/wikimedia/wikidata-query-rdf/ >> [3] >> https://doc.wikimedia.org/wikidata-query-rdf/parent/tools/jacoco/index.html >> [4] >> https://doc.wikimedia.org/wikidata-query-rdf/parent/tools/jdepend-report.ht… >> [5] >> https://doc.wikimedia.org/wikidata-query-rdf/parent/dependency-updates-repo… >> >> -- >> Guillaume Lederrey >> Operations Engineer, Discovery >> Wikimedia Foundation >> UTC+2 / CEST >> >> _______________________________________________ >> Wikidata mailing list >> Wikidata(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikidata > > > > _______________________________________________ > Wikidata mailing list > Wikidata(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikidata > -- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation UTC+2 / CEST

5 years, 2 months

Code level documentation / reporting for Wikidata Query Service

by Guillaume Lederrey

Hello all! We are now publishing a bunch of documentation / reports on the code behind Wikidata Query Service [1]. All this is very developer oriented, so skip the rest of this email if you just want to use the service. All the reports are generated via Maven, and reflect the current state of the master branch of the project [2]. Reports are organized by modules. Feel free to browse through them and see if you find anything interesting. A few pointers to get started (links provided to the "tools" module, the same reports are available for other modules as well): * JaCoCo code coverage [3]: line and branch unit test coverage * JDepend [4]: a few slightly obscure code metrics. Package cycles and "distance" are interesting ones. * Dependency updates [5]: which of our dependencies could be upgraded (yes, we have some work to do on that side) If you know about other interesting reports that could be added to that collection, feel free to reach out to me. And if you want to start addressing some of those issues, patches are always welcomed! Thanks for your time... Guillaume [1] https://doc.wikimedia.org/wikidata-query-rdf/parent/ [2] https://github.com/wikimedia/wikidata-query-rdf/ [3] https://doc.wikimedia.org/wikidata-query-rdf/parent/tools/jacoco/index.html [4] https://doc.wikimedia.org/wikidata-query-rdf/parent/tools/jdepend-report.ht… [5] https://doc.wikimedia.org/wikidata-query-rdf/parent/dependency-updates-repo… -- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation UTC+2 / CEST

5 years, 2 months

2023

2022

2021

2020

2019

2018

2017

2016

2015

Discovery January 2018