Wiki-research-l June 2023

wiki-research-l@lists.wikimedia.org

14 participants
15 discussions

New private, granular pageview dataset
by Hal Triedman 19 Mar '24

19 Mar '24

Hello world! My name is Hal Triedman, and I’m a senior privacy engineer at WMF. I work to make data that WMF releases about reading, editing, and other on-wiki behavior safer, more granular, and more accessible to the world using differential privacy <https://en.wikipedia.org/wiki/Differential_privacy>. Today I’m reaching out to share that WMF has released almost 8 years (from 1 July 2015 to present) of privatized pageview data <https://diff.wikimedia.org/2023/06/21/new-dataset-uncovers-wikipedia-browsi…>, partitioned by country, project, and page. This data is significantly more granular than other datasets we release, and should help researchers to disambiguate both long- and short-term trends within languages on a country-by-country basis — several <https://phabricator.wikimedia.org/T207171> long-standing requests <https://phabricator.wikimedia.org/T267283> from Wikimedia communities. Due to various technical factors, there are three distinct datasets: - 1 July 2015 – 8 Feb 2017 <https://analytics.wikimedia.org/published/datasets/country_project_page_his…> / README <https://analytics.wikimedia.org/published/datasets/country_project_page_his…> (publishing threshold [1]: 3,500 pageviews) - 9 Feb 2017 – 5 Feb 2023 <https://analytics.wikimedia.org/published/datasets/country_project_page_his…> / README <https://analytics.wikimedia.org/published/datasets/country_project_page_his…> (publishing threshold: 450 pageviews) - 6 Feb 2023 – present <https://analytics.wikimedia.org/published/datasets/country_project_page/> / README <https://analytics.wikimedia.org/published/datasets/country_project_page/00_…> (publishing threshold: 90 pageviews) API access to this data should be coming in the next few months. In the interim, I’ve built an example python notebook <https://public-paws.wmcloud.org/67457802/private_pageview_data_access.ipynb> illustrating how one might access the data in its current csv format, as well as several different kinds of simple analyses that can be done with it. I also want to invite the research community to join me for a brief demo of this project at the July Research Showcase <https://www.mediawiki.org/wiki/Wikimedia_Research/Showcase>. In the meantime, please feel free to reach out with any questions on the project talk page <https://meta.wikimedia.org/wiki/Talk:Differential_privacy>. For more information about WMF’s work on differential privacy more generally, see the differential privacy homepage on meta <https://meta.wikimedia.org/wiki/Differential_privacy>. And in the future, look for more announcements of privatized datasets on editor behavior, on-wiki search, centralnotice impressions and clicks, and more. Best, Hal [1] “Publishing threshold” is the minimum value of a row in the dataset in order to be published.

3 7

[events] Wiki Workshop 2023 Announcement
by Leila Zia 26 Jul '23

26 Jul '23

Hi everyone, Wiki Workshop [1 <https://wikiworkshop.org/>] 2023 will be the 10th edition of Wiki Workshop! \o/ In the spirit of research and experimentation, we have decided to make some changes for this decade edition event. There are some changes that we know about now, and some that are work in progress. Below you can learn more about the high level changes we expect to implement. *Online or in-person?* Based on the feedback that we have gathered from Wiki Workshop attendees over the past few years, a survey of authors of the recent Wiki Workshops, as well as data about the geographical and gender diversity of Wiki Workshop attendees (disclosed optionally as part of the registration form, and aggregated), *we have decided to offer Wiki Workshop 2023 as a fully online event*. Through the authors' survey we also learned that some authors who publish in Wiki Workshop appreciated the in-person presence of the Wiki Workshop community as part of the Web Conference [2 <https://www2023.thewebconf.org/>] (formerly WWW). *We are exploring options to bring the Wikimedia researchers who will attend TheWebConf 2023 in-person together while some of us will be in Austin*. More details on this in early 2023. *When* We expect the workshop to take place some time in April-June 2023. We will announce the exact date no later than the end of February 2023. *Publishing and proceedings* When we surveyed Wiki Workshop authors, those who responded were split 50-50 between whether it is important for them to have their workshop submission as part of a proceedings. This allowed us to start considering options other than the Companion Proceedings of WWW (the traditional venue where a subset of Wiki Workshop papers were published in every year). I'm very excited to share that we have found a new approach for publishing Wiki Workshop papers that can allow us to experiment with new models and keep the two groups of authors happy. For the 2023 edition, *we will continue with the tradition of receiving paper submissions for Wiki Workshop* (though we may change the submission format/length for 2023)* and all accepted papers will appear in the **corresponding Wiki Workshop website*, similar to last year's. [3 <https://wikiworkshop.org/2022/#papers>] However, instead of accepting a subset of the papers to appear in Proceedings of WWW, we are working with the Editor in Chief of ACM Transactions on the Web (TWEB) [4 <https://dl.acm.org/journal/tweb>] to create a pathway for a subset of the Wiki Workshop papers (likely after being extended) to be submitted for review to *a special edition of ACM TWEB*. There are a lot of details for us to work on to make the TWEB special edition happen and that means this year you should expect to receive the Call for Paper for Wiki Workshop some time in late January to middle of February 2023 (instead of the usual December time-frame). I am very excited about the opportunity for the work of the Wikimedia research and Wiki Workshop community to be published as part of ACM Transactions on the Web and I'm very grateful to Ryen White, Editor-in-Chief of ACM TWEB, for being welcoming in exploring this idea and offering a special edition space (details tbd). *Other changes* There are some other high level schedule changes that we may make for the 2023 edition. If you like to stay informed about these changes at a granular level and over time, you're welcome to subscribe to the Phabricator task where these changes will be tracked: https://phabricator.wikimedia.org/T313530 . We hope to be back with more updates for you in early 2023. Best, Leila, Bob and Emily p.s. Please note that I didn't run the text of this email with Bob and Emily (cc-ed). We have coordinated and discussed these changes among ourselves, and they're welcome to add/update as they see fit. [1] https://wikiworkshop.org/ [2] https://www2023.thewebconf.org/ [3] https://wikiworkshop.org/2022/#papers [4] https://dl.acm.org/journal/tweb -- Leila Zia Head of Research Wikimedia Foundation

1 1

Wikipedia Research policy
by song＠cs.umn.edu 14 Jul '23

14 Jul '23

Pursuant to prior discussions about the need for a research policy on Wikipedia, WikiProject Research is drafting a policy regarding the recruitment of Wikipedia users to participate in studies. At this time, we have a proposed policy, and an accompanying group that would facilitate recruitment of subjects in much the same way that the Bot Approvals Group approves bots. The policy proposal can be found at: http://en.wikipedia.org/wiki/Wikipedia:Research The Subject Recruitment Approvals Group mentioned in the proposal is being described at: http://en.wikipedia.org/wiki/Wikipedia:Subject_Recruitment_Approvals_Group Before we move forward with seeking approval from the Wikipedia community, we would like additional input about the proposal, and would welcome additional help improving it. Also, please consider participating in WikiProject Research at: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Research -- Bryan Song GroupLens Research University of Minnesota

8 10

Partnership Proposal: UNESCO WHV "Ahmedabad: From the lenses of Built Heritage"
by Khushi Shah 29 Jun '23

29 Jun '23

Hello Wikimedians! I am Khushi Shah, the director of Khushtar Heritage Collective. As per our conversation, I am sending the details of the World Heritage Volunteer program that I am hosting in Ahmedabad, India, from August 1st to August 10th, 2023. *The World Heritage Volunteers (WHV) Initiative, launched in 2008 in partnership with the Coordinating Committee for International Voluntary Service (CCIVS), aims to engage and mobilize young individuals and youth organizations in the preservation and promotion of World Heritage sites. Presently, the initiative is jointly coordinated by the UNESCO World Heritage Centre and Better World.* Our 10-day workshop, titled *"Ahmedabad: From the lenses of built heritage,"* will focus on interactive learning activities that delve into the concepts of heritage, the significance of heritage and culture in society, and the technical aspects of conserving historical properties. For the same, I was wondering if any of the Wikimedia Research team would like to collaborate with us. The collaboration can benefit both of us while also engaging more youth in heritage and culture. Would you be interested in talking further about a possible collaboration? I have attached a brochure of a tentative list of activities planned during the workshop. I would love to hear your thoughts. Best regards.

3 2

[CfP][FCR-2023] 9th Workshop on Formal and Cognitive Reasoning
by Kai Sauerwald 27 Jun '23

27 Jun '23

* Apologies if you receive multiple copies of this call * ========================================= ========== 2nd Call for Papers ============== 9th Workshop on Formal and Cognitive Reasoning (FCR-2023) https://www.fernuni-hagen.de/wbs/fcr2023.html co-located with the 46th German Conference on Artificial Intelligence in Berlin, Germany (KI 2023) ======================================== Aims and Scope -------------- In real-life AI applications, information is usually pervaded by uncertainty and subject to change, and thus requires non-classical systems. At the same time, psychological findings indicate that human reasoning cannot be completely described by classical logical systems. Sources of explanations are incomplete knowledge, incorrect beliefs, or inconsistencies. A wide range of reasoning mechanisms has to be considered, such as analogical or defeasible reasoning, possibly in combination with machine learning methods. The field of knowledge representation and reasoning offers a rich palette of methods for uncertain reasoning both to describe human reasoning and to model AI approaches. The aim of this series of workshops is to address recent challenges and to present novel approaches to uncertain reasoning and belief change in their broad senses, and in particular provide a forum for research work linking different paradigms of reasoning. A special focus is on papers that provide a base for connecting formal-logical models of knowledge representation and cognitive models of reasoning and learning, addressing formal and experimental or heuristic issues. Previous events of the Workshop on "Formal and Cognitive Reasoning" and joint workshops took place in Dresden (2015), Bremen (2016), Dortmund (2017), Berlin (2018), Kassel (2019), Bamberg (2020, online), Berlin (2021, online), and Trier (2022, online). We welcome papers on the following and any related topics: Action and change Agents and multiagent systems Analogical reasoning Argumentation theories Belief change and belief merging Cognitive modeling and empirical data Common sense and defeasible reasoning Computational thinking Decision theory and preferences Inductive reasoning and cognition Knowledge representation in theory and practice Learning and knowledge discovery in data Nonmonotonic and uncertain reasoning Ontologies and description logics Probabilistic approaches of reasoning Syllogistic reasoning Publication ----------- The proceedings will be published in the CEUR Workshop proceedings series. Workshop Organizers and Co-Chairs --------------------------------- Christoph Beierle FernUniversität in Hagen, Germany Kai Sauerwald FernUniversität in Hagen, Germany François Schwarzentruber University of Rennes, CNRS, IRISA, France Frieder Stolzenburg Hochschule Harz, Germany Program Committee ----------------- Theofanis Aravanis University of Patras, Greece Laura Giordano Università del Piemonte Orientale, Italy Jesse Heyninck Open Universiteit Heerlen, the Netherlands Haythem O. Ismail German University in Cairo, Egypt Gabriele Kern-Isberner TU Dortmund, Germany Jean-Guy Mailly Université Paris Cité, France Meltem Ozturk Université Paris Dauphine, France Özgür Lütfü Özcep University of Lübeck, Germany Sylwia Polberg Cardiff University, UK Ute Schmid Universität Bamberg, Germany Claudia Schon Universität Koblenz-Landau, Germany Matthias Thimm FernUniversität in Hagen, Germany Markus Ulbricht University of Leipzig, Germany Johannes P. Wallner Graz University of Technology, Austria Christoph Wernhard Technische Universität Dresden, Germany Important Dates --------------- Deadline for Submission: July 9, 2023 Notification of Authors: September 3, 2023 Camera-ready Paper: September 13, 2023 Workshop: September 26, 2023 Submission Details ------------------ Papers should be formatted in CEUR style (2-column style) without enabled header and footer. The author kit can be found at http://ceur-ws.org/Vol-XXX/CEURART.zip. The length of each paper should not exceed 8-12 pages. All papers must be written in English and submitted in PDF format via the EasyChair system. One of the authors is expected to participate in the workshop and present their paper.

1 0

The June 2023 issue of the Wikimedia Research Newsletter is out
by ABDUL-RAFIU FUSEINI 22 Jun '23

22 Jun '23

Hi everyone, The June 2023 issue of the Wikimedia Research Newsletter is out: https://meta.wikimedia.org/wiki/Research:Newsletter/2023/June In this issue: 1. "New articles about currently popular topics are more likely to be hoaxes" 2. Briefly *** 6 recent publications were covered or listed in this issue *** Alhaji Darajaati on behalf of the Newsletter team --- Wikimedia Research Newsletter * https://meta.wikimedia.org/wiki/Research:Newsletter/ * Follow us on Twitter: https://twitter.com/WikiResearch * Follow us on Mastodon: https://mastodon.social/@wikiresearch * Like us on Facebook: Facebook.com/WikiResearch/ * Receive this newsletter by mail: Research-newsletter Mailing List - Wikimedia

1 0

Wikimedia Research Showcase June 21 at 16:30 UTC
by Pablo Aragón 21 Jun '23

21 Jun '23

Hi all, The next Research Showcase, with the theme of *Wikimedia and LGBTQIA+*, will be live-streamed Wednesday, June 21 at 16:30 UTC. Find your local time here <https://zonestamp.toolforge.org/1687365012>. YouTube stream: https://www.youtube.com/watch?v=AOD2ZdxRNfo You can join the conversation on IRC at #wikimedia-research or on the YouTube chat. This month's presentations: - *Multilingual Contextual Affective Analysis of LGBT People Portrayals in Wikipedia* - *Speaker*: Chan Park, Carnegie Mellon University - *Abstract*: In this talk, I present our research on analyzing the portrayal of LGBT individuals in their biographies on Wikipedia, with a particular focus on subtle word connotations and cross-cultural comparisons. We aim to address two primary research questions: 1) How can we effectively measure the nuanced connotations of words in multilingual texts, which reflect sentiments, power dynamics, and agency? 2) How can we analyze the portrayal of a specific group, such as the LGBT community, and compare these portrayals across different languages? To answer these questions, we collect the Multilingual Contextualized Connotation Frames dataset, comprising 2,700 examples in English, Spanish, and Russian. We also develop a new multilingual model based on pre-trained multilingual language models. Additionally, we devise a matching algorithm to construct a comparison corpus for the target corpus, isolating the attribute of interest. Finally, we showcase how our developed models and constructed corpora enable us to conduct cross-cultural analysis of LGBT People Portrayals on Wikipedia. Our results reveal systematic differences in how the LGBT community is portrayed across languages, surfacing cultural differences in narratives and signs of social biases. - *Paperː* Park, C. Y., Yan, X., Field, A., & Tsvetkov, Y. (2021, May). Multilingual contextual affective analysis of LGBT people portrayals in Wikipedia. In Proceedings of the International AAAI Conference on Web and Social Media (Vol. 15, pp. 479-490). <https://arxiv.org/pdf/2010.10820.pdf> - *Visual gender biases in Wikipediaː A systematic evaluation across the ten most spoken languages* - *Speaker*: Daniele Metilli, University College London - *Abstract*: Wikidata Gender Diversity (WiGeDi) is a one-year project funded through the Wikimedia Research Fund. The project is studying gender diversity in Wikidata, focusing on marginalized gender identities such as those of trans and non-binary people, and adopting a queer and intersectional feminist perspective. The project is organised in three strands — model, data, and community. First, we are looking at how the current Wikidata ontology model represents gender, and the extent to which this representation is inclusive of marginalized gender identities. We are analysing the data stored in the knowledge base to gather insights and identify possible gaps and biases. Finally, we are looking at how the community has handled the move towards the inclusion of a wider spectrum of gender identities by studying a corpus of user discussions through computational linguistics methods. This presentation will report on the current status of the Wikidata Gender Diversity project and the envisioned outcomes. We will discuss the main challenges that we are facing and the opportunities that our project will potentially enable, on Wikidata and beyond. - *Paperː* Metilli D. & Paolini C. (in press). ‘Non-binary gender representation in Wikidata’. In: Provo A., Burlingame K. & Watson B.M. Ethics in Linked Data. Litwin Books. <https://wigedi.com/chapter.pdf> You can watch our past Research Showcases here: https://www.mediawiki.org/wiki/Wikimedia_Research/Showcase Hope you can join us! Warm regards, -- *Pablo Aragón (he/him)* Research Scientist Wikimedia Foundation https://research.wikimedia.org

1 2

[CfP] SEMANTiCS 2023 EU - Call for Workshop Papers
by Anisa Rula & Jennifer D'Souza 21 Jun '23

21 Jun '23

* We apologize if you receive multiple copies of this CFP * * For the online version of this call, please visit: https://2023-eu.semantics.cc/page/workshops * SEMANTiCS 2023 (20th-22nd September - Leipzig, Germany) is hosting an enriched collection of three workshops accepting submissions for contributions: Onto4FAIR: 3rd Workshop on Ontologies for FAIR and FAIR Ontologies Organizers: Cassia Trojahn (Institut de Recherche en Informatique de Toulouse, France), Luiz Olavo Bonino da Silva Santos (University of Twente, Leiden University Medical Centre, the Netherlands), Giancarlo Guizzardi (University of Twente, the Netherlands), Clement Jonquet (French National Research Institute for Agriculture, Food and Environment, Mathematics, Informatics and Statistics for Environment and Agronomy research unit, Montpellier, France) https://onto4fair.github.io/2023-semantics.html Sem4Tra: 5th International Workshop On A Semantic Data Space For Transport Organizers: David Chaves Fraga (Senior Researcher, UPM & KULeuven), Mersedeh Sadeghi (Senior Researcher, University of Cologne), Shahrom Sohi (Researcher, WU), Julián Rojas (Postdoc Researcher, imec - IDLab UGent), Pieter Colpaert (Senior Researcher, imec - IDLab UGent) https://sem4tra2023.linkeddata.es/ NLP4KGC: 2nd Workshop on Natural Language Processing for Knowledge Graph Construction Organizers: Edlira Vakaj (Birmingham City University, Bermingham, UK), Sanju Tiwari (Universidad Autónoma de Tamaulipas, Tamaulipas, Mexico), Rizou Stamatia (Singular Logic, Athens, Greece), Nandana Mihindukulasooriya (IBM Research, Dublin, Ireland), Fernando Ortiz-Rodríguez (Universidad Autónoma de Tamaulipas, Tamaulipas, Mexico), Ryan Mcgranaghan (NASA Jet Propulsion Laboratory, California, United States) https://sites.google.com/view/2nd-nlp4kgc/home Looking forward to your submissions! With kind regards, Workshop & Tutorial Chairs

1 0

Re: [Wikitech-l] Re: Research on Wikimedia Production Errors
by Physikerwelt 13 Jun '23

13 Jun '23

Thank you for your feedback. I think we have a very large and open corpus of documented incidents. As said, the Wikidata workshop is not a good target conference. Following the reference [4]: <https://doi.org/10.1109/ICSE.2013.6606583> I think a paper on that would better fit https://conf.researchr.org/track/icse-2024/icse-2024-software-engineering-i… I will continue updating the paper on Overleaf https://www.overleaf.com/read/swswtbdyyhmg All the best Moritz On Thu, Jun 8, 2023 at 7:57 PM Tyler Cipriani <tcipriani(a)wikimedia.org> wrote: > > > > On Thu, Jun 8, 2023 at 12:40 AM Physikerwelt <wiki(a)physikerwelt.de> wrote: >> >> Hi all, >> >> is there any research on common causes of Wikimedia production errors? >> >> Based on recent examples, I plan to analyze and discuss how production >> errors could be avoided. I am considering submitting a short paper on >> that to the Wikidata workshop, with the deadline >> Thursday, 20 July 2023 >> Website: https://wikidataworkshop.github.io/2023/ >> However, there might be better suitable venues. > > > We (Release Engineering) file production-error tasks as part of the weekly train and collect some data in the "train-stats" repo on GitLab[0]. Additionally, Timo Tijhof's "production excellence" blog posts and emails to this list may be of interest to you[1]. > > The "train-stats" repo collects data for "software defect prediction" based on the use of "FixCaches" or "BugCaches."[2] Each week, we record changes that fix bugs (i.e., the change uses the git trailer `Bug: TXXX` and gets backported to a currently deployed branch). The theory (per the paper linked above) is that the more often a file needs a fix, the more likely it is to cause future bugs. I have an extremely convoluted query to show the list of commonly backported files[3]. > > Problems with this data: > - Many of these files are frequently touched files vs error-prone files (e.g., "composer.json") > - Looking at the count of backports for each file means newer files are less likely to be represented > - "Lower level" files may be overrepresented (although, that's probably to be expected) > > In 2013, a case study used data like this inside Google and found it to be fairly accurate at predicting future bugs[4]. > > Also, in the case study, whenever a developer edited a file that was present in their fixCache, researchers added a bot-generated note to the patch in their code review tool.Their developers found this note unhelpful: developers already knew these files were problematic—the warning just caused confusion. > > Based on that, in March 2020, we created the "Risky Change Template"[5]. My thinking was: if developers already know what's risky, then they can flag it in the train task for the week[6]. At the time, I hoped this would reduce the total version deployment time (although I have no data on that). > > I hope some of this helps! > > – Tyler > > [0]: <https://gitlab.wikimedia.org/repos/releng/train-stats> > [1]: <https://phabricator.wikimedia.org/phame/post/view/296/production_excellence…> > [2]: <https://people.csail.mit.edu/hunkim/images/3/37/Papers_kim_2007_bugcache.pdf> > [3]: <https://data.releng.team/train?sql=select%0D%0A++filename%2C%0D%0A++project…> > [4]: <https://doi.org/10.1109/ICSE.2013.6606583> > [5]: <https://wikitech.wikimedia.org/wiki/Deployments/Risky_change_template> > [6]: <https://train-blockers.toolforge.org/> (here's an example this week: <https://phabricator.wikimedia.org/T337526#8901982>) > >> >> >> I am also open to collaboration on this effort. If you are interested >> in a joint paper, drop me an email until the end of this week. >> >> All the best >> Moritz >> _______________________________________________ >> Wikitech-l mailing list -- wikitech-l(a)lists.wikimedia.org >> To unsubscribe send an email to wikitech-l-leave(a)lists.wikimedia.org >> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ > > _______________________________________________ > Wikitech-l mailing list -- wikitech-l(a)lists.wikimedia.org > To unsubscribe send an email to wikitech-l-leave(a)lists.wikimedia.org > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

1 0

The May 2023 issue of the Wikimedia Research Newsletter is out
by ABDUL-RAFIU FUSEINI 08 Jun '23

08 Jun '23

The May 2023 issue of the Wikimedia Research Newsletter is out: https://meta.wikimedia.org/wiki/Research:Newsletter/2023/May In this issue: Cooperative creators "lose ownership" of their Wikipedia contributions, but the community's NPOV governance should still be "kept limited" Briefly *** 7 recent publications were covered or listed in this issue *** Alhaji Darajaati on behalf of the Newsletter team --- Wikimedia Research Newsletter https://meta.wikimedia.org/wiki/Research:Newsletter/ * Follow us on Mastodon: @WikiResearch * Like us on Facebook: Facebook.com/WikiResearch/ * Receive this newsletter by mail: Research-newsletter Mailing List - Wikimedia

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Wiki-research-l June 2023