Wiki-research-l

wiki-research-l@lists.wikimedia.org

8 participants
2988 discussions

Wikimedia Research: Q3 quarterly reviews and Q4 goals
by Dario Taraborelli 19 Apr '16

19 Apr '16

Hey all, heads up that we published the quarterly review slidedeck for Q3 <https://commons.wikimedia.org/wiki/File:WMF_Research_&_Design_Research_&_An…> (January - March, 2016) for the Wikimedia Research <https://www.mediawiki.org/wiki/Wikimedia_Research> department (slides 2-18): check them out for a high-level overview of our main accomplishments over the last three months. The Q4 goals (April - June 2016) for each team are listed on this page <https://www.mediawiki.org/wiki/Wikimedia_Research/Goals#April_-_June_2016_.…>. Dario

1 0

Research announcement: Learning from article revision histories
by Pierce Edmiston 10 Apr '16

10 Apr '16

I'd like to announce an IEG proposal I'm working on titled "Learning from article revision histories" [1]. If anyone who has studied the evolution of Wikipedia articles (the extent to which articles always improve in quality) is interested in the project, please consider getting in touch with me as I'd love to hear your thoughts. I'm excited about the possible usefulness of this sort of research for the Wikipedia community, but I'm new to Wikipedia and I know I am not the first one to ask some of these questions. If more experienced Wikipedians would like to weigh in on the usefulness of addressing the efficiency of the collaborative editing process, I've posted some discussion topics on the IEG proposal's talk page [2]. Pierce Edmiston [1]: https://meta.wikimedia.org/wiki/Grants:IEG/Learning_from_article_revision_h… [2]: https://meta.wikimedia.org/wiki/Grants_talk:IEG/Learning_from_article_revis…

2 1

Updates to ORES service & BREAKING CHANGE on April 7th
by Aaron Halfaker 07 Apr '16

07 Apr '16

Hey folks, we have a couple of announcements for you today. First is that ORES has a large set of new functionality that you might like to take advantage of. We'll also want to talk about a *BREAKING CHANGE on April 7th.* Don't know what ORES is? See http://blog.wikimedia.org/2015/11/30/artificial-intelligence-x-ray-specs/ *New functionality* *Scoring UI* Sometimes you just want to score a few revisions in ORES and remembering the URL structure is hard. So, we've build a simple scoring user-interface <https://ores.wmflabs.org/ui/> that will allow you to more easily score a set of edits. *New API version* We've been consistently getting requests to include more information in ORES' responses. In order to make space for this new information, we needed to change the structure of responses. But we wanted to do this without breaking the tools that are already using ORES. So, we've developed a versioning scheme that will allow you to take advantage of new functionality when you are ready. The same old API will continue to be available at https://ores.wmflabs.org/scores/, but we've added two additional paths on top of this. - https://ores.wmflabs.org/v1/scores/ is a mirror of the old scoring API which will henceforth be referred to as "v1" - https://ores.wmflabs.org/v2/scores/ implements a new response format that is consistent between all sub-paths and adds some new functionality *Swagger documentation* Curious about the new functionality available in "v2" or maybe what the change was from "v1"? We've implemented a structured description of both versions of the scoring API using swagger -- which is becoming a defacto stanard for this sort of thing. Visit https://ores.wmflabs.org/v1/ or https://ores.wmflabs.org/v2/ to see the Swagger user-interface. Visithttps://ores.wmflabs.org/v1/spec/ or https://ores.wmflabs.org/v2/spec/ to get the specification in a machine-readable format. *Feature values & injection* Have you wondered what ORES uses to make it's predictions? You can now ask ORES to show you the list of "feature" statistics it uses to score revisions. For example, https://ores.wmflabs.org/v2/scores/enwiki/wp10/34567892/?features will return the score with a mapping of feature values used by the "wp10" article quality model in English Wikipedia to score oldid=34567892 <https://en.wikipedia.org/wiki/Special:Diff/34567892>. You can also "inject" features into the scoring process to see how that affects the prediction. E.g., https://ores.wmflabs.org/v2/scores/enwiki/wp10/34567892?features&feature.wi… *Breaking change -- new models* We've been experimenting with new learning algorithms to make ORES work better and we've found that we get better results with gradient boosting <https://en.wikipedia.org/wiki/Gradient_boosting> and random forest <https://en.wikipedia.org/wiki/Random_forest> strategies than we do with the current linear svc <https://en.wikipedia.org/wiki/Support_vector_machine> models. We'd like to get these new, better models deployed as soon as possible, but with the new algorithm comes a change in the range of probabilities returned by the model. So, when we deploy this change, any tools that uses hard-coded thresholds on ORES' prediction probabilities will suddenly start behaving strangely. Regretfully, we haven't found a way around this problem, so we're announcing the change now and we plan to deploy this *BREAKING CHANGE on April 7th*. Please subscribe to the AI mailinglist <https://lists.wikimedia.org/mailman/listinfo/ai> or watch our project page [[:m:ORES <https://meta.wikimedia.org/wiki/ORES>]] to catch announcements of future changes and new functionality. In order to make sure we don't end up in the same situation the next time we want to change an algorithm, we've included a suite of evaluation statistics with each model. The filter_rate_at_recall(0.9), filter_rate_at_recall(0.75), and recall_at_fpr(0.1) thresholds represent three critical thresholds (should review, needs review, and definitely damaging -- respectively) that can be used to automatically configure your wiki tool. You can find out these thresholds for your model of choice by adding the ?model_info parameter to requests. So, come breaking change, we strongly recommend basing your thresholds on these statistics in the future. We'll be working to submit patches to tools that use ORES in the next week to implement this flexibility. Hopefully, all you'll need to do is worth with us on those. -halfak & The Revision Scoring team <https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service>

1 1

Fwd: [Wikitech-l] statistics about frequent section titles
by Jonathan Morgan 07 Apr '16

07 Apr '16

Cross-posting this request to wiki-research-l. Anyone have data on frequently used section titles in articles (any language), or know of datasets/publications that examined this? I'm not aware of any off the top of my head, Amir. - Jonathan ---------- Forwarded message ---------- From: Amir E. Aharoni <amir.aharoni(a)mail.huji.ac.il> Date: Sat, Jul 11, 2015 at 3:29 AM Subject: [Wikitech-l] statistics about frequent section titles To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> Hi, Did anybody ever try to collect statistics about frequent section titles in Wikimedia projects? For Wikipedia, for example, titles such as "Biography", "Early life", "Bibliography", "External links", "References", "History", etc., appear in a lot of articles, and their counterparts appear in a lot of languages. There are probably similar things in Wikivoyage, Wiktionary and possibly other projects. Did anybody ever try to collect statistics of the most frequent section titles in each language and project? -- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com ‪“We're living in pieces, I want to live in peace.” – T. Moore‬ _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Jonathan T. Morgan Senior Design Researcher Wikimedia Foundation User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>

6 8

Wikimedia Research's Goals for April - July 2016
by Aaron Halfaker 06 Apr '16

06 Apr '16

Hey folks! I'm happy to announce that the Wikimedia Research team's goals <https://www.mediawiki.org/wiki/Wikimedia_Research/Goals#April_-_June_2016_.…> for the next quarter (April - July 2016) are up on the wiki. The Research and Data <https://www.mediawiki.org/wiki/Wikimedia_Research#Research_and_Data> team will deploy the ORES extension <https://www.mediawiki.org/wiki/Extension:ORES> that makes revision scoring as a service <https://meta.wikimedia.org/wiki/R:Revscoring> available within the wiki to Wikidata and Persian Wikipedia as a beta feature. We're also digging into studies of discussion modeling. We'll be releasing datasets of on-wiki discussions and starting our own modeling work to try to detect harassment & personal attacks. We'll be hosting three workshops: WikiCite <https://meta.wikimedia.org/wiki/WikiCite> in Berlin and the Wiki Workshop 2016 <http://snap.stanford.edu/wikiworkshop2016/> at WWW and ICWSM. We'll be extending our work surveying readers <https://meta.wikimedia.org/wiki/R:Research:Characterizing_Wikipedia_Reader_…> last quarter by digging into data analysis. The Design Research <https://www.mediawiki.org/wiki/Wikimedia_Research#Design_Research> team will support the use of pragmatic personas <https://www.mediawiki.org/wiki/Personas_for_product_development> in product development and analyze data on on Reader, New Editor and New Reader personas. We'll also continue supporting ongoing user-facing projects in Editing, Reading, Search and Community Engagement. We'll perform a new set of deep-dive interviews in Nigeria to extend the deep-dive interviews recently completed for Mexico. We'll deploy surveys to University of Washington students <https://meta.wikimedia.org/wiki/Research:Publicly_available_online_learning…> and complete the analysis of results. We'll also create a project plan for benchmarking UX characteristics of Wikimedia software and to create a stable testing environment to support our user studies of software changes. We're constantly looking for contributors and as usual we welcome feedback on these projects via the corresponding talk pages on Meta. You can contact us for any question on IRC via the #wikimedia- <http://webchat.freenode.net/?channels=wikimedia-research>research <http://webchat.freenode.net/?channels=wikimedia-research> channel and follow @WikiResearch <https://twitter.com/WikiResearch> on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press. -Aaron (on behalf of the team)

2 1

[IEG] Sharing of my Individual Engagement Grant application, please comment on it
by DJAKN 04 Apr '16

04 Apr '16

Hello all, I'm prepared to participate in Individual Engagement Grant (IEG) and has an idea closely linked to the Accuracy Review Project raised by James Salsman. Here is a brief summary of my proposal: Out-of-date information and references are common in Wikipedia articles, especially in Chinese Wikipedia. Therefore, I would like to evaluate some existed solutions of identifying those out-of-date contents, and create a new bot to identify the information based on the results of testing. More detailed tests will be arranged after that by selected articles from Wikipedia and the cases that we compile. And here is the URL of the project proposal: https://meta.wikimedia.org/wiki/Grants:IdeaLab/Searching_for_out-of-date_in… And please comment on the proposal in the discussion board of it: https://meta.wikimedia.org/wiki/Grants_talk:IdeaLab/Searching_for_out-of-da… Li Linxuan

1 0

The Wikimedia Research Newsletter 6(3) is out
by Mohammed Sadat 04 Apr '16

04 Apr '16

The March 2016 issue of the Wikimedia Research Newsletter is out: https://blog.wikimedia.org/2016/04/02/research-newsletter-march-2016/ https://meta.wikimedia.org/wiki/Research:Newsletter/2016/March In this issue: 1 "Employing Wikipedia for good not evil: innovative approaches to collaborative writing assessment" 2 Using eyetracking to find out how Wikipedia articles are being read *** 9 recent publications were covered or listed in this issue *** Thanks to Piotr Konieczny for contributing. Masssly, Tilman Bayer and Dario Taraborelli --- Wikimedia Research Newsletter https://meta.wikimedia.org/wiki/Research:Newsletter/ * Follow us on Twitter: @WikiResearch * Receive this newsletter by mail: https://lists.wikimedia.org/mailman/listinfo/research-newsletter * Subscribe to the RSS feed: http://blog.wikimedia.org/c/research-2/wikimedia-research-newsletter/feed/

1 0

Sections of Code of Conduct resolved and Code of Conduct approval process
by Matthew Flaschen 01 Apr '16

01 Apr '16

We’ve gotten good participation as we’ve worked on sections of the Code of Conduct over the past few months, and have made considerable improvements to the draft based on your feedback. Given that, and the community approval through the discussions on each section, the best approach is to proceed by approving section-by-section until the last section is done. So, please continue to improve the Code of Conduct by participating now and as future sections are discussed. When the last section is completed and approved on the talk page, the Code of Conduct will become policy and no longer be marked as a draft. Also, two more discussions regarding the Code of Conduct have been resolved and incorporated into the draft. * "Enforcement issues" addressed the reporting process and clarified that Committee decisions could not be circumvented * "Marginalized and underrepresented groups" forbids discrimination Thanks, Matt Flaschen

1 0

Applications open for WikiCite (Berlin, May 25-26, 2016)
by Dario Taraborelli 30 Mar '16

30 Mar '16

Citations and references are the building blocks of Wikimedia projects. However, as of today, they are still treated as second-class citizens. Structured data bases such as Wikidata offer a unique opportunity <https://www.wikidata.org/wiki/Wikidata:WikiProject_Source_MetaData> to turn into reality over a decade of endeavors to build the sum of all citations and bibliographic metadata into a centralized repository. To coordinate upcoming work in this space, we're organizing a technical event in late May and opening up applications for prospective participants. *WikiCite 2016 <https://meta.wikimedia.org/wiki/WikiCite_2016>* is a hands-on event focused on designing data models and technology to *improve the coverage, quality, standards-compliance and machine-readability of citations and source metadata in Wikipedia, Wikidata and other Wikimedia projects*. Our goal, in particular, is to define a technical roadmap for building a repository of all Wikimedia references in Wikidata. We are bringing together Wikidatans, Wikipedians, software engineers, data modelers, and information and library science experts from organizations including *Crossref*, *Zotero*, *CSL*, *ContentMine*, *Google*, *Datacite*, *NISO*, *OCLC* and the *NIH*. We are also inviting academic researchers with experience working with Wikipedia's citations and bibliographic data. WikiCite will be hosted in *Berlin* on *May 25-26, 2016*. Participation to the event is capped at about 50 participants and we expect to have a number of open slots for applicants: - if you were pre-invited and have already filled in a form, you will receive a separate note from the organizers - if you have not been invited but you would like to participate, please fill in this application form <http://goo.gl/forms/Yv6rve2wCt> to give us some information about you and your interest and expected contribution to the event. Please help us pass this on to anyone who has done important technical work on Wikimedia references and citations. *Important dates* - *March 29, 2016*: applications open - *April 11, 2016*: applications close - *April 15, 2016*: notifications of acceptance are issued (if you applied for a travel grant, we'll be able to confirm by this date if we can cover the costs of your trip) For any question, you can contact the organizing committee: wikicite(a)wikimedia.org The organizers, Dario Taraborelli Jonathan Dugan Lydia Pintcher Daniel Mietchen Cameron Neylon *Dario Taraborelli *Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter <http://twitter.com/readermeter>

1 0

Fwd: Please provide feedback on new discrimination and enforcement sections of Code of Conduct
by Matthew Flaschen 29 Mar '16

29 Mar '16

I usually send these to multiple lists, but I realized I forgot to send this to the ones besides wikitech-l. The "Marginalized and underrepresented groups" discussion (https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#New_proposed_word…) is still open. I'll probably give it two weeks total, which means closing it late tomorrow. Matt Flaschen -------- Forwarded Message -------- Subject: Please provide feedback on new discrimination and enforcement sections of Code of Conduct Date: Wed, 16 Mar 2016 20:23:24 -0400 From: Matthew Flaschen <mflaschen(a)wikimedia.org> To: Wikitech List <wikitech-l(a)lists.wikimedia.org> Thanks for your participation in the recent Code of Conduct discussions. The "Marginalized and underrepresented groups" discussion had a lot of feedback. There was not consensus to use the exact original wording, but many people expressed willingness to support a modified text. I've proposed such a new text, based on Neil P. Quinn's text, with a small modification to account for discrimination required by law (e.g. age of people who can sign certain contracts). Please participate at https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#New_proposed_word… . The "Enforcement issues" section received general support, but some of that was conditional, or expressed preference for wording that developed during the discussion. The original wording also did not address the appeals body, which was raised in the discussion. Please participate at https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Circumvention_tex… Update regarding completed discussions: The "Clarification of legitimate reasons for publication of private communications and identity protection" and "Definitions - trolling, bad-faith reports" discussions have been closed. They both had support, and I've incorporated the text into the draft. Thanks, Matt

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Wiki-research-l