Hi Oliver,
On Sat, Dec 19, 2015 at 12:01 AM, Oliver Keyes okeyes@wikimedia.org wrote:
So what's happening with the link recommendation system? Is that rolled into article-creation recommendations, or was the paper the final product?
The short answer is: the paper http://infolab.stanford.edu/~west1/pubs/Paranjape-West-Leskovec-Zia_WSDM-16.pdf is ideally not the final product (although I'm thrilled with the reviews we received for it) as we like to see this system used.
From the research perspective, we want to have a tool where we can collect
data to learn more about and improve the link recommendation system. We've had extensive conversations with Pau about this. The model we're working towards is a landing page where the user can get different types of recommendations: link recommendations* and article-creation recommendations, and maybe more forms of recommendations in the future. In the past three months, Ashwin has worked closely with Pau, Nirzar, and Ed to bring us closer to having such a tool. The tool is not ready to be used yet (really! you'll see it as soon as you click Add Links), but if you're curious to see where we are with it, please check http://tools.wmflabs.org/ navlink-recommendation/
From the product perspective, the Editing team has set their goal to test
the tool (via the same tool on wmflabs) and if successful, figuring out the next steps for it. Please reach out to the team directly if you like to know more.
Best, Leila
* Initially, the tool was going to have link recommendations for two cases: where the anchor text existed in the article text, and where it didn't. We learned that when the anchor text does not exist, the task becomes a much harder one from the user's perspective, since the decision is no longer whether the link should be added or not but where it should be added and in what context. The tool that you see now will only have link recommendations where the anchor text exists.
On 19 December 2015 at 01:53, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
On Dec 18, 2015, at 10:13 PM, Gerard Meijssen <gerard.meijssen@gmail.com
wrote:
Hoi, Where does it say what languages are covered
https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Suppor...
and, what languages are planned for support?
https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service#...
although what gets in production will depend on many factors, such as community support to generate labeled data, performance of the model etc.
Dario
Thanks, GerardM
On 19 December 2015 at 05:16, Dario Taraborelli <
dtaraborelli@wikimedia.org>
wrote:
Hey all,
I’m glad to announce that the Wikimedia Research team’s goals for the
next
quarter (January - March 2016) are up on wiki.
The Research and Data team will continue to work with our volunteers and collaborators on revision scoring as a service adding support for 5 new languages and prototyping new models (including an edit type
classifier). We
will also continue to iterate on the design of article creation recommendations, running a dedicated campaign in coordination with
existing
editathons to improve the quality of these recommendations. Finally, we
will
extend a research project we started in November aimed at understanding
the
behavior of Wikipedia readers, by combining qualitative survey data with behavioral analysis from our HTTP request logs.
The Design Research team will conduct an in-depth study of user needs (particularly readers) on the ground in February. We will continue to
work
with other Wikimedia Engineering teams throughout the quarter to ensure
the
adoption of human-centered design principles and pragmatic personas in
our
product development cycle. We’re also excited to start a collaboration
with
students at the University of Washington to understand what free online information resources (including, but not limited to, Wikimedia
projects)
students use.
I am also glad to report that two papers on link and article recommendations (the result of a formal collaboration with a team at Stanford) were accepted for presentation at WSDM '16 and WWW ’16
(preprints
will be made available shortly). An overview on revision scoring as a service was published a few weeks ago on the Wikimedia blog, and got
some
good media coverage.
We're constantly looking for contributors and as usual we welcome
feedback
on these projects via the corresponding talk pages on Meta. You can
contact
us for any question on IRC via the #wikimedia-research channel and
follow
@WikiResearch on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press.
Wishing you all happy holidays,
Dario and Abbey on behalf of the team
Dario Taraborelli Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Oliver Keyes Count Logula Wikimedia Foundation
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l