What Wikimedia Research is up to in the next quarter

List overview All Threads
Download

newer

older

Ireland International Conference...

Data Science resources

Dario Taraborelli

19 Dec 2015 19 Dec '15

5:16 a.m.

Hey all, I’m glad to announce that the Wikimedia Research team’s goals <https://www.mediawiki.org/wiki/Wikimedia_Research/Goals#January_-_March_2016_.28Q3.29> for the next quarter (January - March 2016) are up on wiki. The Research and Data <https://www.mediawiki.org/wiki/Wikimedia_Research#Research_and_Data> team will continue to work with our volunteers and collaborators on revision scoring as a service <https://meta.wikimedia.org/wiki/R:Revscoring> adding support for 5 new languages and prototyping new models (including an edit type classifier <https://meta.wikimedia.org/wiki/Research:Automated_classification_of_edit_types>). We will also continue to iterate on the design of article creation recommendations <https://meta.wikimedia.org/wiki/Research:Increasing_article_coverage>, running a dedicated campaign in coordination with existing editathons to improve the quality of these recommendations. Finally, we will extend a research project we started in November aimed at understanding the behavior of Wikipedia readers <https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Behaviour> , by combining qualitative survey data with behavioral analysis from our HTTP request logs. The Design Research <https://www.mediawiki.org/wiki/Wikimedia_Research#Design_Research> team will conduct an in-depth study of user needs (particularly readers) on the ground in February. We will continue to work with other Wikimedia Engineering teams throughout the quarter to ensure the adoption of human-centered design principles and pragmatic personas <https://www.mediawiki.org/wiki/Personas_for_product_development> in our product development cycle. We’re also excited to start a collaboration <https://meta.wikimedia.org/wiki/Research:Publicly_available_online_learning_resource_survey> with students at the University of Washington to understand what free online information resources (including, but not limited to, Wikimedia projects) students use. I am also glad to report that two papers on link and article recommendations (the result of a formal collaboration with a team at Stanford) were accepted for presentation at WSDM '16 and WWW ’16 (preprints will be made available shortly). An overview on revision scoring as a service <http://blog.wikimedia.org/2015/11/30/artificial-intelligence-x-ray-specs/> was published a few weeks ago on the Wikimedia blog, and got some good media coverage <https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Media> . We're constantly looking for contributors and as usual we welcome feedback on these projects via the corresponding talk pages on Meta. You can contact us for any question on IRC via the #wikimedia-research channel and follow @WikiResearch <https://twitter.com/WikiResearch> on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press. Wishing you all happy holidays, Dario and Abbey on behalf of the team *Dario Taraborelli *Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter <http://twitter.com/readermeter>

Attachments:

attachment.htm (text/html — 4.3 KB)

Show replies by date

Gerard Meijssen

19 Dec 19 Dec

7:13 a.m.

Hoi, Where does it say what languages are covered and, what languages are planned for support? Thanks, GerardM On 19 December 2015 at 05:16, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

...

Dario Taraborelli

7:53 a.m.

...

On Dec 18, 2015, at 10:13 PM, Gerard Meijssen <gerard.meijssen(a)gmail.com> wrote: Hoi, Where does it say what languages are covered

https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Suppo… <https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Support_table>

...

and, what languages are planned for support?

https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service… <https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service#Progress_report:_2015-11-28> although what gets in production will depend on many factors, such as community support to generate labeled data, performance of the model etc. Dario

...

Thanks, GerardM On 19 December 2015 at 05:16, Dario Taraborelli <dtaraborelli(a)wikimedia.org <mailto:dtaraborelli@wikimedia.org>> wrote: Hey all, I’m glad to announce that the Wikimedia Research team’s goals <https://www.mediawiki.org/wiki/Wikimedia_Research/Goals#January_-_March_2016_.28Q3.29> for the next quarter (January - March 2016) are up on wiki. The Research and Data <https://www.mediawiki.org/wiki/Wikimedia_Research#Research_and_Data> team will continue to work with our volunteers and collaborators on revision scoring as a service <https://meta.wikimedia.org/wiki/R:Revscoring> adding support for 5 new languages and prototyping new models (including an edit type classifier <https://meta.wikimedia.org/wiki/Research:Automated_classification_of_edit_types>). We will also continue to iterate on the design of article creation recommendations <https://meta.wikimedia.org/wiki/Research:Increasing_article_coverage>, running a dedicated campaign in coordination with existing editathons to improve the quality of these recommendations. Finally, we will extend a research project we started in November aimed at understanding the behavior of Wikipedia readers <https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Behaviour>, by combining qualitative survey data with behavioral analysis from our HTTP request logs. The Design Research <https://www.mediawiki.org/wiki/Wikimedia_Research#Design_Research> team will conduct an in-depth study of user needs (particularly readers) on the ground in February. We will continue to work with other Wikimedia Engineering teams throughout the quarter to ensure the adoption of human-centered design principles and pragmatic personas <https://www.mediawiki.org/wiki/Personas_for_product_development> in our product development cycle. We’re also excited to start a collaboration <https://meta.wikimedia.org/wiki/Research:Publicly_available_online_learning_resource_survey> with students at the University of Washington to understand what free online information resources (including, but not limited to, Wikimedia projects) students use. I am also glad to report that two papers on link and article recommendations (the result of a formal collaboration with a team at Stanford) were accepted for presentation at WSDM '16 and WWW ’16 (preprints will be made available shortly). An overview on revision scoring as a service <http://blog.wikimedia.org/2015/11/30/artificial-intelligence-x-ray-specs/> was published a few weeks ago on the Wikimedia blog, and got some good media coverage <https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Media>. We're constantly looking for contributors and as usual we welcome feedback on these projects via the corresponding talk pages on Meta. You can contact us for any question on IRC via the #wikimedia-research channel and follow @WikiResearch <https://twitter.com/WikiResearch> on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press. Wishing you all happy holidays, Dario and Abbey on behalf of the team Dario Taraborelli Head of Research, Wikimedia Foundation wikimediafoundation.org <http://wikimediafoundation.org/> • nitens.org <http://nitens.org/> • @readermeter <http://twitter.com/readermeter> _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org <mailto:Wiki-research-l@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l <https://lists.wikimedia.org/mailman/listinfo/wiki-research-l> _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Oliver Keyes

9:01 a.m.

So what's happening with the link recommendation system? Is that rolled into article-creation recommendations, or was the paper the final product? On 19 December 2015 at 01:53, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

...

On Dec 18, 2015, at 10:13 PM, Gerard Meijssen <gerard.meijssen(a)gmail.com> wrote: Hoi, Where does it say what languages are covered https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Suppo… and, what languages are planned for support? https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service… although what gets in production will depend on many factors, such as community support to generate labeled data, performance of the model etc. Dario Thanks, GerardM On 19 December 2015 at 05:16, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

Hey all, I’m glad to announce that the Wikimedia Research team’s goals for the next quarter (January - March 2016) are up on wiki. The Research and Data team will continue to work with our volunteers and collaborators on revision scoring as a service adding support for 5 new languages and prototyping new models (including an edit type classifier). We will also continue to iterate on the design of article creation recommendations, running a dedicated campaign in coordination with existing editathons to improve the quality of these recommendations. Finally, we will extend a research project we started in November aimed at understanding the behavior of Wikipedia readers, by combining qualitative survey data with behavioral analysis from our HTTP request logs. The Design Research team will conduct an in-depth study of user needs (particularly readers) on the ground in February. We will continue to work with other Wikimedia Engineering teams throughout the quarter to ensure the adoption of human-centered design principles and pragmatic personas in our product development cycle. We’re also excited to start a collaboration with students at the University of Washington to understand what free online information resources (including, but not limited to, Wikimedia projects) students use. I am also glad to report that two papers on link and article recommendations (the result of a formal collaboration with a team at Stanford) were accepted for presentation at WSDM '16 and WWW ’16 (preprints will be made available shortly). An overview on revision scoring as a service was published a few weeks ago on the Wikimedia blog, and got some good media coverage. We're constantly looking for contributors and as usual we welcome feedback on these projects via the corresponding talk pages on Meta. You can contact us for any question on IRC via the #wikimedia-research channel and follow @WikiResearch on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press. Wishing you all happy holidays, Dario and Abbey on behalf of the team Dario Taraborelli Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

-- Oliver Keyes Count Logula Wikimedia Foundation

Leila Zia

21 Dec 21 Dec

6:12 p.m.

Hi Oliver, On Sat, Dec 19, 2015 at 12:01 AM, Oliver Keyes <okeyes(a)wikimedia.org> wrote:

...

So what's happening with the link recommendation system? Is that rolled into article-creation recommendations, or was the paper the final product?

The short answer is: the paper <http://infolab.stanford.edu/~west1/pubs/Paranjape-West-Leskovec-Zia_WSDM-16.pdf> is ideally not the final product (although I'm thrilled with the reviews we received for it) as we like to see this system used.

...

From the research perspective, we want to have a tool where we can collect

data to learn more about and improve the link recommendation system. We've had extensive conversations with Pau about this. The model we're working towards is a landing page where the user can get different types of recommendations: link recommendations* and article-creation recommendations, and maybe more forms of recommendations in the future. In the past three months, Ashwin has worked closely with Pau, Nirzar, and Ed to bring us closer to having such a tool. The tool is not ready to be used yet (really! you'll see it as soon as you click Add Links), but if you're curious to see where we are with it, please check http://tools.wmflabs.org/ navlink-recommendation/

...

From the product perspective, the Editing team has set their goal to test

the tool (via the same tool on wmflabs) and if successful, figuring out the next steps for it. Please reach out to the team directly if you like to know more. Best, Leila * Initially, the tool was going to have link recommendations for two cases: where the anchor text existed in the article text, and where it didn't. We learned that when the anchor text does not exist, the task becomes a much harder one from the user's perspective, since the decision is no longer whether the link should be added or not but where it should be added and in what context. The tool that you see now will only have link recommendations where the anchor text exists.

...

On 19 December 2015 at 01:53, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

On Dec 18, 2015, at 10:13 PM, Gerard Meijssen <gerard.meijssen(a)gmail.com wrote: Hoi, Where does it say what languages are covered

https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Suppo…

and, what languages are planned for support?

https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service…

although what gets in production will depend on many factors, such as community support to generate labeled data, performance of the model etc. Dario Thanks, GerardM On 19 December 2015 at 05:16, Dario Taraborelli <

dtaraborelli(a)wikimedia.org>

wrote: > > Hey all, > > I’m glad to announce that the Wikimedia Research team’s goals for the

> quarter (January - March 2016) are up on wiki. > > The Research and Data team will continue to work with our volunteers and > collaborators on revision scoring as a service adding support for 5 new > languages and prototyping new models (including an edit type

classifier). We

> will also continue to iterate on the design of article creation > recommendations, running a dedicated campaign in coordination with

existing

> editathons to improve the quality of these recommendations. Finally, we

will

> extend a research project we started in November aimed at understanding

the

> behavior of Wikipedia readers, by combining qualitative survey data with > behavioral analysis from our HTTP request logs. > > The Design Research team will conduct an in-depth study of user needs > (particularly readers) on the ground in February. We will continue to

work

> with other Wikimedia Engineering teams throughout the quarter to ensure

the

> adoption of human-centered design principles and pragmatic personas in

our

> product development cycle. We’re also excited to start a collaboration

with

> students at the University of Washington to understand what free online > information resources (including, but not limited to, Wikimedia

projects)

> students use. > > I am also glad to report that two papers on link and article > recommendations (the result of a formal collaboration with a team at > Stanford) were accepted for presentation at WSDM '16 and WWW ’16

(preprints

> will be made available shortly). An overview on revision scoring as a > service was published a few weeks ago on the Wikimedia blog, and got

some

> good media coverage. > > We're constantly looking for contributors and as usual we welcome

feedback

> on these projects via the corresponding talk pages on Meta. You can

contact

> us for any question on IRC via the #wikimedia-research channel and

@WikiResearch on Twitter for the latest Wikipedia and Wikimedia research updates hot off the press. Wishing you all happy holidays, Dario and Abbey on behalf of the team Dario Taraborelli Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

-- Oliver Keyes Count Logula Wikimedia Foundation _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Oliver Keyes

6:18 p.m.

Awesome; thanks! On 21 December 2015 at 12:12, Leila Zia <leila(a)wikimedia.org> wrote:

...

Hi Oliver, On Sat, Dec 19, 2015 at 12:01 AM, Oliver Keyes <okeyes(a)wikimedia.org> wrote:

So what's happening with the link recommendation system? Is that rolled into article-creation recommendations, or was the paper the final product?

The short answer is: the paper is ideally not the final product (although I'm thrilled with the reviews we received for it) as we like to see this system used. From the research perspective, we want to have a tool where we can collect data to learn more about and improve the link recommendation system. We've had extensive conversations with Pau about this. The model we're working towards is a landing page where the user can get different types of recommendations: link recommendations* and article-creation recommendations, and maybe more forms of recommendations in the future. In the past three months, Ashwin has worked closely with Pau, Nirzar, and Ed to bring us closer to having such a tool. The tool is not ready to be used yet (really! you'll see it as soon as you click Add Links), but if you're curious to see where we are with it, please check http://tools.wmflabs.org/navlink-recommendation/ From the product perspective, the Editing team has set their goal to test the tool (via the same tool on wmflabs) and if successful, figuring out the next steps for it. Please reach out to the team directly if you like to know more. Best, Leila * Initially, the tool was going to have link recommendations for two cases: where the anchor text existed in the article text, and where it didn't. We learned that when the anchor text does not exist, the task becomes a much harder one from the user's perspective, since the decision is no longer whether the link should be added or not but where it should be added and in what context. The tool that you see now will only have link recommendations where the anchor text exists.

On 19 December 2015 at 01:53, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

-- Oliver Keyes Count Logula Wikimedia Foundation

Leila Zia

6:33 p.m.

np. :-) On Mon, Dec 21, 2015 at 9:18 AM, Oliver Keyes <okeyes(a)wikimedia.org> wrote:

...

Awesome; thanks! On 21 December 2015 at 12:12, Leila Zia <leila(a)wikimedia.org> wrote:

Hi Oliver, On Sat, Dec 19, 2015 at 12:01 AM, Oliver Keyes <okeyes(a)wikimedia.org>

wrote:

So what's happening with the link recommendation system? Is that rolled into article-creation recommendations, or was the paper the final product?

collect

data to learn more about and improve the link recommendation system.

We've

had extensive conversations with Pau about this. The model we're working towards is a landing page where the user can get different types of recommendations: link recommendations* and article-creation

recommendations,

and maybe more forms of recommendations in the future. In the past three months, Ashwin has worked closely with Pau, Nirzar, and Ed to bring us closer to having such a tool. The tool is not ready to be used yet

(really!

you'll see it as soon as you click Add Links), but if you're curious to

see

where we are with it, please check http://tools.wmflabs.org/navlink-recommendation/ From the product perspective, the Editing team has set their goal to test the tool (via the same tool on wmflabs) and if successful, figuring out

the

next steps for it. Please reach out to the team directly if you like to

know

more. Best, Leila * Initially, the tool was going to have link recommendations for two

cases:

where the anchor text existed in the article text, and where it didn't.

learned that when the anchor text does not exist, the task becomes a much harder one from the user's perspective, since the decision is no longer whether the link should be added or not but where it should be added and

what context. The tool that you see now will only have link

recommendations

where the anchor text exists. > > > On 19 December 2015 at 01:53, Dario Taraborelli > <dtaraborelli(a)wikimedia.org> wrote: > > > > On Dec 18, 2015, at 10:13 PM, Gerard Meijssen > > <gerard.meijssen(a)gmail.com> > > wrote: > > > > Hoi, > > Where does it say what languages are covered > > > > > > > >

https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Suppo…

> > > > and, what languages are planned for support? > > > > > > > >

https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service…

> > > > although what gets in production will depend on many factors, such as > > community support to generate labeled data, performance of the model > > etc. > > > > Dario > > > > Thanks, > > GerardM > > > > On 19 December 2015 at 05:16, Dario Taraborelli > > <dtaraborelli(a)wikimedia.org> > > wrote: > >> > >> Hey all, > >> > >> I’m glad to announce that the Wikimedia Research team’s goals for the > >> next > >> quarter (January - March 2016) are up on wiki. > >> > >> The Research and Data team will continue to work with our volunteers > >> and > >> collaborators on revision scoring as a service adding support for 5

new

> >> languages and prototyping new models (including an edit type > >> classifier). We > >> will also continue to iterate on the design of article creation > >> recommendations, running a dedicated campaign in coordination with > >> existing > >> editathons to improve the quality of these recommendations. Finally,

> >> will > >> extend a research project we started in November aimed at

understanding

> >> the > >> behavior of Wikipedia readers, by combining qualitative survey data > >> with > >> behavioral analysis from our HTTP request logs. > >> > >> The Design Research team will conduct an in-depth study of user needs > >> (particularly readers) on the ground in February. We will continue to > >> work > >> with other Wikimedia Engineering teams throughout the quarter to

ensure

> >> the > >> adoption of human-centered design principles and pragmatic personas

> >> our > >> product development cycle. We’re also excited to start a

collaboration

> >> with > >> students at the University of Washington to understand what free

online

> information resources (including, but not limited to, Wikimedia > projects) > students use. > > I am also glad to report that two papers on link and article > recommendations (the result of a formal collaboration with a team at > Stanford) were accepted for presentation at WSDM '16 and WWW ’16 > (preprints > will be made available shortly). An overview on revision scoring as a > service was published a few weeks ago on the Wikimedia blog, and got > some > good media coverage. > > We're constantly looking for contributors and as usual we welcome > feedback > on these projects via the corresponding talk pages on Meta. You can > contact > us for any question on IRC via the #wikimedia-research channel and > follow > @WikiResearch on Twitter for the latest Wikipedia and Wikimedia > research > updates hot off the press. > > Wishing you all happy holidays, > > Dario and Abbey on behalf of the team > > > Dario Taraborelli Head of Research, Wikimedia Foundation > wikimediafoundation.org • nitens.org • @readermeter > > > _______________________________________________ > Wiki-research-l mailing list > Wiki-research-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

3048

days inactive

3050

days old

wiki-research-l@lists.wikimedia.org

Manage subscription

6 comments

4 participants

tags (0)

participants (4)

Dario Taraborelli
Gerard Meijssen
Leila Zia
Oliver Keyes