Wiki-research-l June 2016

wiki-research-l@lists.wikimedia.org

29 participants
25 discussions

Wikipedia Research policy
by song＠cs.umn.edu 14 Jul '23

14 Jul '23

Pursuant to prior discussions about the need for a research policy on Wikipedia, WikiProject Research is drafting a policy regarding the recruitment of Wikipedia users to participate in studies. At this time, we have a proposed policy, and an accompanying group that would facilitate recruitment of subjects in much the same way that the Bot Approvals Group approves bots. The policy proposal can be found at: http://en.wikipedia.org/wiki/Wikipedia:Research The Subject Recruitment Approvals Group mentioned in the proposal is being described at: http://en.wikipedia.org/wiki/Wikipedia:Subject_Recruitment_Approvals_Group Before we move forward with seeking approval from the Wikipedia community, we would like additional input about the proposal, and would welcome additional help improving it. Also, please consider participating in WikiProject Research at: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Research -- Bryan Song GroupLens Research University of Minnesota

8 10

[Analytics] Beeline as Hive client
by Madhumitha Viswanathan 02 Oct '18

02 Oct '18

Hi all, For all Hive users using stat1002/1004, you might have seen a deprecation warning when you launch the hive client - that claims it's being replaced with Beeline. The Beeline shell has always been available to use, but it required supplying a database connection string every time, which was pretty annoying. We now have a wrapper <https://github.com/wikimedia/operations-puppet/blob/production/modules/role…> script setup to make this easier. The old Hive CLI will continue to exist, but we encourage moving over to Beeline. You can use it by logging into the stat1002/1004 boxes as usual, and launching `beeline`. There is some documentation on this here: https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Beeline. If you run into any issues using this interface, please ping us on the Analytics list or #wikimedia-analytics or file a bug on Phabricator <http://phabricator.wikimedia.org/tag/analytics>. (If you are wondering stat1004 whaaat - there should be an announcement coming up about it soon!) Best, --Madhu :)

2 2

Wikipedia aggregate clickstream data released
by Dario Taraborelli 17 Jan '18

17 Jan '18

We’re glad to announce the release of an aggregate clickstream dataset extracted from English Wikipedia http://dx.doi.org/10.6084/m9.figshare.1305770 <http://dx.doi.org/10.6084/m9.figshare.1305770> This dataset contains counts of (referer, article) pairs aggregated from the HTTP request logs of English Wikipedia. This snapshot captures 22 million (referer, article) pairs from a total of 4 billion requests collected during the month of January 2015. This data can be used for various purposes: • determining the most frequent links people click on for a given article • determining the most common links people followed to an article • determining how much of the total traffic to an article clicked on a link in that article • generating a Markov chain over English Wikipedia We created a page on Meta for feedback and discussion about this release: https://meta.wikimedia.org/wiki/Research_talk:Wikipedia_clickstream <https://meta.wikimedia.org/wiki/Research_talk:Wikipedia_clickstream> Ellery and Dario

5 5

WMF Open Access Policy and Independent Researchers
by Maximilian Klein 09 Jul '16

09 Jul '16

Hello All, As you might know WMF has an Open Access Policy that requires all work that they fund to be Open Access[1]. A strange consequence of this policy, that I recently ran into, is that it requires researchers funded by grants to publish OA -- but without providing any funding to do so. That is, I recently completed an Individual Engagement Grant (IEG), part of whose scope was explicitly to write a paper about the work[2], and when I wrote to WMF to acquire funds for OA publishing, they confirmed that the paper was under the OA mandate but indicated that funds were not available to pay for OA publishing. Has anyone else use WMF's Open Access Policy? What was your experience? [1] https://wikimediafoundation.org/wiki/Open_access_policy [2] https://meta.wikimedia.org/wiki/Grants:IEG/WIGI:_Wikipedia_Gender_Index#Act… Make a great day, Max Klein ‽ http://notconfusing.com/

13 19

question about Pageviews dumps
by Marc Miquel 04 Jul '16

04 Jul '16

Hello, I have a question for you regarding pageviews datadumps. I am considering to study reader engagement for different article topics in different languages. Because of this, I would like to know if there is any plan to make available pageviews dumps detailing activity log at session level per user - in a similar way to editor sessions. Since this would be for a research project I might ask funding for it, I would like to know if I could count on that, what is the nature of the available data, and what would be the procedure to obtain this data and if there would be any implication because of privacy concerns. Thank you very much! Best, Marc Miquel ᐧ

2 3

A New Journal: Wiki Studies
by Robert E. Cummings 03 Jul '16

03 Jul '16

Hi All: Given the conversation about fees for publishing articles about Wikipedia in OA journals, I wanted to call your attention to a new journal we are starting, Wiki Studies http://wikistudies.org/ Wiki Studies is an interdisciplinary, open access, peer-reviewed journal focusing on the intersection of Wikipedia and higher education. We are interested in most all of the same topics hosted on the research listserv and the newsletter, including articles about pedagogical practices, epistemology, bias, mission, and reliability. We will not charge for submission or publication, and will offer open access to readers. We will host on Open Journal Systems. We are just getting started. We are recruiting editors, and plan to have a presence at the upcoming Wiki Conference North America in San Diego 7-10 October 2016. We hope to publish our first volume in March of 2017, consisting of submissions received by 31 December 2016. Comments, queries, and suggestions all welcome at cummings(a)olemiss.edu<mailto:cummings@olemiss.edu> Yours, Bob Cummings

6 5

Proposal to reopen the "Unacceptable behavior" section
by Matthew Flaschen 29 Jun '16

29 Jun '16

Yaron Koren has proposed to reopen the "Unacceptable behavior" section (https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Suggested_change_…). His perspective and mine are given on the talk page. In brief: * He disagrees with how "marginalized and otherwise underrepresented groups" and "encouraged" are handled in the original text. * I support the current text and process, and have explained why on the talk page. Thanks, Matt Flaschen

1 0

Re: [Wiki-research-l] WMF Open Access Policy and Independent Researchers
by James Salsman 29 Jun '16

29 Jun '16

Max, this advise is very good: > On 6/29/2016 11:01, Stuart A. Yeates wrote: > > There are many open access journals which do not charge fees or any > description. See http://www.opendoar.org/ or talk to a friendly > librarian to find a journal that meets your needs. Please see also Table 5 on p. 1320 (PDF p. 6) in http://octavia.zoology.washington.edu/publications/WestEtAl14.pdf That suggests the Journal of Machine Learning Research may be a good high-impact, zero-fee choice, if appropriate. There are alternatives by the same authors at http://www.eigenfactor.org/openaccess/oa.php?catid=50&pt=0 in particular, College and Research Libraries and the Journal of the Medical Library Association, if appropriate. http://www.eigenfactor.org/openaccess/oa.php?catid=29&pt=0 has another bunch, such as the Journal of Educational Research. http://www.eigenfactor.org/openaccess/oa.php?catid=129&pt=0 suggests Computational Linguistics.

1 0

Re: [Wiki-research-l] [Analytics] question about Pageviews dumps
by Marc Miquel 29 Jun '16

29 Jun '16

Hello! I was thinking about user sessions, yes, so this would mean to aggregate pageviews visited by a user during a short amount of time (I should check the cutoff, but it could be around an hour or less). I am particularly interested in understanding the order in which pages are seen (start, end), duration, etc. I wouldn't need data from a long period neither, but I think data from multiple languages would be helpful. I imagined reader data could be sensitive to privacy, but would an NDA with my university and some sort of data encoding help with this? As I said, it is for a scientific purpose. Thanks, Marc El dt., 28 juny 2016 a les 21:09, Nuria Ruiz (<nuria(a)wikimedia.org>) va escriure: > > Hello! > > >I am considering to study reader engagement for different article topics > in different languages. Because of this, I would like to know if there is > >any plan to make available pageviews dumps detailing activity log at > session level per user - in a similar way to editor sessions. > > Are you thinking of "all-pageviews-visited-by-a-certain-user"? If so, no > we do not have any projects to provide that data as due to privacy concerns > we neither have nor keep that information. > > Thanks, > > Nuria > > > > On Tue, Jun 28, 2016 at 6:55 PM, Leila Zia <leila(a)wikimedia.org> wrote: > >> + Analytics >> >> >> On Tue, Jun 28, 2016 at 6:36 AM, Marc Miquel <marcmiquel(a)gmail.com> >> wrote: >> >>> Hello, >>> >>> I have a question for you regarding pageviews datadumps. >>> >>> I am considering to study reader engagement for different article topics >>> in different languages. Because of this, I would like to know if there is >>> any plan to make available pageviews dumps detailing activity log at >>> session level per user - in a similar way to editor sessions. >>> >>> Since this would be for a research project I might ask funding for it, I >>> would like to know if I could count on that, what is the nature of the >>> available data, and what would be the procedure to obtain this data and if >>> there would be any implication because of privacy concerns. >>> >>> Thank you very much! >>> >>> Best, >>> >>> Marc Miquel >>> ᐧ >>> >>> _______________________________________________ >>> Wiki-research-l mailing list >>> Wiki-research-l(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >>> >>> >> >> _______________________________________________ >> Analytics mailing list >> Analytics(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/analytics >> >> > _______________________________________________ > Analytics mailing list > Analytics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics >

2 4

Re: [Wiki-research-l] [Analytics] question about Pageviews dumps
by Marc Miquel 29 Jun '16

29 Jun '16

Hi Joseph. Perhaps these approximations could already provide me valuable information. If it is possible to distinguish between mobile and pc visits, then I could filter the mobile and keep the more reliable pc-based data. This is all I wanted to know by now to prepare my project. In case I need to progress with it, I will contact you. Thank you very much for the answer. Cheers, Marc El dc., 29 juny 2016 a les 10:24, Joseph Allemandou (< jallemandou(a)wikimedia.org>) va escriure: > Hi Marc, > > The information you're after is not available in the data we collect, for > at least two reasons > > - We don't collect data allowing to detect user sessions (no id-cookie > or identifier) > - We don't collect time spent on page > > Approximations could be made using finger-printing techniques as a proxy > for sessions (with an important error on mobile due to ip-pooling), and > successive events as boundaries for time spent on page. > These approximations would in any case need an NDA. > > Cheers > Joseph > > On Wed, Jun 29, 2016 at 9:16 AM, Marc Miquel <marcmiquel(a)gmail.com> wrote: > >> Thanks for the answer, Oliver. But I am not sure it answers my >> questions. I'd like to study aspects like how much time is spent in >> certain pages, as a proxy of how content is approached/read/understood. I'd >> be happy with time of entering the page, time of leaving. This is not >> entirely centered on 'user activity', but I said that because I imagined >> data would be stored in a similar way to editor sessions, or in a database >> and I would need to do the time calculations. >> >> Cheers, >> >> Marc >> >> >> El dc., 29 juny, 2016 03:11, Oliver Keyes <ironholds(a)gmail.com> va >> escriure: >> >>> If historic data is okay, there's already a dataset released ( >>> https://figshare.com/articles/Activity_Sessions_datasets/1291033) that >>> was designed specifically to answer questions around how to best calculate >>> session length with regards to Wikipedia (http://arxiv.org/abs/1411.2878 >>> ) >>> >>> On Tue, Jun 28, 2016 at 3:42 PM, Marc Miquel <marcmiquel(a)gmail.com> >>> wrote: >>> >>>> Hello! >>>> >>>> I was thinking about user sessions, yes, so this would mean to >>>> aggregate pageviews visited by a user during a short amount of time (I >>>> should check the cutoff, but it could be around an hour or less). >>>> >>>> I am particularly interested in understanding the order in which pages >>>> are seen (start, end), duration, etc. >>>> I wouldn't need data from a long period neither, but I think data from >>>> multiple languages would be helpful. >>>> >>>> I imagined reader data could be sensitive to privacy, but would an NDA >>>> with my university and some sort of data encoding help with this? As I >>>> said, it is for a scientific purpose. >>>> >>>> Thanks, >>>> >>>> Marc >>>> >>>> El dt., 28 juny 2016 a les 21:09, Nuria Ruiz (<nuria(a)wikimedia.org>) >>>> va escriure: >>>> >>>>> >>>>> Hello! >>>>> >>>>> >I am considering to study reader engagement for different article >>>>> topics in different languages. Because of this, I would like to know if >>>>> there is >any plan to make available pageviews dumps detailing activity log >>>>> at session level per user - in a similar way to editor sessions. >>>>> >>>>> Are you thinking of "all-pageviews-visited-by-a-certain-user"? If so, >>>>> no we do not have any projects to provide that data as due to privacy >>>>> concerns we neither have nor keep that information. >>>>> >>>>> Thanks, >>>>> >>>>> Nuria >>>>> >>>>> >>>>> >>>>> On Tue, Jun 28, 2016 at 6:55 PM, Leila Zia <leila(a)wikimedia.org> >>>>> wrote: >>>>> >>>>>> + Analytics >>>>>> >>>>>> >>>>>> On Tue, Jun 28, 2016 at 6:36 AM, Marc Miquel <marcmiquel(a)gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hello, >>>>>>> >>>>>>> I have a question for you regarding pageviews datadumps. >>>>>>> >>>>>>> I am considering to study reader engagement for different article >>>>>>> topics in different languages. Because of this, I would like to know if >>>>>>> there is any plan to make available pageviews dumps detailing activity log >>>>>>> at session level per user - in a similar way to editor sessions. >>>>>>> >>>>>>> Since this would be for a research project I might ask funding for >>>>>>> it, I would like to know if I could count on that, what is the nature of >>>>>>> the available data, and what would be the procedure to obtain this data and >>>>>>> if there would be any implication because of privacy concerns. >>>>>>> >>>>>>> Thank you very much! >>>>>>> >>>>>>> Best, >>>>>>> >>>>>>> Marc Miquel >>>>>>> ᐧ >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Wiki-research-l mailing list >>>>>>> Wiki-research-l(a)lists.wikimedia.org >>>>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Analytics mailing list >>>>>> Analytics(a)lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/analytics >>>>>> >>>>>> >>>>> _______________________________________________ >>>>> Analytics mailing list >>>>> Analytics(a)lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/analytics >>>>> >>>> >>>> _______________________________________________ >>>> Wiki-research-l mailing list >>>> Wiki-research-l(a)lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >>>> >>>> >>> _______________________________________________ >>> Wiki-research-l mailing list >>> Wiki-research-l(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >>> >> >> _______________________________________________ >> Analytics mailing list >> Analytics(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/analytics >> >> > > > -- > *Joseph Allemandou* > Data Engineer @ Wikimedia Foundation > IRC: joal > _______________________________________________ > Analytics mailing list > Analytics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics >

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Wiki-research-l June 2016