Hello everyone,
I was interested to know whether there has been any research done around the use of the Mass Message mediawiki extension and in particular about impact of using it.
By extension, I am interested in any research that might be related to the impact of posting a "template" message (as opposed to an individual targetted) on a user talk page. I know the SignPost did a poll in 2017 to evaluate the interest of switching to the Newsletter extension system. And I remember reading about impact of notifications. But are there studies related to the measure of impact in terms of engagement to mass posting on user talk page ?
Thanks for any insight you could provide
Florence
Hi Florence,
A paper by Zhu et al spring to mind, as well as the study of phrasing in template messages by Geiger et al. Although these focus on one-to-one communication on Wiki rather than mass communication, I think they'll be relevant. I think there's also a paper about invitations to join WikiProjects that looks at personalized vs templated messages, but I cannot find it at the moment.
Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. CHI, 2013.
Defense Mechanism or Socialization Tactic? Improving Wikipedia's Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and Walling. ICWSM 2012.
Cheers, Morten
On Thu, 22 Nov 2018 at 07:11, Florence Devouard fdevouard@gmail.com wrote:
Hello everyone,
I was interested to know whether there has been any research done around the use of the Mass Message mediawiki extension and in particular about impact of using it.
By extension, I am interested in any research that might be related to the impact of posting a "template" message (as opposed to an individual targetted) on a user talk page. I know the SignPost did a poll in 2017 to evaluate the interest of switching to the Newsletter extension system. And I remember reading about impact of notifications. But are there studies related to the measure of impact in terms of engagement to mass posting on user talk page ?
Thanks for any insight you could provide
Florence
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hello Morten
Thanks for the infos. Will start from there !
Cheers
Flo
Le 24/11/2018 à 16:47, Morten Wang a écrit :
Hi Florence,
A paper by Zhu et al spring to mind, as well as the study of phrasing in template messages by Geiger et al. Although these focus on one-to-one communication on Wiki rather than mass communication, I think they'll be relevant. I think there's also a paper about invitations to join WikiProjects that looks at personalized vs templated messages, but I cannot find it at the moment.
Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. CHI, 2013.
Defense Mechanism or Socialization Tactic? Improving Wikipedia's Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and Walling. ICWSM 2012.
Cheers, Morten
On Thu, 22 Nov 2018 at 07:11, Florence Devouard fdevouard@gmail.com wrote:
Hello everyone,
I was interested to know whether there has been any research done around the use of the Mass Message mediawiki extension and in particular about impact of using it.
By extension, I am interested in any research that might be related to the impact of posting a "template" message (as opposed to an individual targetted) on a user talk page. I know the SignPost did a poll in 2017 to evaluate the interest of switching to the Newsletter extension system. And I remember reading about impact of notifications. But are there studies related to the measure of impact in terms of engagement to mass posting on user talk page ?
Thanks for any insight you could provide
Florence
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi Flo,
It would be really helpful if you let us know in this thread (whenever you're ready for it and if the answer to your questions is not already in the literature) what kind of research or analysis would be helpful for you. Something we would like to start exploring in the Research team is to convert this kind of question to a well-documented open question type and offer it to volunteer researchers who come to us and ask for what questions to work on.
I have a few questions on this front which may help you expand from there (or negate and tell me to discard them as not-interesting): * What is the impact of MassMessage on activation (where activation needs to be defined but broadly speaking, it's bringing back the user after a period of inactivity to do at least n edits)? * Is the impact on activation dependent on the topic of the MassMessage? For example, does a MassMessage on a call for elections activate the users the same way as the MassMessage to congratulate Wiki Loves Monuments winners? * Is the impact on activation wiki dependent? For example, are Wikimedia Commons editors more likely to get activated after receiving a MassMessage than Wikidata editors? * Is the impact on activation related to the tenure of the user, where tenure needs to be defined but roughly speaking: it's the number of years since account registration?
And finally, we have some learnings from emailing users which may be helpful for you to know as some of them may apply to MassMessage, too, though we can only hypothesize at this point: * On Wikipedia: the users are more likely to respond to a call to action (in this case: create an article) if they have recently edited Wikipedia. Check Figure 10 in https://arxiv.org/pdf/1604.03235.pdf . The more there is time in between the last edit time and the time the users received the email, the less likely they are to respond to the call to action. * On Wikipedia: Personalization matters. The editors who received personalized messages (in this case, it really means personalized recommendations) started to contribute to articles twice more than those who received important articles as part of their recommendations that where not personalized. I want to emphasize that the set-up of the experiment was very specific, but there may be some learnings here for what you have in mind.
Best, Leila On Mon, Nov 26, 2018 at 10:02 AM Florence Devouard fdevouard@gmail.com wrote:
Hello Morten
Thanks for the infos. Will start from there !
Cheers
Flo
Le 24/11/2018 à 16:47, Morten Wang a écrit :
Hi Florence,
A paper by Zhu et al spring to mind, as well as the study of phrasing in template messages by Geiger et al. Although these focus on one-to-one communication on Wiki rather than mass communication, I think they'll be relevant. I think there's also a paper about invitations to join WikiProjects that looks at personalized vs templated messages, but I cannot find it at the moment.
Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. CHI, 2013.
Defense Mechanism or Socialization Tactic? Improving Wikipedia's Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and Walling. ICWSM 2012.
Cheers, Morten
On Thu, 22 Nov 2018 at 07:11, Florence Devouard fdevouard@gmail.com wrote:
Hello everyone,
I was interested to know whether there has been any research done around the use of the Mass Message mediawiki extension and in particular about impact of using it.
By extension, I am interested in any research that might be related to the impact of posting a "template" message (as opposed to an individual targetted) on a user talk page. I know the SignPost did a poll in 2017 to evaluate the interest of switching to the Newsletter extension system. And I remember reading about impact of notifications. But are there studies related to the measure of impact in terms of engagement to mass posting on user talk page ?
Thanks for any insight you could provide
Florence
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Found the paper on welcoming newcomers to WikiProjects that I'm certain is also relevant here, it's this one: Choi, Boreum, et al. "Socialization Tactics in Wikipedia and Their Effects." CSCW, 2010. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.424.7966&rep=re...
Cheers, Morten
On Mon, 26 Nov 2018 at 10:02, Florence Devouard fdevouard@gmail.com wrote:
Hello Morten
Thanks for the infos. Will start from there !
Cheers
Flo
Le 24/11/2018 à 16:47, Morten Wang a écrit :
Hi Florence,
A paper by Zhu et al spring to mind, as well as the study of phrasing in template messages by Geiger et al. Although these focus on one-to-one communication on Wiki rather than mass communication, I think they'll be relevant. I think there's also a paper about invitations to join WikiProjects that looks at personalized vs templated messages, but I
cannot
find it at the moment.
Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. CHI, 2013.
Defense Mechanism or Socialization Tactic? Improving Wikipedia's Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and Walling. ICWSM 2012.
Cheers, Morten
On Thu, 22 Nov 2018 at 07:11, Florence Devouard fdevouard@gmail.com
wrote:
Hello everyone,
I was interested to know whether there has been any research done around the use of the Mass Message mediawiki extension and in particular about impact of using it.
By extension, I am interested in any research that might be related to the impact of posting a "template" message (as opposed to an individual targetted) on a user talk page. I know the SignPost did a poll in 2017 to evaluate the interest of switching to the Newsletter extension system. And I remember reading about impact of notifications. But are there studies related to the measure of impact in terms of engagement to mass posting on user talk
page
?
Thanks for any insight you could provide
Florence
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
wiki-research-l@lists.wikimedia.org