Hi all, Per Lodewijk's suggestion, I'm bringing this to the larger list.
WLM-US organizers have been discussing the value of setting up a community voting process on-wiki for the initial selection of the top 500 or so photos in the WLM-US pool, which we will then send to the judges (though we're thinking it would be wise to have the judges also surface photos they like that don't make the top 500). Can anyone on this list (particularly Russian organizers) give us feedback on what works well and what does not work well?
Did you reach out to Commons contributors who had helped with any of the Featured Picture selection or Picture of the Year voting for feedback? A few of those people we've identified live in the U.S., so we're going to reach out to the relevant individuals. We've also been discussing how to incorporate the WikiProject on English WP that deals with our monuments (WP:NRHP) to try to get help from them. We're thinking of it as a group of ambassadors or captains who can help us alleviate some of the challenge for the jury of sorting thousands of photos.
Any feedback would be very welcome.
thanks, Matthew
---------- Forwarded message ---------- From: Lodewijk lodewijk@effeietsanders.org Date: Sat, Jul 28, 2012 at 6:42 PM Subject: Re: Jury process in the US To: Maarten Dammers maarten@mdammers.nl Cc: Matthew Roth mroth@wikimedia.org, Katie Filbert aude.wiki@gmail.com, "Richard (User:Pharos)" pharosofalexandria@gmail.com, Peter Ekman < pdekman@gmail.com>, Ryan Kaldari rkaldari@wikimedia.org, Sarah Stierch < sstierch@wikimedia.org>
What about discussing this particular issue on the international mailing list? I know at least Russia has some experience with a community WLM vote - and I know India is bumping into the same problems as the US here.
Lodewijk
2012/7/28 Maarten Dammers maarten@mdammers.nl
Hi Matthew,
Op 28-7-2012 20:43, Matthew Roth schreef:
Hi Maarten and Lodewijk, In discussions with Wikimedia DC and other WLM-US organizers, I think we're going to try to set up a voting mechanism on-wiki so that Commons users can help us select the top 500 photos in the WLM-US pool, which we will then send to the judges (though the judges can also surface photos that don't make the top 500). We're also talking about having contestants have the option to nominate their own favorite photos to help highlight their own photos for the voting. Pharos brought up a question about being able to put a nomination button in the Uploader so that it automatically tagged the photos with a particular category if the uploader chooses to nominate particular photos of theirs. Do you think that could be easily done from a technical stance? Also curious to hear your thoughts in general about the plan.
I'm very happy to see things are starting to move in the US. Adding bells and whistles to the upload process would go against one of the core principles (https://commons.wikimedia.**org/wiki/Commons:Wiki_Loves_** Monuments/Philosophyhttps://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments/Philosophy) of WLM: Make it easy, so I'm not in favour of that. The jury process shouldn't cost the organization too much work and it shouldn't bother the (new) uploaders. I'm not sure how this will work, I don't have any experience with this model.
Maarten
I think it is not possible to get good feedback from the public when you provide them a to big list, nobody is going to watch all the pictures, and I also don't think somebody is going to watch a random part. If you want to get the public involved, maybe the best Idea is to let a jury pick the top 20-50 and let the public vote on those 50 to decide on the order. Or you can make a preselection of around 500 pictures, where people can pick the best, and then you send a list of 50 to the jury. But I think it will be hard to get people from the public to watch lots of pictures, so you will maybe get a lot of pictures with 1 or 2 votes (maybe even the photographer voting on his own best view. I believe the Russians provided a list of around 100 pictures you could vote on. Then they had 10 different prices, with one of them being the publics nr. 1. but I'm not sure, somebody should confirm. Mvg, Bas
From: mroth@wikimedia.org Date: Sun, 29 Jul 2012 13:39:51 -0700 To: wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Community voting and jury process.
Hi all,Per Lodewijk's suggestion, I'm bringing this to the larger list. WLM-US organizers have been discussing the value of setting up a community voting process on-wiki for the initial selection of the top 500 or so photos in the WLM-US pool, which we will then send to the judges (though we're thinking it would be wise to have the judges also surface photos they like that don't make the top 500). Can anyone on this list (particularly Russian organizers) give us feedback on what works well and what does not work well?
Did you reach out to Commons contributors who had helped with any of the Featured Picture selection or Picture of the Year voting for feedback? A few of those people we've identified live in the U.S., so we're going to reach out to the relevant individuals. We've also been discussing how to incorporate the WikiProject on English WP that deals with our monuments (WP:NRHP) to try to get help from them. We're thinking of it as a group of ambassadors or captains who can help us alleviate some of the challenge for the jury of sorting thousands of photos.
Any feedback would be very welcome. thanks, Matthew
---------- Forwarded message ---------- From: Lodewijk lodewijk@effeietsanders.org
Date: Sat, Jul 28, 2012 at 6:42 PM Subject: Re: Jury process in the US To: Maarten Dammers maarten@mdammers.nl Cc: Matthew Roth mroth@wikimedia.org, Katie Filbert aude.wiki@gmail.com, "Richard (User:Pharos)" pharosofalexandria@gmail.com, Peter Ekman pdekman@gmail.com, Ryan Kaldari rkaldari@wikimedia.org, Sarah Stierch sstierch@wikimedia.org
What about discussing this particular issue on the international mailing list? I know at least Russia has some experience with a community WLM vote - and I know India is bumping into the same problems as the US here.
Lodewijk
2012/7/28 Maarten Dammers maarten@mdammers.nl
Hi Matthew,
Op 28-7-2012 20:43, Matthew Roth schreef:
Hi Maarten and Lodewijk,
In discussions with Wikimedia DC and other WLM-US organizers, I think we're going to try to set up a voting mechanism on-wiki so that Commons users can help us select the top 500 photos in the WLM-US pool, which we will then send to the judges (though the judges can also surface photos that don't make the top 500). We're also talking about having contestants have the option to nominate their own favorite photos to help highlight their own photos for the voting. Pharos brought up a question about being able to put a nomination button in the Uploader so that it automatically tagged the photos with a particular category if the uploader chooses to nominate particular photos of theirs. Do you think that could be easily done from a technical stance? Also curious to hear your thoughts in general about the plan.
I'm very happy to see things are starting to move in the US. Adding bells and whistles to the upload process would go against one of the core principles (https://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments/Philosophy) of WLM: Make it easy, so I'm not in favour of that. The jury process shouldn't cost the organization too much work and it shouldn't bother the (new) uploaders. I'm not sure how this will work, I don't have any experience with this model.
Maarten
On Sun, Jul 29, 2012 at 10:56 PM, Bas vb basvb_wikipedia@live.nl wrote:
I think it is not possible to get good feedback from the public when you provide them a to big list, nobody is going to watch all the pictures, and I also don't think somebody is going to watch a random part. If you want to get the public involved, maybe the best Idea is to let a jury pick the top 20-50 and let the public vote on those 50 to decide on the order. Or you can make a preselection of around 500 pictures, where people can pick the best, and then you send a list of 50 to the jury. But I think it will be hard to get people from the public to watch lots of pictures, so you will maybe get a lot of pictures with 1 or 2 votes (maybe even the photographer voting on his own best view.
The other option we were thinking is having people nominate photos. These could be self-nominations or nominating others' photos.
Not sure how well that would work either, and suspect we might end up doing a bit of nominating ourselves. We do want some variety and geographic representation in the final pool.
Cheers, Katie
I believe the Russians provided a list of around 100 pictures you could vote on. Then they had 10 different prices, with one of them being the publics nr. 1. but I'm not sure, somebody should confirm.
Mvg,
Bas
From: mroth@wikimedia.org Date: Sun, 29 Jul 2012 13:39:51 -0700 To: wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Community voting and jury process.
Hi all, Per Lodewijk's suggestion, I'm bringing this to the larger list.
WLM-US organizers have been discussing the value of setting up a community voting process on-wiki for the initial selection of the top 500 or so photos in the WLM-US pool, which we will then send to the judges (though we're thinking it would be wise to have the judges also surface photos they like that don't make the top 500). Can anyone on this list (particularly Russian organizers) give us feedback on what works well and what does not work well?
Did you reach out to Commons contributors who had helped with any of the Featured Picture selection or Picture of the Year voting for feedback? A few of those people we've identified live in the U.S., so we're going to reach out to the relevant individuals. We've also been discussing how to incorporate the WikiProject on English WP that deals with our monuments (WP:NRHP) to try to get help from them. We're thinking of it as a group of ambassadors or captains who can help us alleviate some of the challenge for the jury of sorting thousands of photos.
Any feedback would be very welcome.
thanks, Matthew
---------- Forwarded message ---------- From: *Lodewijk* lodewijk@effeietsanders.org Date: Sat, Jul 28, 2012 at 6:42 PM Subject: Re: Jury process in the US To: Maarten Dammers maarten@mdammers.nl Cc: Matthew Roth mroth@wikimedia.org, Katie Filbert aude.wiki@gmail.com, "Richard (User:Pharos)" pharosofalexandria@gmail.com, Peter Ekman < pdekman@gmail.com>, Ryan Kaldari rkaldari@wikimedia.org, Sarah Stierch < sstierch@wikimedia.org>
What about discussing this particular issue on the international mailing list? I know at least Russia has some experience with a community WLM vote
- and I know India is bumping into the same problems as the US here.
Lodewijk
2012/7/28 Maarten Dammers maarten@mdammers.nl
Hi Matthew,
Op 28-7-2012 20:43, Matthew Roth schreef:
Hi Maarten and Lodewijk, In discussions with Wikimedia DC and other WLM-US organizers, I think we're going to try to set up a voting mechanism on-wiki so that Commons users can help us select the top 500 photos in the WLM-US pool, which we will then send to the judges (though the judges can also surface photos that don't make the top 500). We're also talking about having contestants have the option to nominate their own favorite photos to help highlight their own photos for the voting. Pharos brought up a question about being able to put a nomination button in the Uploader so that it automatically tagged the photos with a particular category if the uploader chooses to nominate particular photos of theirs. Do you think that could be easily done from a technical stance? Also curious to hear your thoughts in general about the plan.
I'm very happy to see things are starting to move in the US. Adding bells and whistles to the upload process would go against one of the core principles (https://commons.wikimedia.**org/wiki/Commons:Wiki_Loves_** Monuments/Philosophyhttps://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments/Philosophy) of WLM: Make it easy, so I'm not in favour of that. The jury process shouldn't cost the organization too much work and it shouldn't bother the (new) uploaders. I'm not sure how this will work, I don't have any experience with this model.
Maarten
--
Matthew Roth Global Communications Wikimedia Foundation +1.415.839.6885 ext 6635 www.wikimediafoundation.org *https://donate.wikimedia.org*
_______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
I think that asking a community to help is an interesting concept and *could* work. You do need some software support for that though (see my email about jury tools several weeks ago) - software that could be used too in smaller juries. A nomination method could indeed work (letting everyone nominate up to 10 pictures from the whole lot should not get you much more than 500 images). The problem is that 90% of the people will start with either their own images, or with the A in the alphabet.
Alternatively, you could cut the mountain of images in randomized samples, and have 2-3 volunteers for each sample. That should also reduce drastically.
Anyway, many methods - experiences from Russia would indeed be welcome.
Lodewijk
2012/7/29 aude aude.wiki@gmail.com
On Sun, Jul 29, 2012 at 10:56 PM, Bas vb basvb_wikipedia@live.nl wrote:
I think it is not possible to get good feedback from the public when you provide them a to big list, nobody is going to watch all the pictures, and I also don't think somebody is going to watch a random part. If you want to get the public involved, maybe the best Idea is to let a jury pick the top 20-50 and let the public vote on those 50 to decide on the order. Or you can make a preselection of around 500 pictures, where people can pick the best, and then you send a list of 50 to the jury. But I think it will be hard to get people from the public to watch lots of pictures, so you will maybe get a lot of pictures with 1 or 2 votes (maybe even the photographer voting on his own best view.
The other option we were thinking is having people nominate photos. These could be self-nominations or nominating others' photos.
Not sure how well that would work either, and suspect we might end up doing a bit of nominating ourselves. We do want some variety and geographic representation in the final pool.
Cheers, Katie
I believe the Russians provided a list of around 100 pictures you could vote on. Then they had 10 different prices, with one of them being the publics nr. 1. but I'm not sure, somebody should confirm.
Mvg,
Bas
From: mroth@wikimedia.org Date: Sun, 29 Jul 2012 13:39:51 -0700 To: wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Community voting and jury process.
Hi all, Per Lodewijk's suggestion, I'm bringing this to the larger list.
WLM-US organizers have been discussing the value of setting up a community voting process on-wiki for the initial selection of the top 500 or so photos in the WLM-US pool, which we will then send to the judges (though we're thinking it would be wise to have the judges also surface photos they like that don't make the top 500). Can anyone on this list (particularly Russian organizers) give us feedback on what works well and what does not work well?
Did you reach out to Commons contributors who had helped with any of the Featured Picture selection or Picture of the Year voting for feedback? A few of those people we've identified live in the U.S., so we're going to reach out to the relevant individuals. We've also been discussing how to incorporate the WikiProject on English WP that deals with our monuments (WP:NRHP) to try to get help from them. We're thinking of it as a group of ambassadors or captains who can help us alleviate some of the challenge for the jury of sorting thousands of photos.
Any feedback would be very welcome.
thanks, Matthew
---------- Forwarded message ---------- From: *Lodewijk* lodewijk@effeietsanders.org Date: Sat, Jul 28, 2012 at 6:42 PM Subject: Re: Jury process in the US To: Maarten Dammers maarten@mdammers.nl Cc: Matthew Roth mroth@wikimedia.org, Katie Filbert < aude.wiki@gmail.com>, "Richard (User:Pharos)" < pharosofalexandria@gmail.com>, Peter Ekman pdekman@gmail.com, Ryan Kaldari rkaldari@wikimedia.org, Sarah Stierch sstierch@wikimedia.org
What about discussing this particular issue on the international mailing list? I know at least Russia has some experience with a community WLM vote
- and I know India is bumping into the same problems as the US here.
Lodewijk
2012/7/28 Maarten Dammers maarten@mdammers.nl
Hi Matthew,
Op 28-7-2012 20:43, Matthew Roth schreef:
Hi Maarten and Lodewijk, In discussions with Wikimedia DC and other WLM-US organizers, I think we're going to try to set up a voting mechanism on-wiki so that Commons users can help us select the top 500 photos in the WLM-US pool, which we will then send to the judges (though the judges can also surface photos that don't make the top 500). We're also talking about having contestants have the option to nominate their own favorite photos to help highlight their own photos for the voting. Pharos brought up a question about being able to put a nomination button in the Uploader so that it automatically tagged the photos with a particular category if the uploader chooses to nominate particular photos of theirs. Do you think that could be easily done from a technical stance? Also curious to hear your thoughts in general about the plan.
I'm very happy to see things are starting to move in the US. Adding bells and whistles to the upload process would go against one of the core principles (https://commons.wikimedia.**org/wiki/Commons:Wiki_Loves_** Monuments/Philosophyhttps://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments/Philosophy) of WLM: Make it easy, so I'm not in favour of that. The jury process shouldn't cost the organization too much work and it shouldn't bother the (new) uploaders. I'm not sure how this will work, I don't have any experience with this model.
Maarten
--
Matthew Roth Global Communications Wikimedia Foundation +1.415.839.6885 ext 6635 www.wikimediafoundation.org *https://donate.wikimedia.org*
_______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Board member, Wikimedia District of Columbia http://wikimediadc.org @wikimediadc / @wikimania2012
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Hello Matthew,
On Mon, Jul 30, 2012 at 12:39 AM, Matthew Roth mroth@wikimedia.org wrote:
WLM-US organizers have been discussing the value of setting up a community voting process on-wiki for the initial selection of the top 500 or so photos in the WLM-US pool, which we will then send to the judges (though we're thinking it would be wise to have the judges also surface photos they like that don't make the top 500). Can anyone on this list (particularly Russian organizers) give us feedback on what works well and what does not work well?
For us it was important to involve community to the contest; may be you know that ~90%+ of our participants in 2011 were newbies, and we need to do a great work to include active users in the future. In the last summer people said 'Why do we need WLM at all? No one is forbidden to walk and take pictures of buildings without competition', and at last time people says about WLM as about an interesting and useful expirience (but the problem with an interest of community still exists because of unfreedom of panorama, lack of people and so on). But we used the poll as the second stage, not the first; we had 10 nominations, each of it has it's own purpose, and our jury made a shortlist. In this year we're doing the site for voting and trying to find an ideal solution - may be social network competition, with a demonstration who has been the most active in the evaluation of photographs, with checking on the reasonableness of this activity.
Did you reach out to Commons contributors who had helped with any of the Featured Picture selection or Picture of the Year voting for feedback?
Yes, last year we used Kalan's script, that was created for POTY.
wikilovesmonuments@lists.wikimedia.org