We had very bad experience with using the WLX jury tool this year. I
described it at length here:
Several possible solutions are also mentioned on that page. I would like
to hear your opinion about this situation. Could anyone help Ilya with
developing and maintaining the jury tool, and make sure that it works at
it should work?
If we are planning to meet a very sharp deadline of October 25 for WLM
photos, the jury tool should work absolutely smoothly, and user support
has to be very prompt. Or it would be good to know already now that we
can't rely on the jury tool, and alternative solutions should be
I think we can extend the deadline, but you still have only 20 days to rate
10 thousand images and you might need several rounds more.
You may need to change the instructions to reviewers. Please ask to select
no more than say 50 images in the current round.
Because in round 1 you have already reviewed about 30 thousand images, but
each of the nine reviewers selected from 299 to 1225 images totaling 10416
images to review again in round 2. And the reviewer that started the
selection already selected 114 images and rejected 221 out if his portion
of 1157 images. This gives you too many images after each round.
In Ukraine on the zero round each reviewer selected about 400 images.
In the first round each juror was given instruction to select up to 50
images from about 700 in their portion which totaled to about 400 images
for the second round.
In second round every juror was selecting top10 from the common pool so
total number of images selected for 3rd round is 70, which is easy to rate.
Please set deadlines for you rounds. We used one week, so you can set
August 2 as the deadline of the current round, so you can have two more
rounds in next two weeks (or you can finish faster as the number of images
will be much less).
Maybe you also need help with volunteers to review the images? I see in the
last two days only 1 of 9 reviewers was reviewing. So if someone is tired
or demotivated you may need to ask to replace him/her
On Wed, Jul 27, 2016 at 8:01 PM, Yohann Thomas <yohannvt(a)wikimedia.in>
> Dear Organizers of the International Wiki Loves Earth 2016 edition
> As you are very well aware India had its edition of Wiki Loves Earth from
> 1st June to 30th June 2016. In this period, we saw almost 32,000+ images
> in the competition.
> Images from India total to 25% of all images uploaded by all the
> participating countries in the whole Wiki Loves Earth 2016 competition.
> Such a massive response was totally unexpected from us. Inspite of having
> limited volunteers & such a huge task at our hand, we have been striving to
> publish the results by the deadline. Other obstacles we faced included
> downtime of the WLX jury tool & observing fatigue among the small volunteer
> After facing these unforeseen challenges, we humbly request the organizers
> to extend the deadline till 15th August for submitting the winners for the
> Indian edition.
> I look forward to a positive reply on our request
> Thanking you
> Yohann Thomas
> Organizer, Wiki Loves Earth India 2016
> President,Wikimedia India