Hello guys
I wanted to give you a first feedback regarding the organization of WLA and in particular the organization of the jury and of the global vote.
The reason why I offer this feedback now is because I read in the local teams feedback that the votes should be more transparent.
I could not agree more...
I should however also outline that the photo selection is one of the contest element that is very bad for my health.
Last year, we had no special tools but 6000 images to rank. We did that in several parts, but mostly using google docs. I spent a HUGE amount of time (and when I say HUGE, I really mean HUGE) managing the images and the selections proposed by the jury. It was truely awful.
This year, I was more optimistic because I had been told of the Jury Tool made by Ilya. In terms of jury, we selected images in 3 rounds (the Community picture was a fourth round).
The first round was on the Jury Tool with only wikimedians. It worked well generally, except that - I had to ask Ilya *many* times to set up the tool - one jury member was not very reactive
The second round was again on the Jury Tool, with all jury members. It worked more or less ok, except that - I had to ask Ilya many, many, many, many, many times to set up the tool - some jury members were not reactive - some jury members voted only for a selection of images, which somehow does not work very well in selecting the best images
Which means that at the end of the second round, there was no clear winner
And the problem is that this tool allows only two roles. The admin role see everything. The jury role sees only his votes. Which is not very satisfactory in terms of transparency.
The third round ended up on Google Docs again. Because after waiting for Ilya to set up the tool for MANY weeks, I GAVE UP. We could have done the third round on Commons (pretty much in the same way than the community vote), but then... we would have needed to train our non wikimedia jury to actually edit Commons. Which is nice... but probably beyond what they were ready to do.
In short... the vote was a nightmare in 2014. And it put me in murderous mood in 2015.
So I am still looking for an acceptable way of judging 8000+ images in - a reasonable timeframe - in a transparent fashion - without spending HOURS of time on it
I have opened a page on the IdeaLab to discuss the Jury Tool. https://meta.wikimedia.org/wiki/Grants:IdeaLab/WLX_Jury_Tool_:_improved_tool... At least... I discover that I was not the only one victim of a non-reactive developer :)
But let me just say that unless the tool is improved during the year (or unless a new tool is made available), the way pictures are selected will have to be changed dramatically. Maybe it means we should stop working with an external jury ? Maybe it means we should first select images at the local level then at the global level as WLM is doing (but then giving no price for countries with no local team ?)
I dunno. But we have an issue there. I am interested to know how people involved in other contests actually do.
Florence
Hi Florence, I can bring my experience in organizing Wiki Loves Monuments and Wiki Loves Earth in Switzerland and recently being member of the international team.
The big constraint of WLX is the timeframe. In one month the local teams have to send the list of winners and in few months the international jury to select the winners.
Last year in Switzerland we have received the same comments about transparency, I agree with them but it's difficult to find a good balance between time and transparency.
As member of the international jury we gave also a list of potential jury tools to be used but at the moment WLX jury tool is the more flexible even if not the most complete.
Within IEG program there was a discussion about the financial support to improve the old jury tool used by WLM (https://meta.wikimedia.org/wiki/Grants:IEG/Modernize_the_Wiki_Loves_Monument...), but this option has been excluded because Narvaez sent the information to discontinue the development of the old jury tool, at the moment the tool of Ilya is a good option and the international team of WLM asked to use it also for this contest.
At the moment I think that it makes sense to support better the WLX jury tool, but I have to add that the technology used by Ilya is not simple (it uses Scala, for instance, and this is a new language with small group of developers).
Kind regards
On 14.03.2016 12:14, Florence Devouard wrote:
Hello guys
I wanted to give you a first feedback regarding the organization of WLA and in particular the organization of the jury and of the global vote.
The reason why I offer this feedback now is because I read in the local teams feedback that the votes should be more transparent.
I could not agree more...
african-wikimedians@lists.wikimedia.org