Hi,
I recorded this video of the workflow of configuring and starting to use the jury tool. Unfortunately, at the time of that recording several things had not been implemented yet, which I'll detail in the list below.
http://wlm.wmflabs.org/wlmjurytoolworkflow.ogv
The workflow after installing the tool using the steps mentioned in the other thread is more or less as follows:
1. Select the number of rounds of your contest. This is, how many times will the jury go over the pics
2. For each round you will be presented with a screen to configure the options for that round. Then, for instance, if you configured your contest to be of 3 rounds in step 1, you will see 3 configuration screens in this step.
2.1 For each round you can select whether you want that to be an open round or an invitational round. An open round means anybody can create an account in your tool, and go over the pics. An invitational round means only certain accounts in your tool will be able to go over the pics of this round. Pending in my TODO list is a configuration option to specify what accounts are invited to that round.
2.2 For each round you can select what type of scores will be used. Binay score means Yes/No, while Star-based gives the jury a 5-stars range to pic for each photo.
2.3 [Not in the video] For each round you can select what the scoring policy will be. You can pick between the following options: All photos are scored exactly once and All photos are scored by at least x juries. Obviously, if you have an invitational round of 5 juries, then configuring this round so that All photos are scored by at least 5 juries means All photos are scored by all juries.
2.4 For each round you can select the input of that round. Input may be a category in commons, or a selection of the photos from the previous round, or a plain text file containing the name of the photos in commons. Whatever you pic here will be used to show a configuration screen when the round is about to start.
3. Once all the information for each round is set, Round 1 is about to start, so the tool will show a configuration screen for that. In the video, since Round 1 was set to have a commons category as input, the configuration screen asks for a commons category, you type the name, and the pics from that round are loaded from the category. Had it been configured as having input from a plain text file, the tool would have asked for a file instead of a category in the configuration screen.
And that's it for the moment, there are some other pending things but I think this covers most of the hassle of configuring the tool. Let me know if you have any feedback.
David E. Narvaez
A simple comment, but I think that it may be helpful.
I have been in the coordination of the jury of WM CH last year and what has been really missed in the tool of the jury of last year was the *description* of the photo.
I think that the description is really important mainly to evaluate the importance of the photo and to give to the photographer the possibility to explain his experience.
The jury without the description can evaluate an image and not a photo, and they miss something really important.
If we reduce the photo contest to a paranoic pushing the button to take picture, the value of the contest is a lot decreased.
During the final ceremony we invited people to describe *their experience and what they tried to communicate in the picture* and we discovered that a simple picture has been a big experience for some participants because they described the difficulties to take the picture but also we discovered that some pictures have been peculiar because they took some monuments in general closed to the public.
For instance I remember a picture of a wall in the campaign of the French Swiss, the jury has evaluated it not so important but I found it fantastic because it was evident the technic of construction of celtic people. Basically the photo had a really *high descriptive value* and in my opinion this is the main value because we have to use these photos for an encyclopedia and not to produce calendars or presents for Christmas time.
Regards
On Mon, Aug 19, 2013 at 2:16 PM, David Narvaez david.narvaez@computer.orgwrote:
Hi,
I recorded this video of the workflow of configuring and starting to use the jury tool. Unfortunately, at the time of that recording several things had not been implemented yet, which I'll detail in the list below.
http://wlm.wmflabs.org/wlmjurytoolworkflow.ogv
The workflow after installing the tool using the steps mentioned in the other thread is more or less as follows:
- Select the number of rounds of your contest. This is, how many
times will the jury go over the pics
- For each round you will be presented with a screen to configure the
options for that round. Then, for instance, if you configured your contest to be of 3 rounds in step 1, you will see 3 configuration screens in this step.
2.1 For each round you can select whether you want that to be an open round or an invitational round. An open round means anybody can create an account in your tool, and go over the pics. An invitational round means only certain accounts in your tool will be able to go over the pics of this round. Pending in my TODO list is a configuration option to specify what accounts are invited to that round.
2.2 For each round you can select what type of scores will be used. Binay score means Yes/No, while Star-based gives the jury a 5-stars range to pic for each photo.
2.3 [Not in the video] For each round you can select what the scoring policy will be. You can pick between the following options: All photos are scored exactly once and All photos are scored by at least x juries. Obviously, if you have an invitational round of 5 juries, then configuring this round so that All photos are scored by at least 5 juries means All photos are scored by all juries.
2.4 For each round you can select the input of that round. Input may be a category in commons, or a selection of the photos from the previous round, or a plain text file containing the name of the photos in commons. Whatever you pic here will be used to show a configuration screen when the round is about to start.
- Once all the information for each round is set, Round 1 is about to
start, so the tool will show a configuration screen for that. In the video, since Round 1 was set to have a commons category as input, the configuration screen asks for a commons category, you type the name, and the pics from that round are loaded from the category. Had it been configured as having input from a plain text file, the tool would have asked for a file instead of a category in the configuration screen.
And that's it for the moment, there are some other pending things but I think this covers most of the hassle of configuring the tool. Let me know if you have any feedback.
David E. Narvaez
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Hi,
that sounds like a nice feature request. But at the same time, it seems more important to me to have a good working tool than to have it perfect :)
Adding a description sounds rather complicated to me, if you consider that the description is changed often over the course of the contest, which conflicts with the judge-on-the-fly that was suggested for some other countries. Also the descriptions can be very short or very long, language dependent and could be in the list instead of in the image.
I would suggest to not bother about the descriptions actually, except for the last stage of the competition. When we're talking about thousands of images, no way that the jury will be able to read all those descriptions (and if they insist for a particular photo, they can open the file description page). For the last stage of your judging, when you have about 50 photos left, you could perhaps implement this though - if not in the tool, you could do it manually with an hour of work (which means that if it is complicated to do that in the tool, it should simply not be done in the tool) and do the judging of the final 50 outside the tool.
The usefulness of the tool is primarily in the first phases - getting the huge amount of photos down to a sizable amount.
Lodewijk
2013/8/21 Ilario Valdelli valdelli@gmail.com
A simple comment, but I think that it may be helpful.
I have been in the coordination of the jury of WM CH last year and what has been really missed in the tool of the jury of last year was the *description* of the photo.
I think that the description is really important mainly to evaluate the importance of the photo and to give to the photographer the possibility to explain his experience.
The jury without the description can evaluate an image and not a photo, and they miss something really important.
If we reduce the photo contest to a paranoic pushing the button to take picture, the value of the contest is a lot decreased.
During the final ceremony we invited people to describe *their experience and what they tried to communicate in the picture* and we discovered that a simple picture has been a big experience for some participants because they described the difficulties to take the picture but also we discovered that some pictures have been peculiar because they took some monuments in general closed to the public.
For instance I remember a picture of a wall in the campaign of the French Swiss, the jury has evaluated it not so important but I found it fantastic because it was evident the technic of construction of celtic people. Basically the photo had a really *high descriptive value* and in my opinion this is the main value because we have to use these photos for an encyclopedia and not to produce calendars or presents for Christmas time.
Regards
On Mon, Aug 19, 2013 at 2:16 PM, David Narvaez <david.narvaez@computer.org
wrote:
Hi,
I recorded this video of the workflow of configuring and starting to use the jury tool. Unfortunately, at the time of that recording several things had not been implemented yet, which I'll detail in the list below.
http://wlm.wmflabs.org/wlmjurytoolworkflow.ogv
The workflow after installing the tool using the steps mentioned in the other thread is more or less as follows:
- Select the number of rounds of your contest. This is, how many
times will the jury go over the pics
- For each round you will be presented with a screen to configure the
options for that round. Then, for instance, if you configured your contest to be of 3 rounds in step 1, you will see 3 configuration screens in this step.
2.1 For each round you can select whether you want that to be an open round or an invitational round. An open round means anybody can create an account in your tool, and go over the pics. An invitational round means only certain accounts in your tool will be able to go over the pics of this round. Pending in my TODO list is a configuration option to specify what accounts are invited to that round.
2.2 For each round you can select what type of scores will be used. Binay score means Yes/No, while Star-based gives the jury a 5-stars range to pic for each photo.
2.3 [Not in the video] For each round you can select what the scoring policy will be. You can pick between the following options: All photos are scored exactly once and All photos are scored by at least x juries. Obviously, if you have an invitational round of 5 juries, then configuring this round so that All photos are scored by at least 5 juries means All photos are scored by all juries.
2.4 For each round you can select the input of that round. Input may be a category in commons, or a selection of the photos from the previous round, or a plain text file containing the name of the photos in commons. Whatever you pic here will be used to show a configuration screen when the round is about to start.
- Once all the information for each round is set, Round 1 is about to
start, so the tool will show a configuration screen for that. In the video, since Round 1 was set to have a commons category as input, the configuration screen asks for a commons category, you type the name, and the pics from that round are loaded from the category. Had it been configured as having input from a plain text file, the tool would have asked for a file instead of a category in the configuration screen.
And that's it for the moment, there are some other pending things but I think this covers most of the hassle of configuring the tool. Let me know if you have any feedback.
David E. Narvaez
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Ilario Valdelli Wikimedia CH Verein zur Förderung Freien Wissens Association pour l’avancement des connaissances libre Associazione per il sostegno alla conoscenza libera Switzerland - 8008 Zürich Tel: +41764821371 http://www.wikimedia.ch
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
I agree that visibility of the description is of vital importance. As it may be a complex process to ensure that the description field gets updated when it is changed online, I think it would for this year be perfectly OK simply to show the description as originally uploaded as a static text field. More complex things could come later.
Michael
On 21 Aug 2013, at 09:39, Ilario Valdelli wrote:
A simple comment, but I think that it may be helpful.
I have been in the coordination of the jury of WM CH last year and what has been really missed in the tool of the jury of last year was the *description* of the photo.
I think that the description is really important mainly to evaluate the importance of the photo and to give to the photographer the possibility to explain his experience.
The jury without the description can evaluate an image and not a photo, and they miss something really important.
If we reduce the photo contest to a paranoic pushing the button to take picture, the value of the contest is a lot decreased.
During the final ceremony we invited people to describe *their experience and what they tried to communicate in the picture* and we discovered that a simple picture has been a big experience for some participants because they described the difficulties to take the picture but also we discovered that some pictures have been peculiar because they took some monuments in general closed to the public.
For instance I remember a picture of a wall in the campaign of the French Swiss, the jury has evaluated it not so important but I found it fantastic because it was evident the technic of construction of celtic people. Basically the photo had a really *high descriptive value* and in my opinion this is the main value because we have to use these photos for an encyclopedia and not to produce calendars or presents for Christmas time.
Regards
On Mon, Aug 19, 2013 at 2:16 PM, David Narvaez david.narvaez@computer.org wrote: Hi,
I recorded this video of the workflow of configuring and starting to use the jury tool. Unfortunately, at the time of that recording several things had not been implemented yet, which I'll detail in the list below.
http://wlm.wmflabs.org/wlmjurytoolworkflow.ogv
The workflow after installing the tool using the steps mentioned in the other thread is more or less as follows:
- Select the number of rounds of your contest. This is, how many
times will the jury go over the pics
- For each round you will be presented with a screen to configure the
options for that round. Then, for instance, if you configured your contest to be of 3 rounds in step 1, you will see 3 configuration screens in this step.
2.1 For each round you can select whether you want that to be an open round or an invitational round. An open round means anybody can create an account in your tool, and go over the pics. An invitational round means only certain accounts in your tool will be able to go over the pics of this round. Pending in my TODO list is a configuration option to specify what accounts are invited to that round.
2.2 For each round you can select what type of scores will be used. Binay score means Yes/No, while Star-based gives the jury a 5-stars range to pic for each photo.
2.3 [Not in the video] For each round you can select what the scoring policy will be. You can pick between the following options: All photos are scored exactly once and All photos are scored by at least x juries. Obviously, if you have an invitational round of 5 juries, then configuring this round so that All photos are scored by at least 5 juries means All photos are scored by all juries.
2.4 For each round you can select the input of that round. Input may be a category in commons, or a selection of the photos from the previous round, or a plain text file containing the name of the photos in commons. Whatever you pic here will be used to show a configuration screen when the round is about to start.
- Once all the information for each round is set, Round 1 is about to
start, so the tool will show a configuration screen for that. In the video, since Round 1 was set to have a commons category as input, the configuration screen asks for a commons category, you type the name, and the pics from that round are loaded from the category. Had it been configured as having input from a plain text file, the tool would have asked for a file instead of a category in the configuration screen.
And that's it for the moment, there are some other pending things but I think this covers most of the hassle of configuring the tool. Let me know if you have any feedback.
David E. Narvaez
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Ilario Valdelli Wikimedia CH Verein zur Förderung Freien Wissens Association pour l’avancement des connaissances libre Associazione per il sostegno alla conoscenza libera Switzerland - 8008 Zürich Tel: +41764821371 http://www.wikimedia.ch _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
wikilovesmonuments@lists.wikimedia.org