2013/8/20 David Narvaez <david.narvaez@computer.org>
On Mon, Aug 19, 2013 at 12:50 PM, Peter Ekman <pdekman@gmail.com> wrote:
> B) Will it be able to handle 1,000 entries per day?  Or a better question -
> What will it take to make it work well with 1,000 entries per day?
> - technically, I'd think one upload (perhaps of just one day's worth of
> entries each day) would seem to be needed.  If each reviewer needs to upload
> 30,000 images each time they use it, it could be pretty difficult.


Well, nothing is really uploaded to the tool, but some database
entries (and 1,000 db entries are manageable, probably with some
tweaks I have in mind), but I think this question is oriented towards
the "rate as you go" mode you mention later, is that right?

> -technically, can it be set so that new images (or perhaps randomly selected
> images) are judged by different reviewers.  We wouldn't want the same 500
> images being at the front of the line that get judged by 10 different
> people, but the other 29,500 don't get seen at all.

That is what the configurations for policy of the round are for: With
a "All photos are reviewed exactly once" policy, no photo is ever
served to two different juries, with a "All photos are reviewed by at
least x juries" all photos are also reviewed, and more than once.

> -sociologically, how to deal with folks who go through and select the photos
> they uploaded and rate poorly other very good photos (gaming)?

This would only apply to Open rounds and has no way to be fixed.
Invitational rounds, on the other hand, would require juries to be
pre-approved by the organizers of the contest, and that means the
organizers won't put a jury that uploaded a photo.

> -what happens to photos not rated in cases there are too many photos and not
> enough reviewers?  Are they just left behind?

Haven't thought of that. In my small head all photos have to be reviewed.

Would this be solved if you start at a random point in the review list rather than always at the beginning? Then every jury member would start somewhere else, and the odds of images having zero reviews is minimized. 
 

> -is "rate as you go" a possibility, or would you have to wait until the end
> of the contest?

Good question. The tool is not really designed for that, but could be
extended to support this. I'd like to hear other opininos about this.

I think if you allow feeding multiple txt files through the contest (taking out doublures) that might work? 
 

> -presentation, could you include a box where the local designer (who selects
> the various options) explains how they work, i.e. what are the mechanics for
> a photo to get to the next round.

That's doable, and shouldn't be too hard. I would only need help with
the wording (see the other thread about design).

I think if you just present this as an option, you could have this as an empty text box in the configuration, and let the configurer worry about the wording (and language).

A question of my own: what happens if an image gets renamed/deleted. Will the tool be able to handle that? 

Lodewijk