Hi Pine, thank you for your detailed response. Answers in line! On Wed, Sep 24, 2014 at 8:24 PM, Pine W &lt;wiki.pine(a)gmail.com&gt; wrote: that Yes, they are. Open-ended text responses may be answered in different languages, as well. Text boxes are dominant in the survey to make the process less rigid. While we may need to follow up for clarification after translation, we definitely are willing to work with those reporting to make the process as light as possible. Further, category names should be reported as they would appear in the project they exist in, not translated to English. Actually, the fields are open text, because, if we add validation, it requires the answer and will not permit a reporter who does not have the exact dates, or someone who only has a date and not hour, to advance through the rest of the reporting form. Instead, we do offer an open box, optional to complete, and instruct responses to be in the MM/DD/YY:00:00 (UTC) format. We will clean up the data along with the rest of the analysis. There are many definitions of quality content, many of which have no easy measure. In this question set , we expect the indicators listed to assess how much content was affected: Number of bytes added (Bytes added, positive sum in Wikimetrics), Number of bytes removed (Bytes added, negative sum in Wikimetics), Number of new articles that were created (Pages created, namespace 0 in Wikimetrics), Number of photos/media uploaded to Wikimedia Commons, and Number of Wikimedia pages improved. Later on in the survey, along with other outcomes rather than outputs, we also ask for metrics indicating “quality”. For images, these metrics include number of uniques images used, number of Wikimedia projects using images, and the number of images which are awarded “quality image,” “valued image,” or “featured picture” status. For article content, these metrics include number of articles which are awarded “featured article” or “quality article” status. leaders all Yes, that is an important clarification we can make. Importantly, opt-in procedures should be followed in order to collect usernames at in-person events for use in Wikimetrics. The use of this tool, housed on servers in the US, automatically transfers data internationally (for anyone outside of the U.S.) [1]. If usernames for a program exist publically (eg,on an event page, or online elsewhere) we suggest an opt-out procedure for Wikimetrics as well, but it is as a courtesy as the data have already been exchanged internationally and publically via the internet in such a case. Regardless, no individual usernames will appear in any level of reporting. However, we need to have username list used for reporting. This will allow us to validate the data, as well as have the ability to pull additional metrics, if needed, as we proceed with analysis and reporting. We have now added further clarification. We have changed the language from: Please upload your txt or csv file of your participant usernames. to: Please upload your txt or csv file of your participant usernames. Note: If you have collected usernames from an in-person event as the only record of participation, there are some important steps that may apply [1]. If you have any questions or concerns about confidentiality of user names please reach out to the evaluation team and we can help you determine what is appropriate. the Last round of reporting we used the standard privacy language to assure complete anonymity of direct reporters as a general privacy decision to maximize comfort and accuracy in reporting. When we published our first round of reports with such a high level of anonymity, a number of community members protested [2] and we agreed we would allow reporters to choose what level of anonymity they wanted. This round, reporters may choose (a) to remain completely anonymous, (b) share that their program implementation exists in the pool of those reported, or (c) even allow for their line of data to be identifiable in the data tables found at the end of each report [3]. In addition to clarifying that we mean Wikimetrics cohorts, we have also expanded the privacy statement to be more clear We believe this is clarified as we amended the language from: *Your privacy is important to us. We will only share your reporting data anonymously unless you indicate that you prefer us to share the your program’s name.* to: Your privacy is important to us. By answering these questions, you permit us to record your responses and agree to donate them to the public domain. We will not publicly associate your program's name with your answers or share your name or contact information, unless you permit us or disclosure is required by law. Wikimedia is a worldwide organization. By answering our questions, you consent to the transfer of your responses to the United States and other places as may be necessary to carry out the objectives of this project. Thanks for bringing these points up. We are always working to improve our tools and instructions! Should anyone have further questions or comments regarding this second round of voluntary programs data collection, please direct them either to our portal talk page [4], or if related to specific text or items, you may also comment directly on the reporting form preview [5]. On behalf of the Learning and Evaluation team, *María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation, Inc. mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_> Referenced links: [1] https://meta.wikimedia.org/wiki/Grants:Evaluation/Wikimetrics/Forms [2] https://meta.wikimedia.org/wiki/Grants_talk:Evaluation/Evaluation_reports/2… [3] https://meta.wikimedia.org/wiki/Grants:Evaluation/Evaluation_reports/2013/E… [4] https://meta.wikimedia.org/wiki/Grants_talk:Evaluation [5] https://docs.google.com/document/d/1CG-K8I1d9JPqyRRyHTIQ5x7fASQXcHZsEMKutdA… asengupta(a)wikimedia.org This we've leaders be do have work GLAM, want https://meta.wikimedia.org/wiki/Grants:Evaluation/Evaluation_reports/2013 https://docs.google.com/document/d/1CG-K8I1d9JPqyRRyHTIQ5x7fASQXcHZsEMKutdA… https://commons.wikimedia.org/wiki/File:Evaluation_Report_(beta)_Poster_Wik… _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines Wikimedia-l(a)lists.wikimedia.org <https://meta.wikimedia.org/wiki/Mailing_lists/GuidelinesWikimedia-l@lists.wikimedia.org> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>