On Tue, Aug 20, 2013 at 5:42 PM, Fabrice Florin <fflorin(a)wikimedia.org>wrote;wrote: Yay! This is awesome news. Notifications: the sleeper success of summer 2013. :) -- Steven Walling https://wikimediafoundation.org/

On 08/20/2013 11:27 PM, Oona Castro wrote: Yes, gender support seems to be present almost everywhere in the extension. I found what I believe is a documentation error, pending review (https://gerrit.wikimedia.org/r/#/c/80329/). It does use the gender of the thanker (though I can't help but wonder if there's some language that uses the recipient, or both). In general, MediaWiki handles this with a gender magic word. See https://www.mediawiki.org/wiki/GENDER#Users_have_grammatical_genders . I don't use TranslateWiki, so I don't know if they have a special interface for this, or you enter the magic word directly. Matt Flaschen

Hooray, Echo! :) Great work, everyone – it's wonderful to see this feature on more wikis. We're hoping to release Echo to Wikimedia mobile sites soon, and it'll be extremely useful to have it be available on more than just mobile enwiki. On Wed, Aug 21, 2013 at 11:35 AM, Tomasz Finc <tfinc(a)wikimedia.org> wrote: -- Maryana Pinchuk Product Manager, Wikimedia Foundation wikimediafoundation.org

Thank you all for your kind words -- and kudos to the E2 team that made it all happen! We're really happy with the results so far, and Benoît's quote below just made my day … getting our users more comfortable with innovation is one of our main goals, and it seems that we achieved it on this product, with all of your help. We're now processing some of the minor bug reports we've received so far, but do not see any show stoppers. I'm also pleased to report that more wikis like the Estonian and Korean Wikipedias are already getting ready for Notifications, according to community liaison Keegan Peterzell, so we expect to have a larger release than expected for our next deployment. Thanks again to everyone who made this possible. See more comments below. Cheers, Fabrice P.S.: If you are not already on this editor engagement mailing list, I invite you to subscribe here, so you can keep up with our work and/or respond to these messages: https://lists.wikimedia.org/mailman/listinfo/ee (I Bcc:'d our community partners, so they can hear the good news, but they can only respond if they join the list.) On Aug 21, 2013, at 2:04 PM, Benoît Evellin wrote: Merci, Benoît. We owe a lot of this success to you, as our first non-english community champion for Notifications -- and a pioneer in wiki innovation. It's always a pleasure to be working with you! Yay, mobile team! Can't wait to get my notifications on the go … in my native French language ! :) You're welcome, thanks to Dario for getting them done so quickly. It's interesting to note how much people are playing with Mentions, which represented over 25% of French activity in their first hours … Compare that to these english wiki metrics: http://ee-dashboard.wmflabs.org/dashboards/enwiki-features On Aug 20, 2013, at 8:26 PM, Steven Walling wrote: Oh shucks, Steven, you're too kind … : ) On Aug 20, 2013, at 8:27 PM, Oona Castro wrote: Oona, thanks so much for all that you and Henrique did to make this happen so quickly, you guys were awesome! For now, I would recommend that you try to come up with a gender-neutral translation for the Thanks notification, as a lot of users do not disclose their gender. We can look into adding gender-specific messaging later this year, but will still need a generic solution for 'undisclosed' users, sadly. _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

Congratulations!!! :) Sent from my mobile device. On Sep 17, 2013, at 5:33 PM, Fabrice Florin <fflorin(a)wikimedia.org> wrote: Hi guys, We just released Notifications on another batch of wiki sites today: Bosnian, Dutch, Estonian, Farsi, Hebrew, Romanian and Spanish Wikipedias, as well as English Wikivoyage and Simple Wikipedia. The Echo extension has already been well received on the French, Hungarian, Polish, Portuguese and Swedish Wikipedias, where notifications are being used actively, though in very different ways: we're seeing a lot of activity for talk messages on most sites, but welcome, mentions and thanks notification levels vary quite a bit from site to site. More on this later. Going forward, we plan to have weekly releases every Tuesday, as outlined in this Echo release plan: http://www.mediawiki.org/wiki/Echo/Release_Plan_2013 To prepare for each of these releases, we post announcements several weeks in advance, and invite community members to help translate and discuss this tool with their peers. We're finding that this approach helps build productive relationships within each community and encourages a smoother, stress-free adoption. We hope we can apply the same methodology for other major product releases in the future. I would like to take this opportunity to thank our community liaison team for their invaluable help in socializing this multi-site release: Keegan Peterzell and Jan Eissfeld have been particularly helpful, along with Philippe Beaudette, Maggie Dennis, Anna Koval, Patrick Earley and Sherry Snyder. Thanks as well to our fearless developer Benny Situ for making these deployments possible. :) Please let us know if you have any questions about this new release. Enjoy ... Fabrice, on behalf of the E2 team _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

On 09/18/2013 08:10 PM, Fabrice Florin wrote: Why can't they be created for all sites? Is it performance, or is the dashboard creation process not sufficiently automated? Matt Flaschen

On 09/18/2013 08:30 PM, Fabrice Florin wrote: Yeah, it certainly doesn't make sense to do them all manually. But I think it would be great to be able to script this. Agreed, I'm CCing Analytics on this. For feature requests like this, is it best to file an enhancement in Bugzilla, email the Analytics list, or something else? Matt Flaschen

A little bit of context on these dashboards and what part of the process is "manual". data sources The graphs primarily use data obtained by querying the EventLogging db or the private SQL slaves (there are some exceptions like the revert graphs, which involve more pre-processing). Refreshing the data typically depends on scripts run hourly or daily via cronjobs on stat1. The datasets are then rsync'ed to stat1001. The dashboards live on multiple Limn instances (typically set up on labs and controlled by different teams) which host the datasource, graph and dashboard definitions. graph customization it's no big deal to generate multiple dashboards in a scripted way (that's what we do when a new feature is deployed on a number of projects). What's tricky is the fact that different projects may have different feature sets enabled, each feature may be configured differently on a per-project basis, and in some cases different parameters (such as project-specific cutoff dates) need to be set for segmenting the data. It's obvious that this process doesn't scale well, pulling data from 800 slaves can be a pain (Oliver recently shared some really good thoughts on this) and it's hard to keep track of what data exists for each project or where it's hosted. Centralizing the generation of the datasets and the corresponding graphs will enormously simplify the process of creating and discovering dashboards and I think we should start from the low-hanging fruit of EventLogging data. EventLogging produces well-defined, project-agnostic datasets that can be written natively into different stores (including SQL, Redis, Hadoop or flat files). So here's what we could do: 1. we start producing dashboards for core metrics for all projects by ingesting EventLogging data into Hadoop. 2. next we experiment importing data from core MediaWiki tables (that by definition exist on each project) and have no problem of graph customization/fine-tuning. 3. finally, we define a registry of what features are enabled on each project and selectively import from the production DB tables that are needed to generate the data and the corresponding parameters. Does this approach make sense and is there anything that prevents us from experimenting with step 1? Dario On Sep 18, 2013, at 7:13 PM, Diederik van Liere <dvanliere(a)wikimedia.org> wrote:

There are two ways to do this, I think. 1. Use udp2log and pipe into Kafka. 2. Write a Kafka producer endpoint for EventLogging. I like #2! And I think Ori does too (we talked about this once before). It should be pretty easy to do. On Sep 19, 2013, at 7:22 AM, Diederik van Liere <dvanliere(a)wikimedia.org> wrote: > > > > On Wed, Sep 18, 2013 at 8:05 PM, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote: > A little bit of context on these dashboards and what part of the process is "manual". > > data sources > The graphs primarily use data obtained by querying the EventLogging db or the private SQL slaves (there are some exceptions like the revert graphs, which involve more pre-processing). Refreshing the data typically depends on scripts run hourly or daily via cronjobs on stat1. The datasets are then rsync'ed to stat1001. The dashboards live on multiple Limn instances (typically set up on labs and controlled by different teams) which host the datasource, graph and dashboard definitions. > > graph customization > it's no big deal to generate multiple dashboards in a scripted way (that's what we do when a new feature is deployed on a number of projects). What's tricky is the fact that different projects may have different feature sets enabled, each feature may be configured differently on a per-project basis, and in some cases different parameters (such as project-specific cutoff dates) need to be set for segmenting the data. > > It's obvious that this process doesn't scale well, pulling data from 800 slaves can be a pain (Oliver recently shared some really good thoughts on this) and it's hard to keep track of what data exists for each project or where it's hosted. Centralizing the generation of the datasets and the corresponding graphs will enormously simplify the process of creating and discovering dashboards and I think we should start from the low-hanging fruit of EventLogging data. EventLogging produces well-defined, project-agnostic datasets that can be written natively into different stores (including SQL, Redis, Hadoop or flat files). So here's what we could do: > > 1. we start producing dashboards for core metrics for all projects by ingesting EventLogging data into Hadoop. > 2. next we experiment importing data from core MediaWiki tables (that by definition exist on each project) and have no problem of graph customization/fine-tuning. > We also experimented with this; we have a tool called Sqoop to import the data from MySQL to Hadoop. We would need to define which tables we need to import but that's not hard. I wrote a small tool called sqoopy that will automatically map MySQL column types to Hive column types and now with the the labsdb's we can just import from those databases and not have to worry about PII. > 3. finally, we define a registry of what features are enabled on each project and selectively import from the production DB tables that are needed to generate the data and the corresponding parameters. > Would it make sense to read this info from the Mediaiwiki LocalSetting.php file or is that not containing all the relevant info? > > Does this approach make sense and is there anything that prevents us from experimenting with step 1? > Nothing technical prevents us as far as I am aware; it's getting it appropriately prioritized so that we can work on it fast. > > Dario > > On Sep 18, 2013, at 7:13 PM, Diederik van Liere <dvanliere(a)wikimedia.org> wrote: > >> On Wed, Sep 18, 2013 at 5:38 PM, Matthew Flaschen <mflaschen(a)wikimedia.org> wrote: >> On 09/18/2013 08:30 PM, Fabrice Florin wrote: >> It's a lack of automated tools. >> >> Right now, Dario has to create each of them manually and it's not >> practical for him to support hundreds of sites, given his workload. >> >> Yeah, it certainly doesn't make sense to do them all manually. But I think it would be great to be able to script this. >> >> Someday, when we have more resources, our analytics team may be able to >> automate this process, so we can support more sites. >> >> Agreed, I'm CCing Analytics on this. For feature requests like this, is it best to file an enhancement in Bugzilla, email the Analytics list, or something else? >> What exactly is the feature request (automate what process)? >> D >> >> Matt Flaschen >> >> >> _______________________________________________ >> Analytics mailing list >> Analytics(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/analytics >> >> _______________________________________________ >> EE mailing list >> EE(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ee > > > _______________________________________________ > Analytics mailing list > Analytics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics > > > _______________________________________________ > Analytics mailing list > Analytics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics

sounds like a good plan. I suspect we will need to import data from an uncensored source, tool labs removes much more than PII (for example, the archive table doesn't contain any PII and it's routinely used for internal data analysis). Dario

On 09/18/2013 10:13 PM, Diederik van Liere wrote: Sorry, I left out some of the context. Automating the creation of Limn dashboards like http://ee-dashboard.wmflabs.org/dashboards/eswiki-features , http://ee-dashboard.wmflabs.org/dashboards/nlwiki-features , and http://ee-dashboard.wmflabs.org/dashboards/hewiki-features . I believe they are generated from EventLogging data (on Echo usage), and the only variant is which wiki it is. Matt Flaschen

On 09/19/2013 10:04 AM, Dan Andreescu wrote: Well, some of the graphs vary by wiki. Some do not (e.g. "Daily notifications" should work the same on any wiki with Echo). But I agree Dario's plan makes sense. Matt Flaschen

Wonderful! Congratulations!! messages translated in Telugu and Kannada for the roll out end of this month. Best, Vishnu On Wednesday, 18 September 2013, Fabrice Florin <fflorin(a)wikimedia.org> wrote: today: Bosnian, Dutch, Estonian, Farsi, Hebrew, Romanian and Spanish Wikipedias, as well as English Wikivoyage and Simple Wikipedia. Hungarian, Polish, Portuguese and Swedish Wikipedias, where notifications are being used actively, though in very different ways: we're seeing a lot of activity for talk messages on most sites, but welcome, mentions and thanks notification levels vary quite a bit from site to site. More on this later. in this Echo release plan: weeks in advance, and invite community members to help translate and discuss this tool with their peers. We're finding that this approach helps build productive relationships within each community and encourages a smoother, stress-free adoption. We hope we can apply the same methodology for other major product releases in the future. for their invaluable help in socializing this multi-site release: Keegan Peterzell and Jan Eissfeld have been particularly helpful, along with Philippe Beaudette, Maggie Dennis, Anna Koval, Patrick Earley and Sherry Snyder. Thanks as well to our fearless developer Benny Situ for making these deployments possible. :) Enjoy ...

Is Wikinews going to be on that list? Or are we still the unloved ugly duckling of the sisters? ;) -- Tom Morris http://tommorris.org/

Hi Tom, Good catch! This was an oversight on our part, and we just added WikiNews to the list, as well as Wikiversity. https://www.mediawiki.org/wiki/Echo/Release_Plan_2013#Phase_5 This should be a pretty major deployment, as we're hoping to deploy in all languages on those sites, if feasible. We'll keep you posted … Fabrice On Sep 25, 2013, at 12:07 AM, Steven Walling wrote: _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

On Tue, Oct 8, 2013 at 2:53 PM, Fabrice Florin <fflorin(a)wikimedia.org>wrote;wrote: Congrats to Fabrice, Kaldari, Benny, Vibha and the rest of those who worked on notifications. It is great to see this so widely adopted. Are there any German Wikipedians on this list? I regret to see dewiki missing from the list of wikis with this feature. In fact, it looks like the only one in the top 10 not using the feature. I'd love to hear a German community member explain what the blockers really are. It seems strange that every other wiki would welcome notifications with open arms, but German Wikipedia would not... -- Steven Walling, Product Manager https://wikimediafoundation.org/

congrats, this is really exciting. +1 on asking someone to summarize why dewiki is opposing the release. On Oct 8, 2013, at 2:53 PM, Fabrice Florin <fflorin(a)wikimedia.org> wrote:

Thanks, you guys! Kudos to the entire team that created this product. It may have taken us longer than we hoped, but the results so far seem to validate our investment. We're making progress in our conversations with some of the communities that are still on the fence, and will keep you posted on those discussions. We may have more good news to share soon, if all goes well. Fingers crossed. :) Onward! Fabrice On Oct 8, 2013, at 5:33 PM, Sarah Stierch wrote: On Oct 8, 2013, at 5:11 PM, Matthew Flaschen wrote: _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

Greetings! I'm excited to share the good news that we just released Notifications on most wikis around the world today! This major release includes about 752 sites, ranging from sister projects like Commons and Wiktionary, to remaining Wikipedias in almost all languages. These wikis now have both Echo and Thanks extensions enabled, as listed here. (1) If you are active in a community where we just released Echo, we would be grateful if you could quickly test that Notifications work for you -- and let us know if you encounter any issues on this discussion page. (2) We invite you to enable all notifications in your preferences before you test, and follow guidelines from this testing page (3). We would like to thank all the community and team members who worked together to create this useful tool -- and we are really glad to be bringing it to millions more people around the world. (4) We hope that many productive collaborations will be enabled by this tool, and make our movement grow further as a result. :) Enjoy, Fabrice P.S.: We have not yet enabled Notifications on the German and Italian Wikipedias, because some of their community members thought that more discussions are needed about this feature. To support this request for more time, we are now targeting the week of November 18 for an Echo deployment on both sites. (1) https://www.mediawiki.org/wiki/Echo/Release_Plan_2013/Site_List (2) https://www.mediawiki.org/wiki/Talk:Echo/Release_Plan_2013 (3) https://www.mediawiki.org/wiki/Echo/Testing (4) https://blog.wikimedia.org/2013/10/01/notifications-launch-on-more-wikipedi… _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

this is really exciting, congrats! On Oct 22, 2013, at 12:58 PM, Matthew Flaschen <mflaschen(a)wikimedia.org> wrote:

Thank you all for your gracious support -- we couldn't have made it without the help of so many community and team members on this list. I'm delighted that this project enabled us to work collaboratively with each other -- with a productive outcome that makes us all happy. Let's aim to have many more constructive collaborations like this one! Regards as ever, Fabrice On Oct 22, 2013, at 2:01 PM, Jan Ainali wrote: _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

Hi folks, I'm happy to let you know that Beta Features and Media Viewer have now been released on Commons and MetaWiki, in addition to MediaWiki.org! Beta Features (1) is a new program from the Wikimedia Foundation that lets you try out new features before they are released for everyone. Think of it as a digital laboratory where community members can preview upcoming software and give feedback to help improve them. This special preference page lets designers and engineers experiment with new features on a broad scale, but in a way that's not disruptive. One of the first beta features we will be testing together is Media Viewer (2), which aims to improve the viewing experience by displaying images in larger size and with less clutter than the current file pages. This first version 0.1 is still in early stages of development, with many known bugs, but we invite community feedback right away for this feature, so we can improve it together in coming months. For a sneak peek at the next version 0.2 of the Media Viewer, check out these first mockups. (3) Beta Features and Media Viewer are now ready for early testing by logged-in users on Wikimedia Commons (4), on Meta.Wikimedia.org (5) and on MediaWiki.org (6). Based on test results, we aim to release these beta features on all wikis worldwide on 21 November, 2013. Here are some of the other beta features in our pipeline: • VisualEditor Formulæ — edit algebra or equations on your pages (only on MediaWiki.org) (7) • Typography Refresh — make text more readable (scheduled for first release Thursday, 14 November) (8) Would you like to try out Beta Features and Media Viewer now? After you log in, a small 'Beta' link will appear next to your 'Preferences'. Click on it to see features you can test, check the ones you want, then click 'Save'. After you've tested Beta Features, please let us know what you think on this discussion page (9) -- or report any bugs here on Bugzilla. You're also welcome to join this IRC office hours chat on Friday, 8 November at 18:30 UTC. (11) Beta Features and Media Viewer were developed by the Wikimedia Foundation's Multimedia team, in collaboration with the Design, Mobile and VisualEditor teams. Along with other developers, we will be adding new features to this experimental program every few weeks. We are very grateful to all the community and team members who made these projects possible — and look forward to many more productive collaborations in the future. :) Enjoy, and don't forget to let us know what you think! Fabrice [ 1 ] https://blog.wikimedia.org/2013/11/07/introducing-beta-features/ [ 2 ] https://www.mediawiki.org/wiki/Multimedia/About_Media_Viewer [ 3 ] https://www.mediawiki.org/wiki/Multimedia/About_Media_Viewer#Next_Version [ 4 ] https://commons.wikimedia.org/wiki/Special:Preferences#mw-prefsection-betaf… [ 5 ] https://meta.wikimedia.org/wiki/Special:Preferences#mw-prefsection-betafeat… [ 6 ] https://www.mediawiki.org/wiki/Special:Preferences#mw-prefsection-betafeatu… [ 7 ] https://www.mediawiki.org/wiki/VisualEditor/Beta_Features/Formulae [ 8 ] https://www.mediawiki.org/wiki/Typography_Update [ 9 ] https://www.mediawiki.org/wiki/Talk:About_Beta_Features [10] http://wmbug.com/new?product=MediaWiki%20extensions&component=BetaFeatu… [11] https://meta.wikimedia.org/wiki/IRC_office_hours#Upcoming_office_hours _______________________________ Fabrice Florin Product Manager, Multimedia Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF) https://www.mediawiki.org/wiki/Multimedia

Hi folks, I'm happy to report that we just released Notifications on the German and Italian Wikipedias today! This is an important milestone for all of us, because it marks the successful completion of Echo's first release, now that Notifications have been deployed on over 800 different sites worldwide. (1) This final release on German and Italian wikis was pushed back so that their communities could discuss and better prepare for this new tool. They now have both Echo and Thanks extensions enabled -- and development has started for a special FlaggedRevs notification, which will give more positive feedback for user contributions on the German Wikipedia. If you are active in either community, we invite you to check that Notifications work for you (be sure to enable all notifications in your preferences before you test). We also encourage you to participate in the discussions on these sites, if you are fluent in German or Italian. (2) (3) I would like to give special thanks to Denis Barthel, Jan Eissfeldt and Erica Litrenta for spearheading this final outreach, as well as to community members se4598, TMg and Nemo -- and to developers Benny Situ, Kunal Mehta and Bartosz Dziewoński for all your fine work in improving this tool and bringing it to your communities! Going forward, any new features or notifications will be developed by the teams and communities that need them. We are really happy to have provided this much-needed platform for supporting more productive collaborations on our sites. It's been a true pleasure working with each of you on this project. I look forward to seeing it grow over time, as I switch my focus to developing new multimedia tools (4) for our users. :) Regards as ever, Fabrice (1) https://www.mediawiki.org/wiki/Echo/Release_Plan_2013 (2) https://de.wikipedia.org/wiki/Hilfe_Diskussion:Echo (3) https://it.wikipedia.org/wiki/Discussioni_Wikipedia:Notifiche (4) http://www.mediawiki.org/wiki/Multimedia _______________________________ Fabrice Florin Product Manager Wikimedia Foundation http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

Great news! Congratulations to everyone who were behind this. Cheers from India. Vishnu On 21 November 2013 06:46, Fabrice Florin <fflorin(a)wikimedia.org> wrote:

I added echo dashboards for itwiki and dewiki here: http://ee-dashboard.wmflabs.org/dashboards/dewiki-features http://ee-dashboard.wmflabs.org/dashboards/itwiki-features Dario On Nov 21, 2013, at 2:37 AM, Nicole Ebber <nicole.ebber(a)wikimedia.de> wrote: