Thank you very much for sharing this data, Tyler (and to the team that researched and analysed it, as well). I think it shows that the train has been pretty successful in mitigating the issues it was intended to improve.
I note the data points that show there has been a significant and clear trend toward fewer comments per patch. This would be worth investigating further. Iis the total number of reviews pretty consistent, or is it increasing or decreasing? Is it possible that developers have become more proficient at writing patches to standard, and thus fewer comments are required? Or could it be that, because more time is invested in writing patches (assuming that more patches = more time writing them), there is less time for review?
I've always found the train to be very interesting, and in fact mentioned it when being interviewed for a recently published article (in a positive way). I'm pleased and perhaps a bit relieved to see that the research has borne out my impression of how it has made such a big difference in the deployment process.
Risker/Anne
On Wed, 16 Feb 2022 at 06:01, Tyler Cipriani tcipriani@wikimedia.org wrote:
*tl;dr:* We have open data on Wikimedia production deployments. Read Diving into Deployment Data https://phabricator.wikimedia.org/phame/post/view/272/diving_into_our_deployment_data/ to learn more (or read on, I guess). _____
If you’ve ever experienced the pride of seeing your name on MediaWiki's contributor list, you've been involved in our deployment process.
This realization inspires questions – *we have *📈 *data to answer those questions!*
- We wrote a blog (Research folks did the hard parts): ⚙️Phabricator:
Diving Into Our Deployment Data https://phabricator.wikimedia.org/phame/post/view/272/diving_into_our_deployment_data/
- The data is open: 🦊 GitLab train-stats
https://gitlab.wikimedia.org/thcipriani/train-stats
- Play with the live data (if you'd rather dive into SQL): 💾
data.releng.team https://data.releng.team/train
Thanks!
Tyler Cipriani (he/him/his) Engineering Manager, Release Engineering Wikimedia Foundation _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/