How’d we do in our strive for operational excellence last month? Read on to find out!

Or read on Phabricator at https://phabricator.wikimedia.org/phame/post/view/218/

📈 Incidents

Zero documented incidents in November. [1] That's the only month this year without any (publicly documented) incidents. In 2019, November was also the only such month. [3]

Learn about recent incidents at Incident documentation https://wikitech.wikimedia.org/wiki/Incident_documentation on Wikitech, or Preventive measures https://phabricator.wikimedia.org/project/view/4758/ in Phabricator.

-------

📊 Trends

Figure 1, Figure 2: Unresolved error reports stacked by month. https://phabricator.wikimedia.org/phame/post/view/218/production_excellence_26_november_2020/#trends

The overall increase in errors was relatively low this past month, similar to the November-December period last year.

What's new is that we can start to see a positive trend emerging in the backlogs where we've shrunk issue count three months in a row, from the 233 high in October, down to the 181 we have in the ol' backlog today.

Month-over-month plots based on spreadsheet data https://docs.google.com/spreadsheets/d/1tRCh8aB0UYyLlhftvcHvhWH4-e7cF5V01XvRObTVgUI/edit?usp=sharing. [5]

-------

📖 Outstanding errors

Take a look at the workboard and look for tasks that could use your help. → https://phabricator.wikimedia.org/tag/wikimedia-production-error/

Summary over recent months:

- ⚠️ July 2019 (2 of 18 tasks): One task closed (-1). - ⚠️ August 2019 (1 of 14 tasks): *no change*. - ⚠️ September 2019 (3 of 12 tasks): *no change*. - ⚠️ October 2019 (5 of 12 tasks): *no change*. - ⚠️ November 2019 (1 of 5 tasks): *no change*. - ⚠️ December 2019 (3 of 9 tasks left), *no change*. - January 2020 (3 of 7 tasks left), One task closed (-1). - February (2 of 7 tasks left), *no change*. - March (2 of 2 tasks left), *no change*. - April (9 of 14 tasks left): *no change*. - May (7 of 14 tasks left): *no change*. - June (7 of 14 tasks left): *no change*. - July 2020 (9 of 24 new tasks https://phabricator.wikimedia.org/maniphest/query/s__D8Kd0xuQH/#R): *no change*. - August 2020 (23 of 53 new tasks https://phabricator.wikimedia.org/maniphest/query/hu1yhWu4sXkP/#R): Three tasks closed (-3). - September 2020 (14 of 33 new tasks https://phabricator.wikimedia.org/maniphest/query/CGFQViLShnOY/#R): One task closed (-1). - October 2020 (39 of 69 new tasks https://phabricator.wikimedia.org/maniphest/query/MYnnBybPTYpd/#R): Six tasks closed (-6). - *November 2020*: 19 of 38 new tasks https://phabricator.wikimedia.org/maniphest/query/CkC_VqQq5VC0/#R survived the month and remain open today (+38; -19)

Recent tally 142 as of Excellence #25 https://phabricator.wikimedia.org/phame/post/view/213/production_excellence_25_october_2020/ (23 Oct 2020). -12 closed of the 142 recent tasks. +19 survived November 2020. 149 as of today, 15 Dec 2020.

The on-going month of December, has 19 unresolved tasks https://phabricator.wikimedia.org/maniphest/query/10NQy74iKaZJ/#R so far.

-------

🎉 Thanks!

Thank you to everyone else who helped by reporting, investigating, or resolving problems in Wikimedia production. Thanks!

Until next time,

– Timo Tijhof

-------

Footnotes:

[1] Incident documentation 2020, Wikitech https://wikitech.wikimedia.org/wiki/Incident_documentation#2020. [2] Open tasks, Wikimedia-prod-error, Phabricator https://phabricator.wikimedia.org/maniphest/query/Fw3RdXt1Sdxp/#R. [3] Wikimedia incident stats, Krinkle, CodePen https://codepen.io/Krinkle/full/wbYMZK. [4] Month-over-month, Production Excellence (spreadsheet) https://docs.google.com/spreadsheets/d/1tRCh8aB0UYyLlhftvcHvhWH4-e7cF5V01XvRObTVgUI/edit .