Hi y'all,
I'm about to start sending 4% of global traffic to mw-on-k8s
<https://phabricator.wikimedia.org/T341780>
On-call has been made aware (moritz and I), emergency rollback is:
1. Revert
https://gerrit.wikimedia.org/r/c/operations/puppet/+/954002
2. sudo cumin -b 20 'A:cp-text and P{P:trafficserver::backend}'
'run-puppet-agent -q'
To accommodate this increase, mw-api-ext and mw-web deployments have been
increased by 30%.
If you want to see what happens, you can check out the mw-on-k8s dashboard
<https://grafana.wikimedia.org/d/U7JT--knk/mw-on-k8s>
Cheers,
--
Clément Goubert (they/them)
Senior SRE
Wikimedia Foundation