Hello all!

We are currently experiencing issues with the codfw WDQS cluster, with a sharp drop in successful queries [1]. We suspect that the cluster is overloaded by some expensive queries, but we are still tracking them down. This should affect only traffic routed to the codfw cluster [2].

We will post an update as soon as we know more.

Good luck!

  Guillaume


[1] https://grafana.wikimedia.org/d/l-3CMlN4z/wdqs-uptime-slo?orgId=1&var-Datacenter=codfw&var-SLO_Threshold=.95&var-Period_Days=90d&from=now-6h&to=now
[2] https://wikitech.wikimedia.org/wiki/Global_traffic_routing

--
Guillaume Lederrey (he/him)
Engineering Manager
Wikimedia Foundation