Hi, You can check incidents ( https://phabricator.wikimedia.org/project/profile/2143/) and as you can see, there was an incident due to hardware failure of primary database of es7 cluster which got fixed in twenty minutes ( https://phabricator.wikimedia.org/T430764)

Best

Am Mi., 1. Juli 2026 um 11:23 Uhr schrieb Martin Domdey via Wikitech-l < wikitech-l@lists.wikimedia.org>:

Hi!

While editing dewiki last night I got many internal_api_error_DBConnectionErrors 200 last night.

With this I send you the headers.

What was or is the problem?

Solution maybe: Isn't it possible, to catch such errors on your side and repeat the api action?

Thanks, Martin aka Doc Taxon

headers(age) = 12 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:26:34 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-j589w headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = 224a2e3b-1c58-449f-998b-69eadd20f3c5

headers(age) = 8 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:26:44 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-g64jn headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = a166a3d0-5bf1-4254-aa04-ef0df74be70e

headers(age) = 6 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 199 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:26:54 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-256kl headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = 309edfc8-bdf1-431f-804a-8830208cbe32

headers(age) = 6 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:29:14 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-mqqdw headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = e2bd9fbb-995b-4c57-9281-8a91b7dd8202

headers(age) = 0 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:30:31 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-cxl2x headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = 0bfa35a3-e17f-42e1-8acc-67197f0ed381

headers(age) = 0 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:31:31 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-w98b9 headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = 96cb2aa8-e00f-4895-bcb1-37d93d0d7333

headers(age) = 0 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:32:22 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-qk4s7 headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = 25f90b29-cae6-4436-a696-9314f8e467b8

headers(age) = 0 headers(cache-control) = private, must-revalidate, max-age=0 headers(content-disposition) = inline; filename=api-result.json headers(content-encoding) = gzip headers(content-length) = 200 headers(content-security-policy) = default-src 'self'; script-src 'none'; object-src 'none' headers(content-type) = application/json; charset=utf-8 headers(date) = Wed, 01 Jul 2026 00:35:04 GMT headers(http) = HTTP/2 200 headers(mediawiki-api-error) = internal_api_error_DBConnectionError headers(nel) = { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.0 5, "success_fraction": 0.0} headers(report-to) = { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "htt ps:// intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report ingapi/network_error/1.0.0" }] } headers(server) = mw-api-ext.eqiad.main-694cc968b-zp7bk headers(server-timing) = cache;desc="pass", host;desc="cp1100" headers(strict-transport-security) = max-age=106384710; includeSubDomains; preload headers(vary) = Accept-Encoding,User-Agent headers(x-cache) = cp1100 pass, cp1100 pass headers(x-cache-status) = pass headers(x-client-ip) = 2a02:ec80:a000:1::2ff headers(x-content-type-options) = nosniff headers(x-frame-options) = DENY headers(x-request-id) = d7e8eb8c-04c8-486a-a84a-32acd653e581 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/