Cloud-admin-feed September 2024

cloud-admin-feed@lists.wikimedia.org

5 participants
443 discussions

[FIRING:1] ToolforgeKubernetesWorkerTooManyDProcesses tools (node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

[FIRING:2] ToolforgeKubernetesWorkerTooManyDProcesses tools (node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

** PROBLEM alert - cloudvirt1063/ensure kvm processes are running is CRITICAL **
by nagios＠alert1002.wikimedia.org 23 Sep '24

23 Sep '24

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: CRITICAL Date/Time: Mon Sept 23 22:08:25 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

** RECOVERY alert - cloudvirt1063/ensure kvm processes are running is OK **
by nagios＠alert1002.wikimedia.org 23 Sep '24

23 Sep '24

Notification Type: RECOVERY Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: OK Date/Time: Mon Sept 23 22:06:25 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args qemu-system-x86_64

1 0

** PROBLEM alert - cloudvirt1063/ensure kvm processes are running is CRITICAL **
by nagios＠alert1002.wikimedia.org 23 Sep '24

23 Sep '24

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: CRITICAL Date/Time: Mon Sept 23 09:49:04 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

RECOVERY Host cloudvirt1063 - PING OK - Packet loss = 0%, RTA = 0.36 ms
by nagios＠alert1002.wikimedia.org 23 Sep '24

23 Sep '24

Notification Type: RECOVERY Host: cloudvirt1063 State: UP Address: 10.64.148.23 Info: PING OK - Packet loss = 0%, RTA = 0.36 ms Date/Time: Mon Sept 23 09:48:32 UTC 2024 Acknowledged by :

1 0

[FIRING:1] ToolforgeKubernetesWorkerTooManyDProcesses tools (tools-k8s-worker-nfs-7 node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 23 Sep '24

23 Sep '24

1 0

targets-cloud-infrastructure.txt
by diffscan2 22 Sep '24

22 Sep '24

New Open Service List --------------------- STATUS HOST PORT PROTO OPREV CPREV DNS New Closed Service List --------------------- STATUS HOST PORT PROTO OPREV CPREV DNS CLOSEDDOWN 172.20.3.21 16514 tcp 6 0 cloudvirt1063.private.eqiad.wikimedia.cloud OPREV: number of times service was open in last 7 CPREV number of times service was closed in last 7: current total services: 355 previous total services: 356 up trend: 130,131,129,131,129,131,131 down trend: 2074,2073,2074,2073,2074,2073,2073

1 0

[RESOLVED] ToolforgeKubernetesNodeNotReady tools (Ready k8s.tools.eqiad1.wikimedia.cloud:6443 k8s-kube-state-metrics tools-k8s-worker-nfs-66 metrics kube-state-metrics Helm kube-state-metrics kube-state-metrics 2.10.1 kube-state-metrics-5.16.4 77cd8fc859 kube-state-metrics-77cd8fc859-655xr warning prometheus true wmcs)
by root＠wmflabs.org 21 Sep '24

21 Sep '24

1 0

[RESOLVED] InstanceDown tools (tools-k8s-worker-nfs-66 node warning wmcs)
by root＠wmflabs.org 21 Sep '24

21 Sep '24

1 0

← Newer
1
2
3
4
5
6
7
8
...
45
Older →

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed September 2024