September 2024 - Cloud-admin-feed

[FIRING:1] PuppetAgentFailure tools (tools-prometheus-7 node warning wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

targets-cloud-infrastructure.txt
by diffscan2 24 Sep '24

24 Sep '24

New Open Service List --------------------- STATUS HOST PORT PROTO OPREV CPREV DNS OPEN 172.20.3.21 16514 tcp 4 2 cloudvirt1063.private.eqiad.wikimedia.cloud OPEN 185.15.57.2 25 tcp 0 6 bastion.bastioninfra-codfw1dev.codfw1dev.wmcloud.org OPEN 185.15.57.2 9100 tcp 0 6 bastion.bastioninfra-codfw1dev.codfw1dev.wmcloud.org OPEN 185.15.57.2 9105 tcp 0 6 bastion.bastioninfra-codfw1dev.codfw1dev.wmcloud.org OPEN 185.15.57.4 22 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.4 25 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.4 873 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.4 8140 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.4 9100 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.4 9105 tcp 0 6 instance-cloudinfra-cloudvps-puppetserver-1.cloudinfra-codfw1dev.codfw1dev.… OPEN 185.15.57.5 443 tcp 0 6 puppet-enc.cloudinfra-codfw1dev.codfw1dev.wmcloud.org New Closed Service List --------------------- STATUS HOST PORT PROTO OPREV CPREV DNS OPREV: number of times service was open in last 7 CPREV number of times service was closed in last 7: current total services: 366 previous total services: 355 up trend: 127,126,130,131,129,131,129 down trend: 2074,2076,2074,2073,2074,2073,2074

1 0

** PROBLEM alert - cloudvirt1063/ensure kvm processes are running is CRITICAL **
by nagios＠alert1002.wikimedia.org 24 Sep '24

24 Sep '24

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: CRITICAL Date/Time: Tue Sept 24 01:33:38 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

RECOVERY Host cloudvirt1063 - PING OK - Packet loss = 0%, RTA = 0.40 ms
by nagios＠alert1002.wikimedia.org 24 Sep '24

24 Sep '24

Notification Type: RECOVERY Host: cloudvirt1063 State: UP Address: 10.64.148.23 Info: PING OK - Packet loss = 0%, RTA = 0.40 ms Date/Time: Tue Sept 24 01:33:34 UTC 2024 Acknowledged by :

1 0

PROBLEM Host cloudvirt1063 - PING CRITICAL - Packet loss = 100%
by nagios＠alert1002.wikimedia.org 24 Sep '24

24 Sep '24

Notification Type: PROBLEM Host: cloudvirt1063 State: DOWN Address: 10.64.148.23 Info: PING CRITICAL - Packet loss = 100% Date/Time: Tue Sept 24 01:27:10 UTC 2024 Acknowledged by :

1 0

** PROBLEM alert - cloudvirt1063/ensure kvm processes are running is CRITICAL **
by nagios＠alert1002.wikimedia.org 24 Sep '24

24 Sep '24

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: CRITICAL Date/Time: Tue Sept 24 00:32:36 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

[RESOLVED] ToolforgeKubernetesWorkerTooManyDProcesses tools (tools-k8s-worker-nfs-7 node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

** RECOVERY alert - cloudvirt1063/ensure kvm processes are running is OK **
by nagios＠alert1002.wikimedia.org 24 Sep '24

24 Sep '24

Notification Type: RECOVERY Service: ensure kvm processes are running Host: cloudvirt1063 Address: 10.64.148.23 State: OK Date/Time: Tue Sept 24 00:14:36 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args qemu-system-x86_64

1 0

[FIRING:1] ToolforgeKubernetesWorkerTooManyDProcesses tools (node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

[FIRING:2] ToolforgeKubernetesWorkerTooManyDProcesses tools (node-exporter warning prometheus D wmcs)
by root＠wmflabs.org 24 Sep '24

24 Sep '24

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed September 2024