I think we could start monitoring prometheus-node-exporter on all Cloud
VPS VMs on all projects via the Prometheus instance in metricsinfra. The
required firewall rules are now in place (thanks to Andrew in T288108),
and I've written the required patches to
cloud/metricsinfra/prometheus-manager and to the Puppet repo:
https://gerrit.wikimedia.org/r/c/cloud/metricsinfra/prometheus-manager/+/85…
https://gerrit.wikimedia.org/r/c/operations/puppet/+/856917/
The main effect this will have is that we (and project admins, of
course) will have basic metrics (think CPU, disk, RAM, so on) for all
instances in all projects. Currently these wouldn't send any alerts
unless manually configured by a metricsinfra admin.
Please let me know if you have any questions or concerns, otherwise I'd
like to move forward in the next few days.
Taavi