2018-04-25 20:00:02,943 INFO force is enabled
2018-04-25 20:00:03,005 INFO removing misc-project-backup
2018-04-25 20:00:03,107 INFO removing misc-project-backup
2018-04-25 20:00:03,571 INFO creating misc-project-backup at 2T
2018-04-25 20:00:04,573 INFO force is enabled
2018-04-25 20:00:04,608 INFO removing misc-snap
2018-04-25 20:00:04,657 INFO removing misc-snap
2018-04-25 20:00:05,173 INFO creating misc-snap at 1T
2018-04-24 20:00:02,297 INFO force is enabled
2018-04-24 20:00:02,346 INFO removing tools-project-backup
2018-04-24 20:00:02,446 INFO removing tools-project-backup
2018-04-24 20:00:03,035 INFO creating tools-project-backup at 2T
2018-04-24 20:00:03,895 INFO force is enabled
2018-04-24 20:00:03,938 INFO removing tools-snap
2018-04-24 20:00:03,999 INFO removing tools-snap
2018-04-24 20:00:05,516 INFO creating tools-snap at 1T
Hey all,
I went to the ops meeting Wednesday last week, and today, but as you can
imagine I'm a little bit checked out and distracted with upcoming changes.
I don't have any pings for our team from last week, but this week Manuel
mentioned couple things
- the mariadb puppet module for ubuntu is being deprecated
- there are new wikis in the pipeline for which views must be created.
As for clinic, I've really not been doing much, and you all have handled
all the pages over the last week. I'd appreciate if someone can look into
the new wiki views creation as well. Thank you!
--
Madhumitha Viswanathan
Operations Engineer, Cloud Services
2018-04-18 20:00:02,259 INFO force is enabled
2018-04-18 20:00:02,319 INFO removing misc-project-backup
2018-04-18 20:00:02,435 INFO removing misc-project-backup
2018-04-18 20:00:02,899 INFO creating misc-project-backup at 2T
2018-04-18 20:00:03,718 INFO force is enabled
2018-04-18 20:00:03,744 INFO removing misc-snap
2018-04-18 20:00:03,804 INFO removing misc-snap
2018-04-18 20:00:04,244 INFO creating misc-snap at 1T
2018-04-17 20:00:02,505 INFO force is enabled
2018-04-17 20:00:02,538 INFO removing tools-project-backup
2018-04-17 20:00:02,585 INFO removing tools-project-backup
2018-04-17 20:00:03,107 INFO creating tools-project-backup at 2T
2018-04-17 20:00:03,986 INFO force is enabled
2018-04-17 20:00:04,028 INFO removing tools-snap
2018-04-17 20:00:04,089 INFO removing tools-snap
2018-04-17 20:00:05,698 INFO creating tools-snap at 1T
I opened https://phabricator.wikimedia.org/T192422 and depooled
labvirt1015 for now. I don't know that this is actually cause for
alarm, but 97 VMs seems like a lot of eggs to have in one basket.
-A
-------- Forwarded Message --------
Subject: ** PROBLEM alert - labvirt1015/ensure kvm processes are
running is CRITICAL **
Date: Wed, 18 Apr 2018 01:17:17 +0000
From: icinga(a)einsteinium.wikimedia.org
To: abogott(a)wikimedia.org
Notification Type: PROBLEM
Service: ensure kvm processes are running
Host: labvirt1015
Address: 10.64.20.31
State: CRITICAL
Date/Time: Wed Apr 18 01:17:17 UTC 2018
Notes URLs:
Additional Info:
PROCS CRITICAL: 97 processes with regex args /usr/bin/kvm
I'm around now but I'm trying to handle our 2y old so my wife can get some
sleep. Our 6y old was up all night with a stomach that couldn't hold
anything down. I will spare everyone the details but it's pretty brutal.
--
Chase Pettet
chasemp on phabricator <https://phabricator.wikimedia.org/p/chasemp/> and
IRC
2018-04-11 20:00:02,533 INFO force is enabled
2018-04-11 20:00:02,572 INFO removing misc-project-backup
2018-04-11 20:00:02,654 INFO removing misc-project-backup
2018-04-11 20:00:03,144 INFO creating misc-project-backup at 2T
2018-04-11 20:00:04,043 INFO force is enabled
2018-04-11 20:00:04,107 INFO removing misc-snap
2018-04-11 20:00:04,155 INFO removing misc-snap
2018-04-11 20:00:04,428 INFO creating misc-snap at 1T
* Bryan to ping Eliza about usage of PagerDuty by OIT to see if there
is a way we could trial it
* Rotating lead for weekly meeting: come up with a plan and do it
* Chase & Brooke to work on Puppet state of the union doc and next
steps ideas to bring back to group
* Sarah to talk with Arturo and Brooke about onboarding issues for doc
improvements
* James to give this page a section on the mainpage
<https://www.mediawiki.org/wiki/Wikimedia_Cloud_Services_team/Our_audiences>
Things we didn't have time to talk about:
* Do we need to make more distinction between site-maintaining people
and others? ++
* Planning :) How the heck are we going to do all the things? Gotta
get ruthless in casting things off we can't do. -- yes but not now bc
tired :) +
* Question I have from time to time: am I working enough, performance-wise? +
* Excellent effort at making the team feel like a team of equals
despite realities of contractor status+
Any/all of these could be topics for future team meetings. We could do
a meeting or two where we talk about topics such as these instead of
project updates and just read the update notes offline instead.
Bryan
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA
irc: bd808 v:415.839.6885 x6855
2018-04-10 20:00:03,216 INFO force is enabled
2018-04-10 20:00:03,244 INFO removing tools-project-backup
2018-04-10 20:00:03,341 INFO removing tools-project-backup
2018-04-10 20:00:03,850 INFO creating tools-project-backup at 2T
2018-04-10 20:00:04,611 INFO force is enabled
2018-04-10 20:00:04,641 INFO removing tools-snap
2018-04-10 20:00:04,689 INFO removing tools-snap
2018-04-10 20:00:05,849 INFO creating tools-snap at 1T