Hi all,
There was no ops meeting this week, here are the things I looked at during
clinic duty last week:
* Debugging and fixing PAWS
** https://phabricator.wikimedia.org/T183142#3862801
** Pending: Removing the blacklist for overlayfs for paws cluster.
* Wiki-replica analytics high replag reports on mailing list
** Created https://phabricator.wikimedia.org/T183983 following the
discussion in today's meeting.
** Need to follow up with DBAs
* Followed up on tools and misc high NFS storage utilization (
https://phabricator.wikimedia.org/T183920) and made subtasks for the
relevant project admins.
* There were couple reports of the bastion being slow, but both times got
resolved by folks other than me before I even got to look at the pings
* Resolved a bunch of toolforge membership requests
* Extended icinga downtime for labtestcontrol2003
* Found puppet staleness in labstore1004 & 5 - Chase has already looked at
this and resolved.
* I responded to production pages for pdfrender late night on Christmas Eve
and restarted services on scb1001-4 to resolve since I was the only one
around.
* The cloud list was active this week!
** People helping yay!
*** https://lists.wikimedia.org/pipermail/cloud/2017-December/000137.html
*** https://lists.wikimedia.org/pipermail/cloud/2017-December/000149.html
** Bryan is awesome at responding to user questions -
https://lists.wikimedia.org/pipermail/cloud/2017-December/000136.html
** Concerning long thread on user tables
https://lists.wikimedia.org/pipermail/cloud/2017-December/000112.html
That's all I think!
Best,
--
Madhumitha Viswanathan
Operations Engineer, Cloud Services
I was shuffling a meeting for next week around today and noticed that
only Arturo and I have working hours set in our Google Calendar
profiles. I think it would be useful for everyone to configure their
calendar to show their comfortable working hours to make it easier for
me and others to set meetings without doing a lot of mental math about
if it is too early or too late for someone to join. You do this by
clicking the "cog" icon in the gcal UI, selecting 'Settings' and then
'General > Scheduling' in the left hand navigation menu.
Bryan
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA
irc: bd808 v:415.839.6885 x6855