Tues: * Showed Arturo how to create a new Cloud VPS project * PHP OAuth library tech support on irc with DatGuy * Killed a bunch of pywikibot processes running on bastion-03 * Quota bump for wikidataconcepts https://phabricator.wikimedia.org/T179307 * Created tools elasticsearch credentials https://phabricator.wikimedia.org/T179256 * Updated docs on Floating IPs https://phabricator.wikimedia.org/T136872
Wed: * labsdb1001 died overnight https://phabricator.wikimedia.org/T179464 ** Madhu helped Manuel move traffic off of it ** replag and tool-db-usage busted because of no error handling ** Sent email to cloud-announce about the failure * Killed some pywikibot processes on tools-login
Thurs: * Killed more pywikibot on tools-login ** https://wikitech.wikimedia.org/w/index.php?title=User_talk:Jaumeortola&d... * labsdb1001 is back up, sent an email * missing perms for a db on the analytics.db cluster https://phabricator.wikimedia.org/T179153 ** madhu fixed it * Cleaned out the stale applications in https://toolsadmin.wikimedia.org/tools/membership/
Fri: * Poked the reading-demo project request ticket * started a stress test on labvirt1015 https://phabricator.wikimedia.org/T171473 * made updated patch for page_props.pp_value index https://phabricator.wikimedia.org/T140609 * merged zhuyifei's patch for oge-crontab utf-8 support and deployed new misctools package https://phabricator.wikimedia.org/T156174 * looked into clush connection failures on tools-docker-builder-05 https://phabricator.wikimedia.org/T179388
Sun: * Disk space on tools-webgrid-lighttpd-1428; /tmp was full of junk
Mon: * Techops meeting (see prior notes) * Fixed elasticsearch credentials file for tools.strephit * Made hhvm-staging.hhvm.eqiad.wmflabs less angry https://phabricator.wikimedia.org/T179380 * Looked into heavy cpu load issues https://phabricator.wikimedia.org/T179378 * Removed o+w bit from Toolforge /home/stuem007 and emailed user an explanation * Removed non-directory files in Toolforge /home (cbench.test, foo, test, hi -> /bin/sh, and wat.bash) * Responded to latest comments on reading-demos project request https://phabricator.wikimedia.org/T177616
Bryan