- Cloud-admin - lists.wikimedia.org

wikireplicas reaching maximum utilization
by Jaime Crespo 10 May '18

10 May '18

https://grafana.wikimedia.org/dashboard/file/server-board.json?refresh=1m&p… What to do? -- Jaime Crespo <http://wikimedia.org>

2 2

Cron <root@labstore2004> /usr/local/sbin/block_sync 10.64.37.20 misc misc-project misc-snap backup misc-project misc-project-backup 2T
by root＠labstore2004.codfw.wmnet 10 May '18

10 May '18

2018-05-09 20:00:02,600 INFO force is enabled 2018-05-09 20:00:02,657 INFO removing misc-project-backup 2018-05-09 20:00:02,773 INFO removing misc-project-backup 2018-05-09 20:00:03,631 INFO creating misc-project-backup at 2T 2018-05-09 20:00:04,574 INFO force is enabled 2018-05-09 20:00:04,634 INFO removing misc-snap 2018-05-09 20:00:04,697 INFO removing misc-snap 2018-05-09 20:00:04,988 INFO creating misc-snap at 1T

1 0

Cron <root@labstore2003> /usr/local/sbin/block_sync 10.64.37.20 tools tools-project tools-snap backup tools-project tools-project-backup 2T
by root＠labstore2003.codfw.wmnet 09 May '18

09 May '18

2018-05-08 20:00:02,286 INFO force is enabled 2018-05-08 20:00:02,333 INFO removing tools-project-backup 2018-05-08 20:00:02,434 INFO removing tools-project-backup 2018-05-08 20:00:03,006 INFO creating tools-project-backup at 2T 2018-05-08 20:00:03,854 INFO force is enabled 2018-05-08 20:00:03,894 INFO removing tools-snap 2018-05-08 20:00:03,962 INFO removing tools-snap 2018-05-08 20:00:05,690 INFO creating tools-snap at 1T

1 0

Cron <root@labstore2004> /usr/local/sbin/block_sync 10.64.37.20 misc misc-project misc-snap backup misc-project misc-project-backup 2T
by root＠labstore2004.codfw.wmnet 03 May '18

03 May '18

2018-05-02 20:00:02,952 INFO force is enabled 2018-05-02 20:00:02,982 INFO removing misc-project-backup 2018-05-02 20:00:03,038 INFO removing misc-project-backup 2018-05-02 20:00:03,713 INFO creating misc-project-backup at 2T 2018-05-02 20:00:04,642 INFO force is enabled 2018-05-02 20:00:04,683 INFO removing misc-snap 2018-05-02 20:00:04,743 INFO removing misc-snap 2018-05-02 20:00:05,250 INFO creating misc-snap at 1T

1 0

Introduction to OpenStack at WMCS: Thursday 2018-05-10, 15:00 UTC
by Andrew Bogott 03 May '18

03 May '18

Hello! Next Thursday I'm going to make a short presentation to the new WMCS Ops about our use of OpenStack. It'll be fairly short, mostly serving as a glossary of terms and outline of which service does what. Any of you are welcome! I'll paste a hangout link below, but if you're definitely interested let me know and I'll add you to the calendar invitation. For those of you who want the glossary but don't want to stay up and/or wake up for an actual presentation I'm also attaching a draft of the slides. -Andrew Hangout link: https://hangouts.google.com/hangouts/_/wikimedia.org/introduction-to?hceid=…

1 0

Cron <root@labstore2003> /usr/local/sbin/block_sync 10.64.37.20 tools tools-project tools-snap backup tools-project tools-project-backup 2T
by root＠labstore2003.codfw.wmnet 02 May '18

02 May '18

2018-05-01 20:00:02,523 INFO force is enabled 2018-05-01 20:00:02,563 INFO removing tools-project-backup 2018-05-01 20:00:02,616 INFO removing tools-project-backup 2018-05-01 20:00:03,167 INFO creating tools-project-backup at 2T 2018-05-01 20:00:03,968 INFO force is enabled 2018-05-01 20:00:04,020 INFO removing tools-snap 2018-05-01 20:00:04,064 INFO removing tools-snap 2018-05-01 20:00:05,672 INFO creating tools-snap at 1T

1 0

clinic-duty week summary
by Arturo Borrero Gonzalez 02 May '18

02 May '18

Hey! I just finished my clinic duty week, and here is a summary. From the SRE meeting: * DBAs slow-paced week due to bank holidays and some vacations * Andrew tech talk: ** is that for a private group? ** is there an announcement ** more info? * Pages at weird Europe hours need discussion. * SRE team not sending anybody to Capetown South Africa. * Nothing concrete yet for the SRE summit? Some things I did: * checked grafana boards for alerts. Nothing special. * toolforge access requests: 2 declined, 6 accepted, 5 feedback-needed * reviewed some opened phabricator tasks for the team * Toolforge, version of jq varying https://phabricator.wikimedia.org/T192834 * Unable to install mysql2 using Ruby docker image on Kubernetes https://phabricator.wikimedia.org/T192566 * resolved a couple of simple questions from users on IRC

1 0

Cron <root@labstore2004> /usr/local/sbin/block_sync 10.64.37.20 misc misc-project misc-snap backup misc-project misc-project-backup 2T
by root＠labstore2004.codfw.wmnet 26 Apr '18

26 Apr '18

2018-04-25 20:00:02,943 INFO force is enabled 2018-04-25 20:00:03,005 INFO removing misc-project-backup 2018-04-25 20:00:03,107 INFO removing misc-project-backup 2018-04-25 20:00:03,571 INFO creating misc-project-backup at 2T 2018-04-25 20:00:04,573 INFO force is enabled 2018-04-25 20:00:04,608 INFO removing misc-snap 2018-04-25 20:00:04,657 INFO removing misc-snap 2018-04-25 20:00:05,173 INFO creating misc-snap at 1T

1 0

Cron <root@labstore2003> /usr/local/sbin/block_sync 10.64.37.20 tools tools-project tools-snap backup tools-project tools-project-backup 2T
by root＠labstore2003.codfw.wmnet 25 Apr '18

25 Apr '18

2018-04-24 20:00:02,297 INFO force is enabled 2018-04-24 20:00:02,346 INFO removing tools-project-backup 2018-04-24 20:00:02,446 INFO removing tools-project-backup 2018-04-24 20:00:03,035 INFO creating tools-project-backup at 2T 2018-04-24 20:00:03,895 INFO force is enabled 2018-04-24 20:00:03,938 INFO removing tools-snap 2018-04-24 20:00:03,999 INFO removing tools-snap 2018-04-24 20:00:05,516 INFO creating tools-snap at 1T

1 0

Ops meeting updates
by Madhumitha Viswanathan 24 Apr '18

24 Apr '18

Hey all, I went to the ops meeting Wednesday last week, and today, but as you can imagine I'm a little bit checked out and distracted with upcoming changes. I don't have any pings for our team from last week, but this week Manuel mentioned couple things - the mariadb puppet module for ubuntu is being deprecated - there are new wikis in the pipeline for which views must be created. As for clinic, I've really not been doing much, and you all have handled all the pages over the last week. I'd appreciate if someone can look into the new wiki views creation as well. Thank you! -- Madhumitha Viswanathan Operations Engineer, Cloud Services

1 0

2024

2023

2022

2021

2020

2019

2018

2017

Cloud-admin