- Cloud - lists.wikimedia.org

CloudVPS reboots for security updates
by Arturo Borrero Gonzalez 29 Jul '19

29 Jul '19

Hi there! Unrelated to other operations that were communicated recently (datacenter PDU upgrades, operating system upgrades, etc) we need to reboot all the cloudvirt servers to introduce some security updates for CPU vulnerabilities. Along with the physical hardware reboot we also need to reboot all the virtual machines running in CloudVPS. This operation is a bit disruptive but very quick and should not lead to any unexpected errors (is just a reboot). We already tried the same upgrades in some other servers. We will be doing the reboots during this week (starting 2019-07-29). If you see any problems related to this, please contact us. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

1 0

Need help with code review on Action API code snippets for on-wiki documentation
by Jay prakash 27 Jul '19

27 Jul '19

Hello everyone, I am Jay Prakash. As part of my Google Summer of Code project <https://phabricator.wikimedia.org/T219193>, I have developed code snippets in PHP, Python and MediaWiki Javascript to demonstrate the use of MediaWiki Action API modules. I am looking for help with code review, especially on the code samples format and accuracy. Please give your suggestions and feedback in a comment on this Phabricator task T228549[1]. All these code samples will be shown in a tabbed window in all the API module pages on MediaWiki.org like in https://test.wikipedia.org/wiki/API:Sandbox via a Gadget that is a work in progress. Thank you :) User:Jayprakash12345 (GSoC 2019 intern) <https://www.mediawiki.org/wiki/User:Jayprakash12345> [1] https://phabricator.wikimedia.org/T228549

1 0

[Cloud-announce] 20190726 - afl_log_id field to be removed from wiki replica views
by Brooke Storm 26 Jul '19

26 Jul '19

In the abuse_filter_log table, the afl_log_id field appears to never have been used and is being dropped upstream. To prepare for that and keep the replica view up and running, we are going to start removing the field from the abuse_filter_log views on the wiki replicas service, starting on Monday, July 26th. This should have little to no impact on anyone since the field seems to always be NULL everywhere and to never have been fully implemented, and it would only cause impact to an application if it was specifically queried. For more information on the dropping of the column: https://phabricator.wikimedia.org/T226851 <https://phabricator.wikimedia.org/T226851> Some of the reasons why and a bit more context: https://phabricator.wikimedia.org/T214592 <https://phabricator.wikimedia.org/T214592> Brooke Storm Operations Engineer Wikimedia Cloud Services bstorm(a)wikimedia.org <mailto:bstorm@wikimedia.org> IRC: bstorm_ _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

Re: [Cloud] [Wikitech-l] Coolest Tool Award 2019: Call for Nominations
by Srishti Sethi 26 Jul '19

26 Jul '19

Hello everyone, Sending a reminder that only a few days are left to recommend tools for the Coolest Tool Award 2019: https://meta.wikimedia.org/wiki/Coolest_Tool_Award. Nominate your favorite tools by July 29 :-) Cheers, Srishti *Srishti Sethi* Developer Advocate Wikimedia Foundation <https://wikimediafoundation.org/> On Tue, Jul 16, 2019 at 3:43 PM Bryan Davis <bd808(a)wikimedia.org> wrote: > On Tue, Jul 16, 2019 at 4:32 PM Brian Wolff <bawolff(a)gmail.com> wrote: > > > > To clarify, does this mean tool in the sense of "tool"server? (Aka > coolest > > thing hosted using cloud services) or is it more general including > gadgets, > > standalone apps or any other piece of technology in the wikimedia > ecosystem > > that's "cool"? > > Any Wikimedia related software is eligible. Gadgets, Lua modules, user > scripts, bots no matter where they normally run, web tools no matter > where they are hosted, desktop tools, mobile apps, ... > > We have a huge ecosystem of things that people build and use to make > working on the Wikimedia projects easier and the Coolest Tool Academy > wants to hear about all of them. You could honestly even nominate your > favorite GNU Linux distribution if you can explain how it makes life > as a Wikimedian better. > > Bryan > -- > Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> > [[m:User:BDavis_(WMF)]] Manager, Technical Engagement Boise, ID USA > irc: bd808 v:415.839.6885 x6855 > > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

PDU upgrades in the eqiad datacenter affects CloudVPS hypervisor
by Arturo Borrero Gonzalez 25 Jul '19

25 Jul '19

Hi there! There is an ongoing maintenance in the eqiad datacenter that involves changing power connectors of the servers. More info in this phabricator task: T226778 [0]. The PDU upgrade could potentially leave our hypervisors without power briefly. For some hypervisors, we plan to take the risks of leaving them running. For some other hypervisors (those running important DBs in the form of virtual machines) we will probably do a controlled shutdown before the operations to ensure no data corruption happen in the databases. The PDU upgrades will happen this very week (see phab task [0]) and it could potentially affect every virtual machine we run in CloudVPS. This includes Toolforge. In the case of power loss, we expect the disruptions to be very briefly and to don't cause extended downtime in any case. Please, let us know any issue you may find related to this operation. regards. [0] https://phabricator.wikimedia.org/T226778 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

1 1

[Cloud-announce] NFS Maintenance 2019-07-25 1500 UTC
by Jason Hedden 25 Jul '19

25 Jul '19

On Thursday, July 25th, 2019 between the hours of 1500 and 1700 UTC we will be performing system maintenance on the NFS servers that support Toolforge and the CloudVPS instances that are using NFS for home, project or scratch data. During this maintenance window, we will be applying rolling updates that require NFS service restarts. We are taking precautions to minimize impact, but there may be short periods of NFS service interruption or performance degradation. --- Jason Hedden Site Reliability Engineer - Wikimedia Cloud Services Wikimedia Foundation _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 2

[Cloud-announce] Instance downtime on August 22nd and 23rd
by Andrew Bogott 22 Jul '19

22 Jul '19

As part of routine networking and OS upgrades, I'll be emptying two hypervisors (cloudvirt1016 and cloudvirt1017) on Monday and Tuesday, the 22nd and 23rd. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows. I'll begin by moving the deployment-prep project at around 13:00 UTC on Monday. After that copies will proceed in roughly the order you see below, but the timing will be hard to predict. Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time! -Andrew + the WMCS team Affected instances (shown as <project>: <instance name>): account-creation-assistance: accounts-appserver4 account-creation-assistance: accounts-mwoauth automation-framework: af-puppetdb02 butterfly: butterfly-m4m2 cloudinfra: cloudinfra-db02 codereview: Krypton codereview: Radon commtech: commtech-2 community-labs-monitoring: clm-web-01 community-labs-monitoring: clm-worker-01 dashiki: dashiki-01 dashiki: dashiki-staging-01 deployment-prep: deployment-cache-text05 deployment-prep: deployment-changeprop deployment-prep: deployment-chromium01 deployment-prep: deployment-chromium02 deployment-prep: deployment-cpjobqueue deployment-prep: deployment-dumps-puppetmaster02 deployment-prep: deployment-elastic06 deployment-prep: deployment-elastic07 deployment-prep: deployment-etcd-01 deployment-prep: deployment-eventlog05 deployment-prep: deployment-imagescaler01 deployment-prep: deployment-imagescaler02 deployment-prep: deployment-ircd deployment-prep: deployment-jobrunner03 deployment-prep: deployment-kafka-jumbo-1 deployment-prep: deployment-logstash2 deployment-prep: deployment-mediawiki-07 deployment-prep: deployment-memc06 deployment-prep: deployment-memc07 deployment-prep: deployment-mwmaint01 deployment-prep: deployment-ores01 deployment-prep: deployment-puppetdb02 deployment-prep: deployment-puppetmaster03 deployment-prep: deployment-restbase01 deployment-prep: deployment-restbase02 deployment-prep: deployment-sentry01 deployment-prep: deployment-snapshot01 deployment-prep: deployment-urldownloader02 deployment-prep: deployment-zookeeper02 design: design-research-methods dumps: dumps-0 dwl: dwl dwl: taxonbota fa-wp: tofawiki02 getstarted: gitservices getstarted: webservices glampipe: Glampipe hound: hound-puppet-02 integration: integration-cumin integration: integration-r-lang-01 integration: integration-slave-docker-1040 integration: integration-slave-docker-1041 integration: integration-slave-jessie-1002 k8splay: k8s-dzahn lizenzhinweisgenerator: lizenzhinweisgenerator maps: maps-tiles1 maps: maps-warper3 openrefine: openrefine01 openstack: cloud-bootstrapvz-stretch otrs: otrs-oneclickspam-test packagist-mirror: packagist-mirror1 partnermetrics: partnermetrics-redis-01 puppet-diffs: compiler1001 qna: meza-new2 quotatest: novaadminmadethis6 reading-web-staging: readers-web-master recommendation-api: missing-sections recommendation-api: rec-wiki recommendation-api: related-articles recommendation-api: tool security-tools: logparse01 sentry: frama-test5 sentry: frama-test6-sb services: kask services: kask-client shinken: shinken-02 shiny-r: discovery-production-02 testlabs: abogott-puppetmaster testlabs: canary1016-01 tools: tools-sgecron-01 tools: tools-sgegrid-shadow toolsbeta: toolsbeta-sgecron-01 toolsbeta: toolsbeta-sgegrid-shadow toolsbeta: toolsbeta-sgewebgrid-lighttpd-0901 twl: wmil video: encoding01 video: gfg01 video: video-redis video: videodev videowiki: app-instance visualeditor: dumpgrepper webperf: disposable wikidata-dev: wikidata-constraints wikidata-federation: federated-commons wikidata-federation: federated-wikidata wikidiff2-wmde-dev: wmde-wikidiff2-jacnth wikidocumentaries: hupu wikidocumentaries: roope wikidumpparse: whgi wikifactmine: elasticsearch-20 wikifactmine: elasticsearch-21 wikifactmine: puppetmaster-01 wikilabels: wikilabels-02 wikilabels: wikilabels-experiment wikimetrics: wikimetrics-01 wikistream: ws-web wikitextexp: wikitextexp-base-1002 wikitextexp: wikitextexp-expt-1002 wm-bot: wm-bot-pg wm-bot: wm-bot2 wmf-research-tools: diegoTest wmf-research-tools: wikilabels wpx: wpx-redirects-01 _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 3

[Cloud-announce] Brief toolforge cron outage on Friday, 2019-07-19 at 14:00 UTC
by Andrew Bogott 19 Jul '19

19 Jul '19

On Friday I'll be moving the toolforge cron server to new hardware. During the move, any uses of the 'crontab' command will fail gracelessly. Any cron jobs scheduled to launch during the downtime will be skipped. The move should take 5-10 minutes but may take as long as 30 if there are complications. -Andrew _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 1

Coolest Tool Award 2019: Call for Nominations
by Birgit Mueller 17 Jul '19

17 Jul '19

Dear all, we’re really happy to announce the first ever Coolest Tool Award <https://meta.wikimedia.org/wiki/Coolest_Tool_Award>! Tools play an essential role at Wikimedia, and so do the many volunteer developers who experiment with new ideas, develop & maintain local & global solutions and bridge workflow gaps for the Wikimedia communities. There are incredible many great tools out there. It’s time to celebrate this & to make the work volunteer developers do more visible to everyone :-) The Coolest Tool Award ceremony will take place at Wikimania, as part of the official program: https://wikimania.wikimedia.org/wiki/2019:Technology_outreach_%26_innovatio… The award is organized & selected by this year's Coolest Tool Academy. The plan is to award the greatest tools in a variety of categories: For example: “best Commons tool” to recognize the value of a tool for a specific project, or “best newcomer” to award the work of a fairly new developer. As no one can possibly know all the cool tools out there, we’re looking for some help & inspiration: Please point us to the tools that you think are great - out of any reason you can think of! Please use this form: https://docs.google.com/forms/d/1Ip5Sb_CDvgO6IN2f51V3WjkVYU9Sa-nneX5PoY0sjo… to recommend tools by July 29, 2019. You can nominate as many tools as you want by filling out the form multiple times. This survey will be conducted via a third-party service, which may subject it to additional terms. For more information on privacy and data-handling, see the survey privacy statement: https://foundation.wikimedia.org/wiki/Coolest_Tool_Award_2019_Survey_Privac… Thank you very much for your ideas & recommendation(s)! We will continue to spread the word over the next 1-2 days, but if you get the chance, please feel welcome to share this information with others too! If you have any questions, please contact us at https://meta.wikimedia.org/wiki/Coolest_Tool_Award. Thanks :-) Birgit, for the Coolest Tool Academy 2019 -- Birgit Müller (she/her) Director of Technical Engagement Wikimedia Foundation <https://wikimediafoundation.org/>

1 0

[Cloud-announce] Debian Buster image now available in cloud-vps
by Andrew Bogott 09 Jul '19

09 Jul '19

The latest Debian version, 10.0 "buster", was officially released a few days ago[0]. Today, I've built a new Debian buster base image and made it available in all projects. The Stretch base image will remain available for some time to permit compatibility with existing setups, but any new work should use buster. If you have existing instances that were built using the buster prelease images (or instances that you manually upgraded from an earlier version) I encourage you to delete them and rebuild with this new base image for the most consistent results. -Andrew _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

2024

2023

2022

2021

2020

2019

2018

2017

Cloud