Cloud July 2019

cloud@lists.wikimedia.org

11 participants
14 discussions

[Cloud-announce] Instance downtime on August 5th and 6th
by Andrew Bogott 05 Aug '19

05 Aug '19

As part of routine networking and OS upgrades, I'll be emptying two more hypervisors (cloudvirt1021 and cloudvirt1022) on Monday and Tuesday next week, the 5th and 6th. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows. Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time! -Andrew + the WMCS team Affected instances (shown as <project>: <instance name>): account-creation-assistance: accounts-db3 analytics: deployment-server analytics: zk1-1 analytics: zk1-3 antiharassment: antiharassment-web1 automation-framework: af-debmonitor automation-framework: af-puppetmaster02 bastion: bastion-eqiad1-01 bastion: bastion-restricted-eqiad1-01 catgraph: sylvester cloudinfra: mx-out01 cloudinfra: mx-out02 cyberbot: cyberbot-exec-01 design: wikimedia-ui discourse: discourse1002 download: download-01 dumps: dumps-1 dumps: dumps-2 dwl: taxonbot etcd: etcd04 etcd: etcd05 etcd: etcd06 extdist: extdist-01 fastcci: fastcci-worker1 fastcci: fastcci-worker2 git: gerrit-mysql git: gerrit-test git: puppet-paladox google-api-proxy: google-api-proxy-02 grantreview: grantreview-03 hashtags: hashtags-prod hat-imagescalers: k8s-test-builder hhvm: hhvm-jmm-vp9 hhvm: hhvm-stretch-jmm huggle: huggle-wl huggle: xmlrcs iiab: medbox3-iiab integration: integration-slave-docker-1043 k8splay: qube-master language: language-apertium2 language: language-cx language: language-eg language: language-mleb-master language: language-mleb-stable language: moses01-small logging: filippo-log-jessie01 logging: filippo-log-stretch01 mcr-dev: mcr-full mediawiki-vagrant: mwv-builder-02 mediawiki-vagrant: mwv-stretch-migration mediawiki-vagrant: T183456-jessie mediawiki-vagrant: T183456-stretch mix-n-match: mixnmatch mobile: apps-team-tools mobile: emoji mwoffliner: mwoffliner2 mwoffliner: mwoffliner4 mwstake: mwstake mwv-apt: mwv-apt-01 newsletter: newsletter-test openstack: labs-bootstrapvz-jessie openstack: vmbuilder-trusty ores: ores-web-01 ores: ores-web-03 orig: gnd-01 packaging: builder01 packaging: calico-builder01 petscan: petscan3 phabricator: phabricator phabricator: phab-tin phabricator: puppet-phabricator pluggableauth: pluggableauth-server puppet: puppet-jmm-pmaster puppet: puppet-jmm-pmaster-client qna: meza-new4 quarry: quarry-db-01 quarry: quarry-web-01 quarry: quarry-worker-02 reading-web-staging: experiments reading-web-staging: marvin-staging reading-web-staging: readingwebstaging recommendation-api: gapfinder-tools recommendation-api: tool-alpha search: cirrus-browser-bot search: relforge-search search: wdsearch2 snuggle: snuggle-wikidatawiki-01 social-tools: timeless2 striker: striker-uwsgi03 test-twemproxy: mc-clusterB-1 test-twemproxy: mc-clusterB-2 toolsbeta: toolsbeta-sgebastion-04 toolsbeta: toolsbeta-sgeexec-0901 toolsbeta: toolsbeta-sgegrid-master toolserver-legacy: relic-stretch traffic: diffscan traffic: traffic-puppetmaster traffic: traffic-text-stretch utrs: utrs-beta-production utrs: utrs-database2 utrs: utrs-production2 wcdo: wcdo wikibase-registry: orig-01 wikibase-registry: wbregistry-01 wikidata-dev: federated-wikis wikidata-dev: federated-wikis2 wikidata-primary-sources-tool: pst wikidiff2-wmde-dev: sqltest02 wikidiff2-wmde-dev: wmde-wikidiff2-patched wikidiff2-wmde-dev: wmde-wikidiff2-unpatched wikilabels: wikilabels-staging-01 wikimania-support: scholarships-02 wikispeech: wikispeech-tts-release wikitextexp: parsing-qa-01 wildcat: dannyb xtools: xtools-dev04 xtools: xtools-prod03 xtools: xtools-prod05 _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

2 8

[Cloud-announce] Brief toolforge grid interruption on Monday, August 5 at 14:00UTC
by Andrew Bogott 31 Jul '19

31 Jul '19

I will be moving the toolforge grid master on Monday. That will mean that for a few minutes it will be impossible to submit new grid jobs. Jobs that are already running will be unaffected. I'll make the move at 14:00UTC, which is about 7AM Pacific time. -Andrew _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

Issue with pip
by Huji Lee 31 Jul '19

31 Jul '19

Hi all, I am trying to run a pywikibot script on the Cloud servers. Please find the script at [1]. The script depends on a few pip packages include cidr_trie. I created a virtual environment under my tools account and installed these dependencies using "pip3 install ..." commands. When I ran the bot, I got a Syntax Error message for the cidr_trie module. I have pasted the traceback below. Any idea why this is happening? Of note, the exact same version of this module (3.1.2) works without any issues on my local machine. (venv) tools.huji@tools-sgebastion-07:~$ python3 core/pwb.py findproxy Traceback (most recent call last): File "core/pwb.py", line 250, in <module> if not main(): File "core/pwb.py", line 243, in main run_python_file(filename, [filename] + args, argvu, file_package) File "core/pwb.py", line 95, in run_python_file main_mod.__dict__) File "core/scripts/userscripts/findproxy.py", line 26, in <module> from cidr_trie import PatriciaTrie File "/mnt/nfs/labstore-secondary-tools-project/huji/venv/lib/python3.5/site-packages/cidr_trie/__init__.py", line 49 return f"IP: {self.ip}, Decision bit: {self.bit}" ^ SyntaxError: invalid syntax CRITICAL: Exiting due to uncaught exception <class 'SyntaxError'> Thanks, Huji [1] https://github.com/PersianWikipedia/fawikibot/blob/master/HujiBot/findproxy…

3 6

Re: [Cloud] CloudVPS reboots for security updates
by Maximilian Doerr 29 Jul '19

29 Jul '19

Aww man. I was hoping to push 365 days of continuous up time for my VMs. Cyberpower678 English Wikipedia Account Creation Team English Wikipedia Administrator Global User Renamer > On Jul 29, 2019, at 07:13, Arturo Borrero Gonzalez <aborrero(a)wikimedia.org> wrote: >

2 2

CloudVPS reboots for security updates
by Arturo Borrero Gonzalez 29 Jul '19

29 Jul '19

Hi there! Unrelated to other operations that were communicated recently (datacenter PDU upgrades, operating system upgrades, etc) we need to reboot all the cloudvirt servers to introduce some security updates for CPU vulnerabilities. Along with the physical hardware reboot we also need to reboot all the virtual machines running in CloudVPS. This operation is a bit disruptive but very quick and should not lead to any unexpected errors (is just a reboot). We already tried the same upgrades in some other servers. We will be doing the reboots during this week (starting 2019-07-29). If you see any problems related to this, please contact us. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

1 0

Need help with code review on Action API code snippets for on-wiki documentation
by Jay prakash 26 Jul '19

26 Jul '19

Hello everyone, I am Jay Prakash. As part of my Google Summer of Code project <https://phabricator.wikimedia.org/T219193>, I have developed code snippets in PHP, Python and MediaWiki Javascript to demonstrate the use of MediaWiki Action API modules. I am looking for help with code review, especially on the code samples format and accuracy. Please give your suggestions and feedback in a comment on this Phabricator task T228549[1]. All these code samples will be shown in a tabbed window in all the API module pages on MediaWiki.org like in https://test.wikipedia.org/wiki/API:Sandbox via a Gadget that is a work in progress. Thank you :) User:Jayprakash12345 (GSoC 2019 intern) <https://www.mediawiki.org/wiki/User:Jayprakash12345> [1] https://phabricator.wikimedia.org/T228549

1 0

[Cloud-announce] 20190726 - afl_log_id field to be removed from wiki replica views
by Brooke Storm 26 Jul '19

26 Jul '19

In the abuse_filter_log table, the afl_log_id field appears to never have been used and is being dropped upstream. To prepare for that and keep the replica view up and running, we are going to start removing the field from the abuse_filter_log views on the wiki replicas service, starting on Monday, July 26th. This should have little to no impact on anyone since the field seems to always be NULL everywhere and to never have been fully implemented, and it would only cause impact to an application if it was specifically queried. For more information on the dropping of the column: https://phabricator.wikimedia.org/T226851 <https://phabricator.wikimedia.org/T226851> Some of the reasons why and a bit more context: https://phabricator.wikimedia.org/T214592 <https://phabricator.wikimedia.org/T214592> Brooke Storm Operations Engineer Wikimedia Cloud Services bstorm(a)wikimedia.org <mailto:bstorm@wikimedia.org> IRC: bstorm_ _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

Re: [Cloud] [Wikitech-l] Coolest Tool Award 2019: Call for Nominations
by Srishti Sethi 26 Jul '19

26 Jul '19

Hello everyone, Sending a reminder that only a few days are left to recommend tools for the Coolest Tool Award 2019: https://meta.wikimedia.org/wiki/Coolest_Tool_Award. Nominate your favorite tools by July 29 :-) Cheers, Srishti *Srishti Sethi* Developer Advocate Wikimedia Foundation <https://wikimediafoundation.org/> On Tue, Jul 16, 2019 at 3:43 PM Bryan Davis <bd808(a)wikimedia.org> wrote: > On Tue, Jul 16, 2019 at 4:32 PM Brian Wolff <bawolff(a)gmail.com> wrote: > > > > To clarify, does this mean tool in the sense of "tool"server? (Aka > coolest > > thing hosted using cloud services) or is it more general including > gadgets, > > standalone apps or any other piece of technology in the wikimedia > ecosystem > > that's "cool"? > > Any Wikimedia related software is eligible. Gadgets, Lua modules, user > scripts, bots no matter where they normally run, web tools no matter > where they are hosted, desktop tools, mobile apps, ... > > We have a huge ecosystem of things that people build and use to make > working on the Wikimedia projects easier and the Coolest Tool Academy > wants to hear about all of them. You could honestly even nominate your > favorite GNU Linux distribution if you can explain how it makes life > as a Wikimedian better. > > Bryan > -- > Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> > [[m:User:BDavis_(WMF)]] Manager, Technical Engagement Boise, ID USA > irc: bd808 v:415.839.6885 x6855 > > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

PDU upgrades in the eqiad datacenter affects CloudVPS hypervisor
by Arturo Borrero Gonzalez 25 Jul '19

25 Jul '19

Hi there! There is an ongoing maintenance in the eqiad datacenter that involves changing power connectors of the servers. More info in this phabricator task: T226778 [0]. The PDU upgrade could potentially leave our hypervisors without power briefly. For some hypervisors, we plan to take the risks of leaving them running. For some other hypervisors (those running important DBs in the form of virtual machines) we will probably do a controlled shutdown before the operations to ensure no data corruption happen in the databases. The PDU upgrades will happen this very week (see phab task [0]) and it could potentially affect every virtual machine we run in CloudVPS. This includes Toolforge. In the case of power loss, we expect the disruptions to be very briefly and to don't cause extended downtime in any case. Please, let us know any issue you may find related to this operation. regards. [0] https://phabricator.wikimedia.org/T226778 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

1 1

[Cloud-announce] NFS Maintenance 2019-07-25 1500 UTC
by Jason Hedden 25 Jul '19

25 Jul '19

On Thursday, July 25th, 2019 between the hours of 1500 and 1700 UTC we will be performing system maintenance on the NFS servers that support Toolforge and the CloudVPS instances that are using NFS for home, project or scratch data. During this maintenance window, we will be applying rolling updates that require NFS service restarts. We are taking precautions to minimize impact, but there may be short periods of NFS service interruption or performance degradation. --- Jason Hedden Site Reliability Engineer - Wikimedia Cloud Services Wikimedia Foundation _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

Cloud July 2019