- Cloud - lists.wikimedia.org

[Reminder] Your feedback on the Developer Portal content draft
by Andre Klapper 21 May '21

21 May '21

Your feedback on content for a central place which links key technical documents is still very welcome until next Tuesday: https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal/Content_… Or join our Hackathon session this Saturday at 18:00UTC: https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/Schedule For more information, see the initial email: https://lists.wikimedia.org/hyperkitty/list/cloud@lists.wikimedia.org/messa… Thanks for your help to make finding our key tech docs easier! andre -- Andre Klapper (he/him) | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

1 0

secrets on cloud-vps
by Andrew Bogott 18 May '21

18 May '21

tl;dr: please respond with your use cases and concerns about secret keys, passwords, etc on cloud-vps Right now we have two not-very-good ways to distribute a secret key within a cloud project: 1) copy the secret onto each VM by hand as you create it 2) create a puppetmaster in your project and and have it distribute the secrets Option #2 is pretty good for big, long-lived projects but involves a lot of overhead. Option #1 is fine for projects with only one or two VMs but scales terribly. The WMCS team has been discussing the question of secrets distribution for years, and we have a few different possible solutions in mind but no favorite. Rather than rattle off those options here, we're trying to rewind a bit and gather possible use-cases and user wishes in this area. So: if this is a feature you've been missing, please respond with an answer to this question: "How would I make use of secrets on cloud-vps instances?" If possible, please include thoughts about these points: - Is it good enough to provide project-wide distribution, or do we need finer-grained control, limiting secrets to particular users or instances? - Is a web UI for managing secrets a requirement, or are command line tools adequate? What if there were /only/ a web-ui and no command line? - Would supporting secret management solve immediate issues on its own, or is it only useful as a part of larger instrumentation tooling (e.g. puppet, heat, or terraform integration) Thank you! I welcome your thoughts on-list, but you're also welcome to list thoughts or use-cases on the phabricator tracking task https://phabricator.wikimedia.org/T283032

2 1

Wikimedia Hackathon 2021 this week! (May 21-23)
by Pavithra Eswaramoorthy 18 May '21

18 May '21

Hello everyone, Wikimedia Hackathon 2021<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021> is this week! The event will take place from Friday 21st to Sunday 23rd May, across various time zones. As mentioned earlier, the hackathon will have one main track and two open rooms. We’re excited to announce the main track sessions for the event: Hackathon Schedule<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/Schedule>! Please note that this schedule is still under construction and subject to change. You can still propose sessions for the open room (deadline: 19th May, 2021) by creating a Phabricator task using this template<https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?title=%5BSess…>. For more information, please go through How to propose a session<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/How_to#How_to_propo…> on the Hackathon Wiki-page. Notes for hackathon participants: * Make sure to add yourself to the list of participants<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/Participants> * Learn how you can participate and contribute<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/How_to#Contribute> * Join the hackathon discussion channels<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/Discussions> * If this is your first hackathon, check out some newcomer resources<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/How_to#First_time_a…> and join the newcomers telegram group<https://t.me/joinchat/fxc2lnfugAM1MTBh> for any queries We are looking for people to help us run an awesome and smooth event! If you're interested, feel free to have a look at the available roles<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021/How_to#Help_running…>. We’re especially looking for people who could facilitate sessions and help newcomers. Please feel free to share this in your communities, see you at the hack! Cheers, Organizing Team - Amir Sarabadani, Birgit Müller, Joaquin Hernandez, Léa Lacroix, Mohammed Sadat, Neslihan Turan, and Pavithra Eswaramoorthy

1 0

Porting the output of qstat to a web page
by Huji Lee 12 May '21

12 May '21

Hi, Some of the jobs I submit to the grid take a long time (say, 30-60 minutes) and I would like to check on their status without having to log back into the labs. I was hoping I could run shell_exec('qstat') in PHP and display its output on a web page. While shell_exec() works with other commands—e.g. echo shell_exec('whoami') correctly displays my tool's username on the webpage—for reasons I cannot explain, the output of shell_exec('qstat') is always blank. When I run qstat on the CLI at that same time, it does show me the familiar table output of ongoing jobs. Any idea why that is the case? Has anyone already created a solution for fetching a list of active jobs from the grid and displaying it on a web-based status page for your tool? Thanks, Huji

4 5

Expired certificates for wmflabs.org and wmcloud.org
by Sebastian Berlin 11 May '21

11 May '21

I'm getting errors regarding expired certificates for wmflabs.org and wmcloud.org, e.g. https://wikispeech.wmflabs.org and https://codesearch.wmcloud.org. Is this related to the maintenance later today or has something gone wrong? Here's an example from curl: $ curl https://codesearch.wmcloud.org curl: (60) SSL certificate problem: certificate has expired More details here: https://curl.haxx.se/docs/sslcerts.html curl failed to verify the legitimacy of the server and therefore could not establish a secure connection to it. To learn more about this situation and how to fix it, please visit the web page mentioned above. Best, *Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE) E-post/*E-Mail*: sebastian.berlin(a)wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84

3 5

CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC
by Arturo Borrero Gonzalez 06 May '21

06 May '21

Hello there, We will be doing an upgrade to the CloudVPS edge network Thursday 2021-05-06 @ 15:00 UTC that will likely impact user experience, including Toolforge. We scheduled an 1h operation window. During that time, intermittent network interruption, packet loss and other network problems are to be expected. The edge network maintenance will affect how virtual machines (and Toolforge tools) contact NFS, wiki-replicas, wikis API endpoints, and, in general, any network traffic that flows leaving or entering the cloud (also known as north-south traffic). More information on the operation can be found in phabricator [0] and in wikitech [1]. Regards. [0]https://phabricator.wikimedia.org/T270704 [1] https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/Enhanceme… -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

1 2

Developer Portal content draft: A future central place which links key technical documents
by Andre Klapper 06 May '21

06 May '21

<tl;dr>: Your feedback as a technically-minded Wikimedian is welcome on https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal/Content_… Hi everyone, last year[1] the Developer Advocacy team started to work on a single, central entry point for developers and tech-minded people for Wikimedia's technical documentation[2]. A central entry point ("developer portal") would cover common technical use cases to allow existing and future technical contributors and developers to find the information they need. Each use case links to its most relevant documentation (i.e. to pages on wikitech or mediawiki.org). This is part of a larger initiative to implement an organization strategy for key technical documents: Understand challenges about finding and maintaining docs, identify key docs, and investigate ways to improve our workflows around documentation. So far we: * Researched and reviewed existing documentation venues and pages * Reviewed developer/documentation portals in the broader industry * Interviewed several engineering teams around technical documentation workflows, audiences, and key technical docs (the key themes from these conversations are available, see the link above) * Created an initial draft for the structure and content of the single entry point Now we would like to improve this initial content draft with your help. 1) Please take a look at the initial draft at https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal/Content_… 2) Then, please help improve it by sharing your thoughts and feedback until *May 25th* at https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal/Content_… Note that this is only a draft how to structure content. It is not a design or layout proposal and it is not an implementation. For additional future work, see also the Phabricator workboard[3]. Next steps include: * A session at the remote Hackathon (May 22-23; [4]) * Incorporate content improvements, based on your feedback * Check the documents linked from the single entry point proposal for accuracy * Investigate requirements for the technical implementation * Investigate improvements of processes around technical documentation (structure, locations, navigation, stewardship, etc). If you want to learn more about the project, please see https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal Thanks to everybody who has provided their valuable input to get to this stage, and thanks in advance to everyone who will! Cheers, andre [1] https://lists.wikimedia.org/pipermail/wikitech-l/2020-August/093773.html [2] https://www.mediawiki.org/wiki/Developer_Advocacy/Developer_Portal [3] https://phabricator.wikimedia.org/tag/wikimedia-developer-portal/ [4] https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021 -- Andre Klapper (he/him) | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

1 0

[Cloud-announce] DNS for wikireplicas shifting to the new cluster today
by Brooke Storm 04 May '21

04 May '21

We waited longer than planned in previous communications to move the DNS to the new cluster (scheduled for April 28th, see https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign <https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign>), but with the old cluster slated for decommissioning, I’m redirecting the DNS to the new systems today. The old labsdb names are already pointed at it. If you notice problems related to the change that aren’t discussed in the Wikitech page at https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign <https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign>, please reach out on Phabricator, the #wikimedia-cloud IRC channel, or the Cloud mailing list. Thanks! Brooke Storm Staff SRE Wikimedia Cloud Services bstorm(a)wikimedia.org _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

[Cloud-announce] Wiki Replicas: Redirecting the old host names to the new cluster
by Joaquin Oltra Hernandez 29 Apr '21

29 Apr '21

Hi, Like we mentioned in the timeline [0], we are starting the work to redirect the old host names to the new ones [1]. We will share more details in the next few days when we actually deploy the DNS change. This is a heads up before the change actually happens in case you haven't tested your code with the new cluster, last warning. [0]: https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Timeli… [1]: https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_ho… -- Joaquin Oltra Hernandez Developer Advocate - Wikimedia Foundation _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

1 0

[Cloud-announce] cloud-vps maintenance at 14:00 UTC
by Andrew Bogott 28 Apr '21

28 Apr '21

We will be upgrading the Cloud-VPS OpenStack install later today beginning at 14:00 UTC (7:00 AM Pacific time). The total upgrade should take 60-90 minutes. During the upgrade period Horizon will be disabled. There may also be brief network interruptions as we restart router services. -Andrew + the WMCS Team _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce

5 6

2024

2023

2022

2021

2020

2019

2018

2017

Cloud