Hello,
we are planning to change how Cloud VPS instances and Toolforge tools contact
WMF-hosted wikis, in particular the source IP address for the network connection.
The new IP address that wikis will see is 185.15.56.1.
The change is scheduled to go live on 2021-02-08.
More detailed information in wikitech:
https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis
If you are a Cloud VPS user or Toolforge developer, check your tools after that
date to make sure they are properly running. If you detect a block, a rate-limit
or similar, please let us know.
If you are a WMF SRE or engineer involved with the wikis, be informed that this
address could generate a significant traffic volume, perhaps about 30%-40% total
wiki edits. We are trying to smooth the change as much as possible, so please
send your feedback if you think there is something we didn't account for yet.
Thanks, best regards.
--
Arturo Borrero Gonzalez
SRE / Wikimedia Cloud Services
Wikimedia Foundation
Hello!
The 2020 project opt-in process wrapped up at the end of the year, and
we've identified the following projects as abandoned:
- asyncwiki
- blog
- commons-corruption-checker
- fastcci
- finding-glams
- ign2commons
- lizenzhinweisgenerator
- lta-tracker
- meza
- ogvjs-integration
- puppet
- snuggle
- wikidata-federation
- wikidata-primary-sources-tool
- wikidata-realtime-dumps
- wikimania-scholarships
At the end of this month (2020-01-31) those projects will be deleted
along with all related data and VMs. If you know of anyone associated
with those projects who is not on this list, please bring this to their
attention. And, if you think any of this is in error, please notify me
immediately.
Thank you!
-Andrew + the WMCS team
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Hi everyone.
We have some updates related to T260389 Redesign and rebuild the
wikireplicas service using a multi-instance architecture
<https://phabricator.wikimedia.org/T260389>.
The new cluster will be ready for testing on February 1st, and we need your
help.
Please subscribe and comment on T272523 Early testing of the multi-instance
architecture <https://phabricator.wikimedia.org/T272523> or reach out if
you would like to help test it by migrating your code. We want to closely
monitor it and tune it as we ramp up usage.
PAWS and Quarry will migrate to use the new cluster later in February, we
will publish more information as soon as possible.
The old cluster will remain available in parallel during the migration.
Thank you for your help,
--
Joaquin Oltra Hernandez
Developer Advocate - Wikimedia Foundation
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
This Thursday we will be upgrading the cloud-vps OpenStack install to
version 'Stein'. During the upgrade window (probably about an hour),
Horizon will be disabled.
Existing tools and VMs should be largely unaffected, although there may
be a brief network interruption when the routing services restart.
The upgrade is scheduled for 15:00 UTC, which is 7AM in California.
-Andrew + the WMCS team
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Hi Everyone,
We’re happy to announce the January 2021 edition of the Technical Community
Newsletter
<https://www.mediawiki.org/wiki/Technical_Community_Newsletter/2021/January>
is now available. The newsletter is compiled by the Wikimedia Developer
Advocacy Team. It aims to share highlights, news, and information of
interest from and about the Wikimedia technical community.
Check it out, and learn about what technical contributors have been up to
this past quarter, upcoming conferences & calls for papers, and how to get
involved.
The Wikimedia Technical Community is large and diverse, and we know we
can't capture everything perfectly. We welcome your ideas for future
newsletters. Let us know what you would like to see or highlights you would
like us to include.
Subscribe to the Technical Community Newsletter
<https://www.mediawiki.org/wiki/Newsletter:Technical_Community_Newsletter>,
if you'd like to keep up with essential updates and information
Kindly,
Sarah R. Rodlund
Senior Technical Writer, Developer Advocacy
<https://www.mediawiki.org/wiki/Developer_Advocacy>
srodlund(a)wikimedia.org
My toolforge service (https://author-disambiguator.toolforge.org/) keeps
becoming unavailable with hangs/502 Bad Gateway or other server errors a
few minutes after I restart it, and I can't see what could be causing this.
These errors don't show up in the error log, and the 502 responses don't
show up in the access log (which has had very little traffic anyway - one
request per minute at most usually?) I can connect to the kubernetes pod
with kubectl and everything looks normal,there's only a few processes
listed in /proc, etc. (though it would be nice to have some other
monitoring tools like ps and netstat installed by default?) But I can't get
a response via the web after the first few minutes.
The problem seems to have started mid-day yesterday - see the monitor data
here:
https://grafana-labs.wikimedia.org/d/toolforge-k8s-namespace-resources/kube…
with the surge in 4xx and 5xx status codes on 1/3 (by the way, I don't see
the surge in 4xx status codes in access.log recently either - there are 2
from this morning and none yesterday, nothing like the multiple per second
indicated in that grafana chart!)
Any ideas what's going on? This looks like some sort of upstream issue with
nginx maybe?
I am seeing a "You have run out of local ports" error in the error logs
from earlier today (but it hasn't repeated recently) which is maybe a clue?
I don't think that could possibly be from anything my service is doing
though!
Help would be greatly appreciated, thanks!
Arthur Smith