Dear Wikimedia Cloud VPS/Toolforge users,
If you use dumps/pageviews/other datasets available via /public/dumps on
Toolforge/VPS instance, this email is for you!
The underlying NFS storage server is being replaced. Your access path will
remain the same, but the data may be stale or inaccessible during the
migration to the new servers.
Dates: The migration is scheduled for *April 2nd, 2018 starting at 14:30
UTC*, and is expected to last a few hours.
Thanks! We'll send more updates closer to the migration date. If you have
any questions, just let us know.
Best,
--
Madhumitha Viswanathan & Ariel Glenn
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
We use the term "tool" a lot in our community, usually to refer to projects
hosted on Toolforge (and before that, Tool Labs, and before that, the
Toolserver). But what is a tool?
On Meta I've crafted a preliminary definition based on my own
understanding.[0] Let me know if it's consistent with your understanding.
If not, feel free to recommend changes. (I'd be very curious to see if
other definitions exist!)
Thank you,
James Hare
[0] https://meta.wikimedia.org/wiki/Tools
----
James Hare
Associate Product Manager
Wikimedia Foundation
https://wikimediafoundation.org
About 24 hours from now we're going to reboot a couple of servers[1] in
the cloud infrastructure to apply security updates.
Few WMCS users (and, in particular, no tools users) should notice any
interruption. Nonetheless, a few services will be down:
- New instance creation will fail
- CI tests will stop running
- Horizon and Wikitech may display incorrect or missing information
Apologies in advance for any inconvenience!
-Andrew
[1] labservices1001 and labcontrol1001
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 3-4 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Hello,
I need help writing a query that I would like to run on the Clouds. The
goal of the query is to retrieve the following information from
wikidatawiki_p:
* Find all pages that have a claim for the property P1566, for example see
https://www.wikidata.org/wiki/Q2113430
* Find out what is the value of their P1566 property (in this case, 18918)
Output format should be like this:
page_id entity property_value
2039804 Q2113430 18918
...
Thanks in advance,
Huji
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 4-5 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
There was some feedback in the 2017 Toolforge survey that it would be
helpful for all database related changes to be posted to the cloud
mailing list. I can't guarantee that I'll spot all of them, but
together we can probably do a pretty good job of keeping each other
informed.
Bryan
---------- Forwarded message ----------
From: Léa Lacroix <lea.lacroix(a)wikimedia.de>
Date: Mon, Mar 12, 2018 at 7:17 AM
Subject: [Wikitech-ambassadors] "autopatrolled" entries to be removed
from the logging table
To: wikitech-ambassadors(a)lists.wikimedia.org
Hello all,
This change might impact people who run tools based on the patrolling
status of edits. This could also be relevant for admins. Feel free to
share with your local communities.
Currently, MediaWiki is storing the information about if an edit has
been patrolled or autopatrolled in the logging table. This table is
getting very very big, causing significant infrastructure issues.
Therefore, we plan to make the following changes:
Stop adding new entries for autopatrolling to the logging table
Remove the old entries for autopatrolling from this table
Since the distinction between autopatrol and manual patrol was
introduced in April of 2016, We need to remove every patrol action
(manual or not) before that date.
Include information about autopatrolled in the recentchanges table.
The fields rc_patrolled is current 0 for unpatrolled edits, and 1 for
patrolled edits. In the future, it will be 0 for unpatrolled, 1 for
manually patrolled, and 2 for autopatrolled edits.
This means that the information about if an edit is autopatrolled,
will be accessible only in the Recent Changes table, for 30 days. For
now, manual patrolling actions will continue to be recorded in the
logging table as before, and will remain visible on Special:Log. More
details can be found in the technical RFC document, see phab:T184485.
We plan to deploy these changes on April 4th. The script removing
patrol actions in the database may take several weeks to run.
If you’re maintaining a tool using logging.log_action =
"autopatrolled", please consider changing your code to use
recentchanges.rc_patrolled = 2. If this is going to cause large issues
for an important tool, please let us know.
If you have any technical question, feel free to write to user:Ladsgroup.
--
Léa Lacroix
Project Manager Community Communication for Wikidata
Wikimedia Deutschland e.V.
Tempelhofer Ufer 23-24
10963 Berlin
www.wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg
unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das
Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.
_______________________________________________
Wikitech-ambassadors mailing list
Wikitech-ambassadors(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA
irc: bd808 v:415.839.6885 x6855
tl;dr: Starting on Wednesday, the Horizon UI is going to look a bit
different.
--
On Wednesday next week I'm going to switch Horizon and Toolsadmin
traffic away from their current physical host and over to new hardware.
The change to Toolsadmin will be largely invisible, but the Horizon
switch will include a two-version upgrade from (alphabetized) version
'Mitaka' to version 'Ocata.'
If you'd like to try out either of the new services, they have their own
temporary public urls:
https://newhorizon.wikimedia.org/https://newtoolsadmin.wikimedia.org/
I welcome your comments, either positive or negative. A few of
Horizon's workflows have moved to client-side javascript, so bits and
pieces may be a bit more responsive but in general it will still provide
the slow load times that we've all learned to tolerate.
In addition to UI changes, behind the scenes these new sites are quite a
bit different:
- Both services are running Debian Stretch (the old services were on
Ubuntu Trusty).
- The services are running on a pair of new servers running behind a
load balancer, which should reduce downtime during future maintenance.
- The new Horizon deploy is deployed using Scap3, directly from the
upstream source. That will make applying future WMCS-specific fixes and
improvements much simpler.
On Friday morning my time (10:00 CST, 8:00 PST, 16:00 UTC) I'll be
switching the dns record for wikitech.wikimedia.org to point to a new
server. This change should be largely invisible to users, but there are
a few things to be ready for:
- Most importantly, YOU WILL BE LOGGED OUT of Wikitech. So if you've
been relying on a persistent session to avoid having to keep track of
your 2FA tokens, today is the day to reset 2FA and record the new
information.
- The new Wikitech build uses a lot of updated software (Debian Stretch,
HHVM, etc.). Although we've done some spot-checks, there may be new
issues that appear for your particular use case. We'll evaluate these
as they crop up, and decide whether or not to revert to the old server.
-Andrew
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 4-5 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.