To move maps project/home NFS and the scratch share off of the old labstore1003 machine and onto much faster, newer hardware, I’m going to begin doing rsyncs of data across.
This is just to announce this is starting soon and to encourage people to reach out on the #wikimedia-cloud channel if it is hitting performance hard on maps servers, in particular or on the scratch share.
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org <mailto:bstorm@wikimedia.org>
IRC: bstorm_
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Reminder: Technical Advice IRC meeting this week **Wednesday 3-4 pm UTC**
on #wikimedia-tech.
Question can be asked in English, German & Hungarian!
The Technical Advice IRC Meeting is a weekly support event for volunteer
developers. Every Wednesday, two full-time developers are available to help
you with all your questions about Mediawiki, gadgets, tools and more! This
can be anything from "how to get started" over "who would be the best
contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for the Technical Advice IRC Meeting crew)
--
Michael F. Schönitzer
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
https://wikimedia.de
Unsere Vision ist eine Welt, in der alle Menschen am Wissens der Menschheit
teilhaben, es nutzen und mehren können. Helfen Sie uns dabei!
https://spenden.wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.
Hi Alaa,
On 25-04-19 16:38, Alaa Sarhan wrote:
> > This is really a defective redesign. It reintroduced numeric IDs to
> be removed by T114902. See also T179928. We should reconsider
> reintroduce a new table to link unperfixed and perfixed entity ID.
>
> The new schema has been optimized as much as possible to allow maximum
> scalability as it will contain a massive amount of data that we hope
> it doubles or even triple in size as soon as we can.
The new schema has been optimized for your use cases and complete breaks
any tools combining page table data with wikibase data. If you really
would care about tool developers, you wouldn't trash the unprefixed ID.
Maarten
Hi everyone,
I get those mails from time to time. Is there a way to prevent them?
Martin
---------- Forwarded message ---------
From: Cron Daemon <root(a)tools.wmflabs.org>
Date: Fri, 3 May 2019 at 02:00
Subject: Cron <tools.map-of-monuments@tools-sgecron-01> jlocal rm -f
/data/project/map-of-monuments/generate.*; /usr/bin/jsub -N generate -once
-quiet bash /data/project/map-of-monuments/support/generate_monuments.sh
To: <tools.map-of-monuments(a)tools.wmflabs.org>
cannot allocate TLS data structures for initial threadTraceback (most
recent call last):
File "/usr/bin/job", line 48, in <module>
root = xml.etree.ElementTree.fromstring(proc.stdout.read())
File "/usr/lib/python3.5/xml/etree/ElementTree.py", line 1345, in XML
return parser.close()
xml.etree.ElementTree.ParseError: no element found: line 1, column 0
Reminder: Technical Advice IRC meeting this week **Wednesday 3-4 pm UTC**
on #wikimedia-tech.
Question can be asked in English & Hebrew!
The Technical Advice IRC Meeting is a weekly support event for volunteer
developers. Every Wednesday, two full-time developers are available to help
you with all your questions about Mediawiki, gadgets, tools and more! This
can be anything from "how to get started" over "who would be the best
contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for the Technical Advice IRC Meeting crew)
--
Michael F. Schönitzer
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
https://wikimedia.de
Unsere Vision ist eine Welt, in der alle Menschen am Wissens der Menschheit
teilhaben, es nutzen und mehren können. Helfen Sie uns dabei!
https://spenden.wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.
Alaa Sarhan, 25/04/19 17:38:
> Full migration is not possible unfortunately due to the current capacity
> of database master node.
Can you clarify whether it would also be too much load to write both to
the new table and the old wb_terms table for a transition period
(controlled by a configuration setting)?
(I'm not advocating for it, just asking because we did something of the
sort in the past for other transitions.)
Federico
With the merge of Icb674095,[1] use of API action=logout will require a
CSRF token. This was considered a security issue, so the usual deprecation
process was not followed. See T25227[2] for details.
Clients that do not use a CSRF token with action=logout will receive a
badtoken error message ***and will not be logged out***.
This change should be deployed to Wikimedia wikis with 1.34.0-wmf.3. See
https://www.mediawiki.org/wiki/MediaWiki_1.34/Roadmap for a schedule.
Overall client impact is expected to be relatively low, as gathered
statistics indicate there are relatively few users of this API call. None
the less, maintainers should check their code for use of action=logout and
update as necessary to maintain expected operation.
[1]: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/504565
[2]: https://phabricator.wikimedia.orgdo not use /T25227
<https://phabricator.wikimedia.org/T25227>
[3]: https://phabricator.wikimedia.org/T25227#4902709
--
Brad Jorsch (Anomie)
Senior Software Engineer
Wikimedia Foundation
_______________________________________________
Mediawiki-api-announce mailing list
Mediawiki-api-announce(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce
The 'wb_terms' table is being removed from the Wiki Replica databases.
Please see Léa Lacroix's post on the wikidata mailing list [0] for
additional details.
TL;DR summary:
* May-June 2019, the Wikidata development team will drop the wb_terms
table from the database in favor of a new optimized schema
* Migration will start on 2019-05-29
* A test system will be available starting 2019-05-15
* Details are available in Phabricator [1]
[0]: https://lists.wikimedia.org/pipermail/wikidata/2019-April/012987.html
[1]: https://phabricator.wikimedia.org/T221764
Bryan
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Technical Engagement Boise, ID USA
irc: bd808 v:415.839.6885 x6855
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Tuesday starting at around 17:00 UTC I'm going to relocate the paws and
kubernetes masters to the new network region. While the VMs are
copying, launches of new kubernetes jobs and creation of new PAWS
notebooks will fail.
The outage should last about an hour -- less if everything goes well,
somewhat more if not. Jobs that are already running when the copy begins
should be unaffected.
Apologies for any inconvenience caused!
-Andrew
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Cross-posting for visibility.
---------- Forwarded message ---------
From: Brad Jorsch (Anomie) <bjorsch(a)wikimedia.org>
Date: Tue, Apr 16, 2019 at 10:49 AM
Subject: Re: [Mediawiki-api-announce] Deprecation of list=allusers
'recenteditcount' result property
To: <mediawiki-api-announce(a)lists.wikimedia.org>
This deprecated property, announced in July 2014, will be removed in
MediaWiki 1.34. On Wikimedia sites, the removal will likely be
deployed with 1.34.0-wmf.2, which is scheduled for next week.
If your client is still using the "recenteditcount" property rather
than "recentactions", you should update your code ASAP.
On Tue, Jul 1, 2014 at 3:48 PM Brad Jorsch (Anomie)
<bjorsch(a)wikimedia.org> wrote:
>
> When list=allusers is used with auactiveusers, a property 'recenteditcount' is returned in the result. In bug 67301[1] it was pointed out that this property is including various other logged actions, and so should really be named something like "recentactions".
>
> Gerrit change 130093,[2] merged today, adds the "recentactions" result property. "recenteditcount" is also returned for backwards compatability, but will be removed at some point during the MediaWiki 1.25 development cycle.
>
> Any clients using this property should be updated to use the new property name. The new property will be available on WMF wikis with 1.24wmf12, see https://www.mediawiki.org/wiki/MediaWiki_1.24/Roadmap for the schedule.
>
>
> [1]: https://bugzilla.wikimedia.org/show_bug.cgi?id=67301
> [2]: https://gerrit.wikimedia.org/r/#/c/130093/
>
> --
> Brad Jorsch (Anomie)
> Software Engineer
> Wikimedia Foundation
--
Brad Jorsch (Anomie)
Senior Software Engineer
Wikimedia Foundation
_______________________________________________
Mediawiki-api-announce mailing list
Mediawiki-api-announce(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Technical Engagement Boise, ID USA
irc: bd808 v:415.839.6885 x6855