Hello,
I was asked by WMF to make the database views on Toolserver fit to their privacy policy they applied at Toollabs.
This means some data in the databases should not be displayed any longer.
It regards fields in the tables revision, logging, recentchanges, oldimage and filearchive.
Table entries that should be hidden will not be displayed by the Toolserver database servers.
These entries can be unhidden by the Steward level users of the Wikipedias and are then accessible again.
Some fields are not even shown in the default view because queries on these tables then no longer can use indexes which makes the
databases and queries run very slow.
I put alternative views in place in this case in case you need more fields you'll find slower views with most of the fields (but
redacted).
Please note that this may change the number of rows and other results of your tools.
If you have any issues with your tools because of this change please let me know.
Cheers
Marlen/nosy
FYI
---------- Forwarded message ----------
From: Andrew Bogott <abogott(a)wikimedia.org>
Date: Fri, Nov 15, 2013 at 8:29 PM
Subject: [Labs-l] Labs datacenter migration
To: "A list for announcements and discussion related to the Wikimedia Labs
project." <labs-l(a)lists.wikimedia.org>, Wikimedia developers <
wikitech-l(a)lists.wikimedia.org>
Almost a year ago, the Wikimedia Foundation migrated most of our
services from our old data center in Tampa to the new one in Ashburn [1].
In the next couple of months Labs and Tool Labs will be following suit --
we expect to have everything moved to Ashburn by mid-January at the latest.
This move will provide some immediate benefits (lower latency with
production, quicker database replication) and many long-term benefits
(better stability, happier Operations staff). We don't yet have a specific
timeline for stages of the migration, but there are a few things you can do
now to help us prepare for the change and to bolster your projects against
possible disruption.
1) Subscribe to Labs-l, and read it. [2] Labs-l is low-volume, and future
migration announcements may not be sent to other lists.
2) Tool Labs users: As long as your tools are properly managed by the
grid engine and can survive stops and restarts, the migration will be quite
painless. If your tools aren't, or can't... fix them :)
3) Labs project admins: Clean up old projects and instances. If you have
instances that are no longer of interest, delete them. If you know of
entire projects that are no longer in use, please contact me directly and
I'll mop up.
4) Labs instance owners: Make sure that puppet is running properly on
your instances. If '$sudo puppetd -tv' produces any red lines, then fix
them or contact me for help with fixing. When instances move to the new
data center we'll be relying on puppet to update location-specific
settings, so instances without puppet may not survive the move. If your
instance uses self-hosting puppet (via puppetmaster::self or
role::puppet::self) then you will also need to update your local puppet
repo. [3]
5) All Labs users: if you have valuable data residing on local instance
storage, start backing it up to shared storage in /data/project. You
should be doing this anyway -- no instance is safe from catastrophe, ever.
6) If your project or tool generates log files, have a look at purging old
log data. The last time we did a data migration there was at least one
terabyte-sized logfile that really gummed up the works.
Updates about this change will be posted to this list as soon as we
know about them. Any potential downtime will be announced well in advance.
In the meantime, don't hesitate to ask questions about the above steps on
IRC or the mailing list.
-Andrew
[1] https://blog.wikimedia.org/2013/01/19/wikimedia-sites-
move-to-primary-data-center-in-ashburn-virginia/
[2] https://lists.wikimedia.org/mailman/listinfo/labs-l
[3] https://wikitech.wikimedia.org/wiki/Help:Self-hosted_puppetmaster#FAQ
_______________________________________________
Labs-l mailing list
Labs-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/labs-l
--
@wikimediadc / @wikidata
Hi all!
There will be 2 overlapping creative communities for planning Wikimaps
1. Wikimaps Designers & Developers (GLAM & map Wikipedians,
OpenHistoricalMappers etc)
2. Wikimaps Nordic (Regional collaboration: Wikimedia chapters,
wikimedians, mappers and GLAMs from the Nordic countries)
This is an invitation to join the international designer & developer
community. Wikimaps Nordic will form a project community in the beginning
of January.
We’ll arrange a video conference with *http://videoconf.wikimedia.ch/
<http://videoconf.wikimedia.ch/>*
Tuesday December 3
at 8:00 PDT - 11:00 EST - 16:00 GMT - 17:00 CET - 18:00 EET - 21:00 IST
Sign up in the collaborative Etherpad
*http://wmfi.muistio.tieke.fi/wikimaps-online-1
<http://wmfi.muistio.tieke.fi/wikimaps-online-1>*
Let's talk freely about what Wikimaps could be. Here are some ideas to get
you started. See, comment and discuss them here:
*https://docs.google.com/presentation/d/1EvXZtoV9vihtXZxVhA5ZKTEfmKFVI2btNQUREF-6so0/edit#slide=id.g11cd82f09_034
<https://docs.google.com/presentation/d/1EvXZtoV9vihtXZxVhA5ZKTEfmKFVI2btNQU…>*
*Meeting agenda*
Introductions 30 min
1. Round for presentations ~1 min per person
2. Brief presentations of Wikimaps projects ~2 min / ~8 projects
Discussion 70 min
3. Discuss expectations. Create working groups. Focus on a project or two.
4. What kind of technologies and communication tools we will use
Practicalities 20 min
5. Future schedule for the process
6. To-Do before the next meeting
See you soon!
Susanna Ånäs / Wikimedia Suomi
ps.
Info about Wikimaps Nordic with links to Wikimaps info:
https://docs.google.com/document/d/1EhKgIUshgUHq3c4NeCDvMTPoRPCXxF-IInwtHHE…
I've cross-posted this on maps-l, commons-l, cultural partners in wikimedia
and historic at osm
--
*Susanna Ånäs *Käyttäjä:Susannaanas
Wikimedia Suomi <http://fi.wikimedia.org/wiki/Etusivu>
– GLAM <http://fi.wikipedia.org/wiki/Wikipedia:GLAM>
– tiedotus – yhteistyö
blog.wikimedia.fi
/ @ <https://twitter.com/WMFinland>
WMFinland <https://twitter.com/WMFinland>
/ Facebook <https://www.facebook.com/WikimediaSuomi>
/ Liity jäseneksi! <http://fi.wikimedia.org/wiki/Liity_j%C3%A4seneksi>