(+Jaime)
It’s hard to tell how long it will take, but I imagine for quite a while.
I guess a day max, but probably much less. If Jaime let’s me know that
he’s finished early, and I am close enough to a computer, I’ll turn the
EventLogging MySQL processes back on asap.
On Wed, Jan 20, 2016 at 4:12 PM, Oliver Keyes <okeyes(a)wikimedia.org> wrote:
Thanks Madhu! Awesome to see the transparency and
announces around this :D.
Do you know how long the reimport should take on Monday? I want to
make sure I know when to expect we can safely launch all our scripts.
On 20 January 2016 at 13:08, Madhumitha Viswanathan
<mviswanathan(a)wikimedia.org> wrote:
Hi all,
In order to convert tables on db1046 to the TokuDB engine - we have to
schedule some downtime on the Eventlogging databases between tomorrow,
Thursday Jan 21, 2016 at 16:00 UTC to Monday Jan 25, 2016 16:00 UTC.
What this means for EL users:
1. Eventlogging will still receive data and it will be available in
Kafka.
The data will continue to be imported into Hadoop
and files.
2. The Mysql consumers of Eventlogging will be stopped, so no data will
get
imported into the master(db1046 or m4-master) and
by extension to the
analytics-store.
3. Querying existing data from analytics-store will still be available,
but
data for the next 4 days won't be available.
4. On Monday, after the maintenance window we'll restart the Mysql
consumers, and all the data should get reimported from Kafka.
Analytics and Ops(DBA) will work on this together.
Feel free to reach out to us here or on #wikimedia-analytics if you have
any
concerns/questions.
-- Madhu Viswanathan
Software Engineer, Analytics
_______________________________________________
Engineering mailing list
Engineering(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/engineering
--
Oliver Keyes
Count Logula
Wikimedia Foundation
_______________________________________________
Engineering mailing list
Engineering(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/engineering