FYI, This has started. I have turned off the MySQL processes. No new data will be inserted into MySQL until we turn them back on.
On Wed, Jan 20, 2016 at 4:43 PM, Andrew Otto otto@wikimedia.org wrote:
(+Jaime)
It’s hard to tell how long it will take, but I imagine for quite a while. I guess a day max, but probably much less. If Jaime let’s me know that he’s finished early, and I am close enough to a computer, I’ll turn the EventLogging MySQL processes back on asap.
On Wed, Jan 20, 2016 at 4:12 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Thanks Madhu! Awesome to see the transparency and announces around this :D.
Do you know how long the reimport should take on Monday? I want to make sure I know when to expect we can safely launch all our scripts.
On 20 January 2016 at 13:08, Madhumitha Viswanathan mviswanathan@wikimedia.org wrote:
Hi all,
In order to convert tables on db1046 to the TokuDB engine - we have to schedule some downtime on the Eventlogging databases between tomorrow, Thursday Jan 21, 2016 at 16:00 UTC to Monday Jan 25, 2016 16:00 UTC.
What this means for EL users:
- Eventlogging will still receive data and it will be available in
Kafka.
The data will continue to be imported into Hadoop and files. 2. The Mysql consumers of Eventlogging will be stopped, so no data will
get
imported into the master(db1046 or m4-master) and by extension to the analytics-store. 3. Querying existing data from analytics-store will still be available,
but
data for the next 4 days won't be available. 4. On Monday, after the maintenance window we'll restart the Mysql consumers, and all the data should get reimported from Kafka.
Analytics and Ops(DBA) will work on this together.
Feel free to reach out to us here or on #wikimedia-analytics if you
have any
concerns/questions.
-- Madhu Viswanathan Software Engineer, Analytics
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering
-- Oliver Keyes Count Logula Wikimedia Foundation
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering