FYI, This has started.  I have turned off the MySQL processes.  No new data will be inserted into MySQL until we turn them back on.

On Wed, Jan 20, 2016 at 4:43 PM, Andrew Otto <otto@wikimedia.org> wrote:
(+Jaime)

It’s hard to tell how long it will take, but I imagine for quite a while.  I guess a day max, but probably much less.  If Jaime let’s me know that he’s finished early, and I am close enough to a computer, I’ll turn the EventLogging MySQL processes back on asap.



On Wed, Jan 20, 2016 at 4:12 PM, Oliver Keyes <okeyes@wikimedia.org> wrote:
Thanks Madhu! Awesome to see the transparency and announces around this :D.

Do you know how long the reimport should take on Monday? I want to
make sure I know when to expect we can safely launch all our scripts.

On 20 January 2016 at 13:08, Madhumitha Viswanathan
<mviswanathan@wikimedia.org> wrote:
> Hi all,
>
> In order to convert tables on db1046 to the TokuDB engine - we have to
> schedule some downtime on the Eventlogging databases between tomorrow,
> Thursday Jan 21, 2016 at 16:00 UTC to Monday Jan 25, 2016 16:00 UTC.
>
> What this means for EL users:
>
> 1. Eventlogging will still receive data and it will be available in Kafka.
> The data will continue to be imported into Hadoop and files.
> 2. The Mysql consumers of Eventlogging will be stopped, so no data will get
> imported into the master(db1046 or m4-master) and by extension to the
> analytics-store.
> 3. Querying existing data from analytics-store will still be available, but
> data for the next 4 days won't be available.
> 4. On Monday, after the maintenance window we'll restart the Mysql
> consumers, and all the data should get reimported from Kafka.
>
> Analytics and Ops(DBA) will work on this together.
>
> Feel free to reach out to us here or on #wikimedia-analytics if you have any
> concerns/questions.
>
>
> -- Madhu Viswanathan
> Software Engineer, Analytics
>
> _______________________________________________
> Engineering mailing list
> Engineering@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/engineering
>



--
Oliver Keyes
Count Logula
Wikimedia Foundation

_______________________________________________
Engineering mailing list
Engineering@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/engineering