[Engineering] Eventlogging Mysql consumers downtime

[Andrew Otto]

FYI, This has started.  I have turned off the MySQL processes.  No new data
will be inserted into MySQL until we turn them back on.

On Wed, Jan 20, 2016 at 4:43 PM, Andrew Otto <otto at wikimedia.org> wrote:

> (+Jaime)
>
> It’s hard to tell how long it will take, but I imagine for quite a while.
> I guess a day max, but probably much less.  If Jaime let’s me know that
> he’s finished early, and I am close enough to a computer, I’ll turn the
> EventLogging MySQL processes back on asap.
>
>
>
> On Wed, Jan 20, 2016 at 4:12 PM, Oliver Keyes <okeyes at wikimedia.org>
> wrote:
>
>> Thanks Madhu! Awesome to see the transparency and announces around this
>> :D.
>>
>> Do you know how long the reimport should take on Monday? I want to
>> make sure I know when to expect we can safely launch all our scripts.
>>
>> On 20 January 2016 at 13:08, Madhumitha Viswanathan
>> <mviswanathan at wikimedia.org> wrote:
>> > Hi all,
>> >
>> > In order to convert tables on db1046 to the TokuDB engine - we have to
>> > schedule some downtime on the Eventlogging databases between tomorrow,
>> > Thursday Jan 21, 2016 at 16:00 UTC to Monday Jan 25, 2016 16:00 UTC.
>> >
>> > What this means for EL users:
>> >
>> > 1. Eventlogging will still receive data and it will be available in
>> Kafka.
>> > The data will continue to be imported into Hadoop and files.
>> > 2. The Mysql consumers of Eventlogging will be stopped, so no data will
>> get
>> > imported into the master(db1046 or m4-master) and by extension to the
>> > analytics-store.
>> > 3. Querying existing data from analytics-store will still be available,
>> but
>> > data for the next 4 days won't be available.
>> > 4. On Monday, after the maintenance window we'll restart the Mysql
>> > consumers, and all the data should get reimported from Kafka.
>> >
>> > Analytics and Ops(DBA) will work on this together.
>> >
>> > Feel free to reach out to us here or on #wikimedia-analytics if you
>> have any
>> > concerns/questions.
>> >
>> >
>> > -- Madhu Viswanathan
>> > Software Engineer, Analytics
>> >
>> > _______________________________________________
>> > Engineering mailing list
>> > Engineering at lists.wikimedia.org
>> > https://lists.wikimedia.org/mailman/listinfo/engineering
>> >
>>
>>
>>
>> --
>> Oliver Keyes
>> Count Logula
>> Wikimedia Foundation
>>
>> _______________________________________________
>> Engineering mailing list
>> Engineering at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/engineering
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/engineering/attachments/20160121/34213882/attachment.html>