https://phabricator.wikimedia.org/T76671 has been open for a while. We
are just not sure how to deal with it.

I'm a bit confused why MobileWebDiffClickTracking is so big. It should
be tiny compared to the other tables. MobileWebClickTracking is the
nasty one.

For some reason I'm having issues sshing into stat1003 to explore further.

On Mon, Dec 22, 2014 at 9:33 AM, Dan Garry <dgarry@wikimedia.org> wrote:
> There is over six months of data in MobileWebClickTracking_5929948. Maryana,
> maybe the older data could be purged as well? That'd probably speed up the
> queries.
>
> Dan
>
> On 22 December 2014 at 09:29, Maryana Pinchuk <mpinchuk@wikimedia.org>
> wrote:
>>
>> Thanks for the heads up -- the MobileWebDiffClickTracking schema has
>> gotten way too big to query, it looks like. We'll figure out a way to break
>> it up into more manageable chunks so it doesn't cause issues like this.
>>
>>
>>
>> On Dec 22, 2014, at 7:57 AM, Nuria Ruiz <nuria@wikimedia.org> wrote:
>>
>> Adding mobile tech so they are aware, I am guessing we need to query for
>> that data in a more efficient fashion.
>>
>>
>>
>> On Mon, Dec 22, 2014 at 4:10 AM, Sean Pringle <springle@wikimedia.org>
>> wrote:
>>>
>>> Had to kill queries, lest analytics-store grind to a halt and take even
>>> longer to recover.
>>>
>>> These ones: https://gerrit.wikimedia.org/r/#/c/178381/
>>>
>>> On Sun, Dec 21, 2014 at 8:09 PM, Sean Pringle <springle@wikimedia.org>
>>> wrote:
>>>>
>>>> This last few days analytics-store replication has started to lag by
>>>> some hours. Currently s1 (enwiki) and s5 (dewiki, wikidatawiki) are most
>>>> affected. Eventlogging is not lagging, due to the nicely batched writes it
>>>> does now-a-days :-)
>>>>
>>>> There are many slow queries running from the research user on stat1003,
>>>> referencing eventlogging tables like MobileWebDiffClickTracking*.
>>>>
>>>> I'm not sure who belongs to them, or if they're new, or if they're safe
>>>> to kill, so this is mainly a heads-up email. Let us know if ops should kill
>>>> stuff to let the box catch up again.
>>>>
>>>> BR
>>>> Sean
>>>> --
>>>> DBA @ WMF
>>>
>>>
>>>
>>> --
>>> DBA @ WMF
>>>
>>> _______________________________________________
>>> Analytics mailing list
>>> Analytics@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/analytics
>>>
>>
>
>
>
> --
> Dan Garry
> Associate Product Manager, Mobile Apps
> Wikimedia Foundation

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics