Hey all,
You might notice some weird spikes in the dashboard data. This is caused by some duplicated days worth of data due to the stop-and-start of services we're dependent on. We expect to have it resolved by the end of the day.
Thanks!
thanks for the heads up
On Tue, Jan 19, 2016 at 10:44 AM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
You might notice some weird spikes in the dashboard data. This is caused by some duplicated days worth of data due to the stop-and-start of services we're dependent on. We expect to have it resolved by the end of the day.
Thanks!
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
It looks like there have been some issues in CirrusSearch since the train rolled forward last thursday, the 14th. Our logs to hadoop have been incomplete. This will be fixed in ~ 5 hours during the evening SWAT deploy.
On Tue, Jan 19, 2016 at 11:23 AM, Tomasz Finc tfinc@wikimedia.org wrote:
thanks for the heads up
On Tue, Jan 19, 2016 at 10:44 AM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
You might notice some weird spikes in the dashboard data. This is caused by some duplicated days worth of data due to the stop-and-start of services we're dependent on. We expect to have it resolved by the end of the day.
Thanks!
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
By incomplete, for clarity, we mean production rows are not getting through, only rows from the labs instance.
Erik, will the fix stream in just new rows or are the old rows cached somewhere? I expect the former.
On 19 January 2016 at 11:25, Erik Bernhardson ebernhardson@wikimedia.org wrote:
It looks like there have been some issues in CirrusSearch since the train rolled forward last thursday, the 14th. Our logs to hadoop have been incomplete. This will be fixed in ~ 5 hours during the evening SWAT deploy.
On Tue, Jan 19, 2016 at 11:23 AM, Tomasz Finc tfinc@wikimedia.org wrote:
thanks for the heads up
On Tue, Jan 19, 2016 at 10:44 AM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
You might notice some weird spikes in the dashboard data. This is caused by some duplicated days worth of data due to the stop-and-start of services we're dependent on. We expect to have it resolved by the end of the day.
Thanks!
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Oliver, re: question for Erik: former is correct. we have lost that data.
On Tue, Jan 19, 2016 at 11:46 AM, Oliver Keyes okeyes@wikimedia.org wrote:
By incomplete, for clarity, we mean production rows are not getting through, only rows from the labs instance.
Erik, will the fix stream in just new rows or are the old rows cached somewhere? I expect the former.
On 19 January 2016 at 11:25, Erik Bernhardson ebernhardson@wikimedia.org wrote:
It looks like there have been some issues in CirrusSearch since the train rolled forward last thursday, the 14th. Our logs to hadoop have been incomplete. This will be fixed in ~ 5 hours during the evening SWAT
deploy.
On Tue, Jan 19, 2016 at 11:23 AM, Tomasz Finc tfinc@wikimedia.org
wrote:
thanks for the heads up
On Tue, Jan 19, 2016 at 10:44 AM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
You might notice some weird spikes in the dashboard data. This is caused by some duplicated days worth of data due to the stop-and-start of services we're dependent on. We expect to have it resolved by the end of the day.
Thanks!
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Oliver Keyes, 19/01/2016 19:44:
You might notice some weird spikes in the dashboard data.
Are you talking of http://discovery-beta.wmflabs.org/maps/ too? Looks weird too.
Nemo
Actually, no, although I'll look into that.
On 19 January 2016 at 11:56, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Oliver Keyes, 19/01/2016 19:44:
You might notice some weird spikes in the dashboard data.
Are you talking of http://discovery-beta.wmflabs.org/maps/ too? Looks weird too.
Nemo
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
(I think we recently had maps launch in a new context, which would explain it. Yuri?)
On 19 January 2016 at 11:58, Oliver Keyes okeyes@wikimedia.org wrote:
Actually, no, although I'll look into that.
On 19 January 2016 at 11:56, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Oliver Keyes, 19/01/2016 19:44:
You might notice some weird spikes in the dashboard data.
Are you talking of http://discovery-beta.wmflabs.org/maps/ too? Looks weird too.
Nemo
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
-- Oliver Keyes Count Logula Wikimedia Foundation
Maps on en-wiki was launched, but later we had some pushback from a few community members and it was reverted - hence the spike. I'm still working on resolving it, but in the mean time, the graph data from Varnish looks like this: https://grafana.wikimedia.org/dashboard/db/service-maps-varnish
On Tue, Jan 19, 2016 at 10:58 PM, Oliver Keyes okeyes@wikimedia.org wrote:
(I think we recently had maps launch in a new context, which would explain it. Yuri?)
On 19 January 2016 at 11:58, Oliver Keyes okeyes@wikimedia.org wrote:
Actually, no, although I'll look into that.
On 19 January 2016 at 11:56, Federico Leva (Nemo) nemowiki@gmail.com
wrote:
Oliver Keyes, 19/01/2016 19:44:
You might notice some weird spikes in the dashboard data.
Are you talking of http://discovery-beta.wmflabs.org/maps/ too? Looks
weird
too.
Nemo
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
-- Oliver Keyes Count Logula Wikimedia Foundation
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Can you link to the discussions on enwiki around the initial launch and pushback?
On 19 January 2016 at 12:03, Yuri Astrakhan yastrakhan@wikimedia.org wrote:
Maps on en-wiki was launched, but later we had some pushback from a few community members and it was reverted - hence the spike. I'm still working on resolving it, but in the mean time, the graph data from Varnish looks like this: https://grafana.wikimedia.org/dashboard/db/service-maps-varnish
On Tue, Jan 19, 2016 at 10:58 PM, Oliver Keyes okeyes@wikimedia.org wrote:
(I think we recently had maps launch in a new context, which would explain it. Yuri?)
On 19 January 2016 at 11:58, Oliver Keyes okeyes@wikimedia.org wrote:
Actually, no, although I'll look into that.
On 19 January 2016 at 11:56, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Oliver Keyes, 19/01/2016 19:44:
You might notice some weird spikes in the dashboard data.
Are you talking of http://discovery-beta.wmflabs.org/maps/ too? Looks weird too.
Nemo
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
-- Oliver Keyes Count Logula Wikimedia Foundation
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
