Hey all,
We currently have a data outage on our dashboards - they display, but we're missing the last few days.
The good news is that we know exactly what happened here; as part of our work to (amusingly enough) make the data pipeline here more robust and standardised, we switched all of our data retrieval scripts over to a new project and repository (previously they'd lived in the repo for the dashboard they referred to, which doesn't scale). A bug in the shell script that tied them all together meant none of them ran - and of course we switched everything over immediately before a long weekend. Doh ;p.
The original bug has a patchset in awaiting review, and as soon as it's +2d we're going to begin backfilling the datasets. You can follow our progress on that at https://phabricator.wikimedia.org/T111749
Thanks,
Hey all,
After a longer-than-expected deployment process to fix a couple of bugs, I'm pleased to report all the backfilling is done and we have a new version of the dashboard out. Amongst other things, this includes a fix to a bug whereby the KPI infoboxes were displaying the wrong values - thanks to Kevin for pointing it out - and a new feature whereby you can select the range of time that KPI averages are computed over. The next feature is smoothing, which will let you see how the dashboard data averages out over a week, month or quarter.
Thanks,
On 7 September 2015 at 21:07, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
We currently have a data outage on our dashboards - they display, but we're missing the last few days.
The good news is that we know exactly what happened here; as part of our work to (amusingly enough) make the data pipeline here more robust and standardised, we switched all of our data retrieval scripts over to a new project and repository (previously they'd lived in the repo for the dashboard they referred to, which doesn't scale). A bug in the shell script that tied them all together meant none of them ran - and of course we switched everything over immediately before a long weekend. Doh ;p.
The original bug has a patchset in awaiting review, and as soon as it's +2d we're going to begin backfilling the datasets. You can follow our progress on that at https://phabricator.wikimedia.org/T111749
Thanks,
-- Oliver Keyes Count Logula Wikimedia Foundation
wikimedia-search@lists.wikimedia.org