> > > We
> > > could start with a spike investigating if there is a framework for

> > > aggregating the sums [...]

Our approaches are hard-wired into our legacy code. So we do not use a
common, solid framework for it.

I haven't done any research on whether or not such frameworks
exist. But if you find some good framework, please let us know, it
would certainly be interesting.

There are certainly products like Cassandra and Spark that make working with big (or bunches of small) data easy and fast.

There are more sophisticated but less mature products like Druid that work with dimensional data.

We have solid options, we just have to decide that this is a priority and move on it.  The pageviews API sprint was nice but we abandoned it after a week of work because of changed priorities.