Echo databases on analytics-store? - Analytics

Dan Andreescu

9 Oct 9 Oct

8:28 p.m.

No, there's no other machine. The reason for the split is simply that any replication to analytics-store has to be approved and implemented by our DBA. You should make a request to Jaime Crespo to do this, or just export and import what you need into the staging db on analytics-store. On Fri, Oct 9, 2015 at 4:26 PM, Neil P. Quinn <nquinn(a)wikimedia.org> wrote:

...

I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki. I can get `echo_events` on x1-analytics-slave, but *not* on analytics-store; I can get `user` on analytics-store, but *not *on x1-analytics-slave. This makes it impossible to join the two. Is there some other machine where both the tables are present? If not, is there a good reason for this split? -- Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>, product analyst Wikimedia Foundation _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Reply

Aaron Halfaker

10 Oct 10 Oct

3:30 p.m.

IMO we should have echo and flow databases on analytics-store even if this use case is served by Event Logging data. The whole point of having so many databases replicated on that machine is to make for easy to do cross DB joins. Neil, If you file a DBA task, please CC me. :) On Fri, Oct 9, 2015 at 4:40 PM, Leila Zia <leila(a)wikimedia.org> wrote:

...

On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn <nquinn(a)wikimedia.org> wrote:

I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.

I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser. Leila

-- Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>, product analyst Wikimedia Foundation _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Reply

Neil P. Quinn

6:32 p.m.

I take that back—Flow stores its info in a global MariaDB database called `flowdb`. At any rate, I didn't include that in the task. On Mon, Oct 12, 2015 at 11:30 AM, Neil P. Quinn <nquinn(a)wikimedia.org> wrote:

...

Okay, thanks everybody! I've filed the task <https://phabricator.wikimedia.org/T115275>. Aaron, I just filed the task for the Echo databases, because I *think *Flow uses Cassandra, which couldn't be replicated to a MariaDB instance. On Sat, Oct 10, 2015 at 8:30 AM, Aaron Halfaker <ahalfaker(a)wikimedia.org> wrote:

IMO we should have echo and flow databases on analytics-store even if this use case is served by Event Logging data. The whole point of having so many databases replicated on that machine is to make for easy to do cross DB joins. Neil, If you file a DBA task, please CC me. :) On Fri, Oct 9, 2015 at 4:40 PM, Leila Zia <leila(a)wikimedia.org> wrote:

On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn <nquinn(a)wikimedia.org> wrote:

I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.

I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser. Leila

-- Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>, product analyst Wikimedia Foundation _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>, product analyst Wikimedia Foundation

Reply