I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I can get `echo_events` on x1-analytics-slave, but *not* on analytics-store; I can get `user` on analytics-store, but *not *on x1-analytics-slave. This makes it impossible to join the two.
Is there some other machine where both the tables are present? If not, is there a good reason for this split?
No, there's no other machine. The reason for the split is simply that any replication to analytics-store has to be approved and implemented by our DBA. You should make a request to Jaime Crespo to do this, or just export and import what you need into the staging db on analytics-store.
On Fri, Oct 9, 2015 at 4:26 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I can get `echo_events` on x1-analytics-slave, but *not* on analytics-store; I can get `user` on analytics-store, but *not *on x1-analytics-slave. This makes it impossible to join the two.
Is there some other machine where both the tables are present? If not, is there a good reason for this split?
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser.
Leila
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
IMO we should have echo and flow databases on analytics-store even if this use case is served by Event Logging data. The whole point of having so many databases replicated on that machine is to make for easy to do cross DB joins.
Neil, If you file a DBA task, please CC me. :)
On Fri, Oct 9, 2015 at 4:40 PM, Leila Zia leila@wikimedia.org wrote:
On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser.
Leila
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Okay, thanks everybody! I've filed the task https://phabricator.wikimedia.org/T115275.
Aaron, I just filed the task for the Echo databases, because I *think *Flow uses Cassandra, which couldn't be replicated to a MariaDB instance.
On Sat, Oct 10, 2015 at 8:30 AM, Aaron Halfaker ahalfaker@wikimedia.org wrote:
IMO we should have echo and flow databases on analytics-store even if this use case is served by Event Logging data. The whole point of having so many databases replicated on that machine is to make for easy to do cross DB joins.
Neil, If you file a DBA task, please CC me. :)
On Fri, Oct 9, 2015 at 4:40 PM, Leila Zia leila@wikimedia.org wrote:
On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser.
Leila
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
I take that back—Flow stores its info in a global MariaDB database called `flowdb`. At any rate, I didn't include that in the task.
On Mon, Oct 12, 2015 at 11:30 AM, Neil P. Quinn nquinn@wikimedia.org wrote:
Okay, thanks everybody! I've filed the task https://phabricator.wikimedia.org/T115275.
Aaron, I just filed the task for the Echo databases, because I *think *Flow uses Cassandra, which couldn't be replicated to a MariaDB instance.
On Sat, Oct 10, 2015 at 8:30 AM, Aaron Halfaker ahalfaker@wikimedia.org wrote:
IMO we should have echo and flow databases on analytics-store even if this use case is served by Event Logging data. The whole point of having so many databases replicated on that machine is to make for easy to do cross DB joins.
Neil, If you file a DBA task, please CC me. :)
On Fri, Oct 9, 2015 at 4:40 PM, Leila Zia leila@wikimedia.org wrote:
On Fri, Oct 9, 2015 at 1:26 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
I'm trying to gather some stats on the use of Echo notifications across wikis, and I'd like to join the `echo_events` table with the `user` table for a given wiki.
I'm not sure what kind of information you need but there is a chance that they are captured via schema in which case you can get them from Echo schema in log database and then join that with enwiki.user. I'm also not sure what info you need from enwiki.user, you may be able to get more global info from centralauth.globaluser.
Leila
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation