Hello,
Please see preliminary goals for the analytics infrastructure team next quarter. Replies to this thread with suggestions and feedback are welcome.
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q3_Goals#Analyt...
Thanks,
Nuria
Hi Nuria, Thank you for publishing your draft so early and requesting feedback. I apologize for being so late in responding--the short holiday week caused a serious backlog on my end.
For now, I only have a preliminary prioritized list of reading requests for analytics in Q3 (and beyond). I can confirm by Friday. The following are in order of priority
- Pywik up and running for iOS (simple machine spin-up, if not finished in Q2) - Input pageview data into tableau or some other non-query table maker - 'is_spider' column in event logs (Based on regex of user agent- based on conversation with Madhu and Kevin, I know its not going to get most of the bots) - App session tables split by OS (per ticket: T117615 https://phabricator.wikimedia.org/T117615) - Browser reports you mention in your current priorities (this is low for us if it is in hive already, though you probably have other stakeholders) - connection speed field...somewhere ;)
I'd be happy to discuss more either via chat or email. Best,
J
On Tue, Nov 24, 2015 at 8:49 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Hello,
Please see preliminary goals for the analytics infrastructure team next quarter. Replies to this thread with suggestions and feedback are welcome.
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q3_Goals#Analyt...
Thanks,
Nuria
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Why is the pageviews goal centred on "keeping the lights up" rather than new features? Is resourcing so limited keeping the lights on is the best we can do?
On 3 December 2015 at 03:59, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Jon Katz, 03/12/2015 06:16:
Pywik up and running for iOS (simple machine spin-up, if not finished in Q2)
What is meant here by "Pywik"? Piwik? Some shortening of pywikibot? Other?
Nemo
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
To be clear, I do not by this mean "survivability is bad", I mean "survivability is good but are there resourcing reasons it is the only goal, as opposed to part of a wider one?"
On 3 December 2015 at 07:38, Oliver Keyes okeyes@wikimedia.org wrote:
Why is the pageviews goal centred on "keeping the lights up" rather than new features? Is resourcing so limited keeping the lights on is the best we can do?
On 3 December 2015 at 03:59, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Jon Katz, 03/12/2015 06:16:
Pywik up and running for iOS (simple machine spin-up, if not finished in Q2)
What is meant here by "Pywik"? Piwik? Some shortening of pywikibot? Other?
Nemo
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Oliver Keyes Count Logula Wikimedia Foundation
Why is the pageviews goal centred on "keeping the lights up"
Because a new service deployed always needs mainatenance regarding availability, monitoring and correction of operational bugs and that comes before new feature deployment. Let me give you an example: Pageview API now has less that desirable response times cause it is running without proper caching (https://phabricator.wikimedia.org/T119886). Issues such as this one need to be addressed before adding new features.
That is not to say we are not listening to our users, we have a session at the mediawiki summit arround Pageview API and that is the time to bring your new feature requests. We will see common patterns, evaluate our storage budget and then prioritize features accordingly. See: https://phabricator.wikimedia.org/T112956
Hopefully this makes sense.
On Thu, Dec 3, 2015 at 4:38 AM, Oliver Keyes okeyes@wikimedia.org wrote:
Why is the pageviews goal centred on "keeping the lights up" rather than new features? Is resourcing so limited keeping the lights on is the best we can do?
On 3 December 2015 at 03:59, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Jon Katz, 03/12/2015 06:16:
Pywik up and running for iOS (simple machine spin-up, if not finished in Q2)
What is meant here by "Pywik"? Piwik? Some shortening of pywikibot?
Other?
Nemo
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Oliver Keyes Count Logula Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Nemo: This is it: http://piwik.org/
On Thu, Dec 3, 2015 at 12:59 AM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Jon Katz, 03/12/2015 06:16:
Pywik up and running for iOS (simple machine spin-up, if not finished in Q2)
What is meant here by "Pywik"? Piwik? Some shortening of pywikibot? Other?
Nemo
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Some thoughts below (we will be creating tickets for some of these so we do not forget)
connection speed field...somewhere ;)
I think many teams will benefit from this one but as far as I can see there is no way to get this info (and it being correct) at this time. Performance team just recently opened a ticket in this regard and we saw it was not possible. See: https://phabricator.wikimedia.org/T119801 and http://www.w3.org/TR/netinfo-api/
'is_spider' column in event logs (Based on regex of user agent- based on
conversation with Madhu and Kevin, I know its not going to get most of the bots For eventlogging data? On the contrary, it will get most of the bot traffic. This is not true of our pageview data and I can explain in more detail via IRC why is that. Please let me know if I misunderstood this referring to EL.
App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615) Agreed. This should be part of the background work we do that is not related to goals.
.>Piwik up and running for iOS (simple machine spin-up, if not finished in Q2) This would be very useful for other things besides IOS but it is harder than it looks as holding production data requires proper infrastructure (to be able to abide to our privacy policy) and to be honest I do not think we can get there next quarter. I think Dan can add more detail here as we have tried to use Piwik before outside labs w/o success.
Input pageview data into tableau or some other non-query table maker
Need to think more about this use case.
On Wed, Dec 2, 2015 at 9:16 PM, Jon Katz jkatz@wikimedia.org wrote:
Hi Nuria, Thank you for publishing your draft so early and requesting feedback. I apologize for being so late in responding--the short holiday week caused a serious backlog on my end.
For now, I only have a preliminary prioritized list of reading requests for analytics in Q3 (and beyond). I can confirm by Friday. The following are in order of priority
- Pywik up and running for iOS (simple machine spin-up, if not
finished in Q2)
- Input pageview data into tableau or some other non-query table maker
- 'is_spider' column in event logs (Based on regex of user agent-
based on conversation with Madhu and Kevin, I know its not going to get most of the bots)
- App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615)
- Browser reports you mention in your current priorities (this is low
for us if it is in hive already, though you probably have other stakeholders)
- connection speed field...somewhere ;)
I'd be happy to discuss more either via chat or email. Best,
J
On Tue, Nov 24, 2015 at 8:49 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Hello,
Please see preliminary goals for the analytics infrastructure team next quarter. Replies to this thread with suggestions and feedback are welcome.
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q3_Goals#Analyt...
Thanks,
Nuria
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Hi Nuria, Thank you for looking at these. I think your assessment is a fair representation of the asks. Just adding a new one (in green).
- Pywik up and running for iOS (simple machine spin-up, if not finished in Q2) - Input pageview data into tableau or some other non-query table maker - 'is_spider' column in event logs (Based on regex of user agent- based on conversation with Madhu and Kevin, I know its not going to get most of the bots) - App session tables split by OS (per ticket: T117615 https://phabricator.wikimedia.org/T117615) - Time on site (per: T119352 https://phabricator.wikimedia.org/T119352 ) - Browser reports you mention in your current priorities (this is low for us if it is in hive already, though you probably have other stakeholders) - connection speed field...somewhere ;)
Also, to be clear, I am assuming that: Unique users/sessions are considered to be outside the scope of this prioritization. Let me know if I'm mistaken. I believe Toby will be scheduling some time to talk through the above at some point as well.
-J
On Thu, Dec 3, 2015 at 8:55 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Some thoughts below (we will be creating tickets for some of these so we do not forget)
connection speed field...somewhere ;)
I think many teams will benefit from this one but as far as I can see there is no way to get this info (and it being correct) at this time. Performance team just recently opened a ticket in this regard and we saw it was not possible. See: https://phabricator.wikimedia.org/T119801 and http://www.w3.org/TR/netinfo-api/
'is_spider' column in event logs (Based on regex of user agent- based on
conversation with Madhu and Kevin, I know its not going to get most of the bots For eventlogging data? On the contrary, it will get most of the bot traffic. This is not true of our pageview data and I can explain in more detail via IRC why is that. Please let me know if I misunderstood this referring to EL.
App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615) Agreed. This should be part of the background work we do that is not related to goals.
.>Piwik up and running for iOS (simple machine spin-up, if not finished in Q2) This would be very useful for other things besides IOS but it is harder than it looks as holding production data requires proper infrastructure (to be able to abide to our privacy policy) and to be honest I do not think we can get there next quarter. I think Dan can add more detail here as we have tried to use Piwik before outside labs w/o success.
Input pageview data into tableau or some other non-query table maker
Need to think more about this use case.
On Wed, Dec 2, 2015 at 9:16 PM, Jon Katz jkatz@wikimedia.org wrote:
Hi Nuria, Thank you for publishing your draft so early and requesting feedback. I apologize for being so late in responding--the short holiday week caused a serious backlog on my end.
For now, I only have a preliminary prioritized list of reading requests for analytics in Q3 (and beyond). I can confirm by Friday. The following are in order of priority
- Pywik up and running for iOS (simple machine spin-up, if not
finished in Q2)
- Input pageview data into tableau or some other non-query table maker
- 'is_spider' column in event logs (Based on regex of user agent-
based on conversation with Madhu and Kevin, I know its not going to get most of the bots)
- App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615)
- Browser reports you mention in your current priorities (this is low
for us if it is in hive already, though you probably have other stakeholders)
- connection speed field...somewhere ;)
I'd be happy to discuss more either via chat or email. Best,
J
On Tue, Nov 24, 2015 at 8:49 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Hello,
Please see preliminary goals for the analytics infrastructure team next quarter. Replies to this thread with suggestions and feedback are welcome.
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q3_Goals#Analyt...
Thanks,
Nuria
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Time on site (per: T119352 https://phabricator.wikimedia.org/T119352)
While analytics team can surface this metric if available we are not the ones to implement it. The methodology suggested by Gabriel has many caveats and it should be up to product teams (with FYI to performance) to decide whether/how they want to use it. I think metrics on that regard can be stored on eventlogging easily.
On Fri, Dec 4, 2015 at 12:25 PM, Jon Katz jkatz@wikimedia.org wrote:
Hi Nuria, Thank you for looking at these. I think your assessment is a fair representation of the asks. Just adding a new one (in green).
- Pywik up and running for iOS (simple machine spin-up, if not
finished in Q2)
- Input pageview data into tableau or some other non-query table maker
- 'is_spider' column in event logs (Based on regex of user agent-
based on conversation with Madhu and Kevin, I know its not going to get most of the bots)
- App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615)
- Time on site (per: T119352
https://phabricator.wikimedia.org/T119352)
- Browser reports you mention in your current priorities (this is low
for us if it is in hive already, though you probably have other stakeholders)
- connection speed field...somewhere ;)
Also, to be clear, I am assuming that: Unique users/sessions are considered to be outside the scope of this prioritization. Let me know if I'm mistaken. I believe Toby will be scheduling some time to talk through the above at some point as well.
-J
On Thu, Dec 3, 2015 at 8:55 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Some thoughts below (we will be creating tickets for some of these so we do not forget)
connection speed field...somewhere ;)
I think many teams will benefit from this one but as far as I can see there is no way to get this info (and it being correct) at this time. Performance team just recently opened a ticket in this regard and we saw it was not possible. See: https://phabricator.wikimedia.org/T119801 and http://www.w3.org/TR/netinfo-api/
'is_spider' column in event logs (Based on regex of user agent- based
on conversation with Madhu and Kevin, I know its not going to get most of the bots For eventlogging data? On the contrary, it will get most of the bot traffic. This is not true of our pageview data and I can explain in more detail via IRC why is that. Please let me know if I misunderstood this referring to EL.
App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615) Agreed. This should be part of the background work we do that is not related to goals.
.>Piwik up and running for iOS (simple machine spin-up, if not finished in Q2) This would be very useful for other things besides IOS but it is harder than it looks as holding production data requires proper infrastructure (to be able to abide to our privacy policy) and to be honest I do not think we can get there next quarter. I think Dan can add more detail here as we have tried to use Piwik before outside labs w/o success.
Input pageview data into tableau or some other non-query table maker
Need to think more about this use case.
On Wed, Dec 2, 2015 at 9:16 PM, Jon Katz jkatz@wikimedia.org wrote:
Hi Nuria, Thank you for publishing your draft so early and requesting feedback. I apologize for being so late in responding--the short holiday week caused a serious backlog on my end.
For now, I only have a preliminary prioritized list of reading requests for analytics in Q3 (and beyond). I can confirm by Friday. The following are in order of priority
- Pywik up and running for iOS (simple machine spin-up, if not
finished in Q2)
- Input pageview data into tableau or some other non-query table
maker
- 'is_spider' column in event logs (Based on regex of user agent-
based on conversation with Madhu and Kevin, I know its not going to get most of the bots)
- App session tables split by OS (per ticket: T117615
https://phabricator.wikimedia.org/T117615)
- Browser reports you mention in your current priorities (this is
low for us if it is in hive already, though you probably have other stakeholders)
- connection speed field...somewhere ;)
I'd be happy to discuss more either via chat or email. Best,
J
On Tue, Nov 24, 2015 at 8:49 AM, Nuria Ruiz nuria@wikimedia.org wrote:
Hello,
Please see preliminary goals for the analytics infrastructure team next quarter. Replies to this thread with suggestions and feedback are welcome.
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q3_Goals#Analyt...
Thanks,
Nuria
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics