Hi all!
We just finished https://phabricator.wikimedia.org/T269160 setting up an internal instance of EventStreams called eventstreams-internal. This instance is not public, but does expose all streams declared in stream config*.
I've added documentation about how to access this here: https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In...
This instance isn't particularly useful for building any services (in production you should just consume from Kafka), but it may be very useful for debugging and troubleshooting events in production. EventStreams has a GUI that will allow you to see events in Kafka as they flow in. In production, this will allow you to see events right after they are emitted, without having to wait a few hours for them to be ingested into Hive. You can use this to make sure events you trigger in production make it through EventGate into Kafka as you expect.
Big thanks to Marcel and Luca for their work on this! :)
- Andrew Otto
* i.e. those that use Event Platform, not legacy EventLogging events.
Oh, I mean to include a screenshot :) Here's consuming the eventlogging_QuickSurveyInitiation stream:
[image: Screen Shot 2021-02-04 at 14.18.00.jpg]
On Thu, Feb 4, 2021 at 2:16 PM Andrew Otto otto@wikimedia.org wrote:
Hi all!
We just finished https://phabricator.wikimedia.org/T269160 setting up an internal instance of EventStreams called eventstreams-internal. This instance is not public, but does expose all streams declared in stream config*.
I've added documentation about how to access this here:
https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In...
This instance isn't particularly useful for building any services (in production you should just consume from Kafka), but it may be very useful for debugging and troubleshooting events in production. EventStreams has a GUI that will allow you to see events in Kafka as they flow in. In production, this will allow you to see events right after they are emitted, without having to wait a few hours for them to be ingested into Hive. You can use this to make sure events you trigger in production make it through EventGate into Kafka as you expect.
Big thanks to Marcel and Luca for their work on this! :)
- Andrew Otto
- i.e. those that use Event Platform, not legacy EventLogging events.
Awesome! can't wait to try it out :) Huge thanks to the Analytics team :)
On Thu, Feb 4, 2021 at 11:17 AM Andrew Otto otto@wikimedia.org wrote:
Hi all!
We just finished https://phabricator.wikimedia.org/T269160 setting up an internal instance of EventStreams called eventstreams-internal. This instance is not public, but does expose all streams declared in stream config*.
I've added documentation about how to access this here:
https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In...
This instance isn't particularly useful for building any services (in production you should just consume from Kafka), but it may be very useful for debugging and troubleshooting events in production. EventStreams has a GUI that will allow you to see events in Kafka as they flow in. In production, this will allow you to see events right after they are emitted, without having to wait a few hours for them to be ingested into Hive. You can use this to make sure events you trigger in production make it through EventGate into Kafka as you expect.
Big thanks to Marcel and Luca for their work on this! :)
- Andrew Otto
- i.e. those that use Event Platform, not legacy EventLogging events.
-- Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
- i.e. those that use Event Platform, not legacy EventLogging events.
Quick correction, to this asterisk: 'migrated' legacy EventLogging events do use Event Platform stuff, and so are available in eventstrerams-internal.
:)
On Fri, Feb 5, 2021 at 3:52 AM Maya Kampurath mkampurath@wikimedia.org wrote:
Awesome! can't wait to try it out :) Huge thanks to the Analytics team :)
On Thu, Feb 4, 2021 at 11:17 AM Andrew Otto otto@wikimedia.org wrote:
Hi all!
We just finished https://phabricator.wikimedia.org/T269160 setting up an internal instance of EventStreams called eventstreams-internal. This instance is not public, but does expose all streams declared in stream config*.
I've added documentation about how to access this here:
https://wikitech.wikimedia.org/wiki/Event_Platform/Instrumentation_How_To#In...
This instance isn't particularly useful for building any services (in production you should just consume from Kafka), but it may be very useful for debugging and troubleshooting events in production. EventStreams has a GUI that will allow you to see events in Kafka as they flow in. In production, this will allow you to see events right after they are emitted, without having to wait a few hours for them to be ingested into Hive. You can use this to make sure events you trigger in production make it through EventGate into Kafka as you expect.
Big thanks to Marcel and Luca for their work on this! :)
- Andrew Otto
- i.e. those that use Event Platform, not legacy EventLogging events.
-- Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
--
Thanks, Maya Analyst, Product Analytics https://www.mediawiki.org/wiki/Product_Analytics Wikimedia Foundation
https://wikimediafoundation.org/
Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
analytics-announce@lists.wikimedia.org
