Alright, we are now ready to do this. New date: June 14 2018, around 14:00 UTC.
On Tue, Jun 5, 2018 at 9:31 AM, Andrew Otto otto@wikimedia.org wrote:
Hi,
We need to delay this switchover. We’ve made some changes to the plan that require a bit more prep work. Follow https://phabricator. wikimedia.org/T185225 for more details.
I’ll reply with another announcement email when we set a new date.
- Andrew Otto Senior Systems Engineer, WMF
On Tue, May 15, 2018 at 11:43 AM, Andrew Otto otto@wikimedia.org wrote:
Hi all!
*If you are not an active user of the EventStreams service, you can ignore this email.*
We’re in the process of upgrading https://phabricator.wikimedia.org/T152015 the backend infrastructure that powers the EventStreams service. When we switch EventStreams to the new infrastructure https://phabricator.wikimedia.org/T185225, the ‘offsets’ AKA Last-Event-IDs will change.
Connected EventStreams SSE clients will reconnect and not be able to automatically consume from the exact position in the stream where they left off. Instead, reconnecting clients will begin consuming from the latest messages in the stream. This means that connected clients will likely miss any messages that occurred during the reconnect period. Hopefully this will be a very small number of messages, as your SSE client should reconnect quickly.
This switch is scheduled to happen on June 5 2018, at around 17:30 UTC.
Let us know if you have any questions.
Thanks!
- Andrew Otto Senior Systems Engineer, WMF
It looks like the pageviews dump for 2018-06-14 hour 12 is missing on
https://dumps.wikimedia.org/other/pageviews/2018/2018-06/
Possibly related to this change?
From: Analytics analytics-bounces@lists.wikimedia.org on behalf of Andrew Otto otto@wikimedia.org Reply-To: "A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics." analytics@lists.wikimedia.org Date: Tuesday, June 12, 2018 at 2:35 PM To: "A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics." analytics@lists.wikimedia.org, Services Mailing List services@lists.wikimedia.org, Internal discussion of WMF Research Team research-internal@lists.wikimedia.org, Research into Wikimedia content and communities wiki-research-l@lists.wikimedia.org, "huggle@lists.wikimedia.org" huggle@lists.wikimedia.org, "pywikibot-announce@lists.wikimedia.org" pywikibot-announce@lists.wikimedia.org, "mediawiki-api-announce@lists.wikimedia.org" mediawiki-api-announce@lists.wikimedia.org, Operations LIst ops@lists.wikimedia.org Subject: [Analytics] EventStreams offset reset - June 14 2018
Alright, we are now ready to do this. New date: June 14 2018, around 14:00 UTC.
On Tue, Jun 5, 2018 at 9:31 AM, Andrew Otto <otto@wikimedia.orgmailto:otto@wikimedia.org> wrote: Hi,
We need to delay this switchover. We’ve made some changes to the plan that require a bit more prep work. Follow https://phabricator.wikimedia.org/T185225https://urldefense.proofpoint.com/v2/url?u=https-3A__phabricator.wikimedia.org_T185225&d=DwMFaQ&c=gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=XYb0dICC34f7i19sp8q3kXzrSJMkWJPZqcu5o_ACx1c&m=kbEBLIedzcmqhbAKl1o4w_UaOXCI7jEjzow7VfHG58c&s=-6WHYdlOeJJx-mP66KxQK3zvCOc9TxUncTy9nnNxG1E&e= for more details.
I’ll reply with another announcement email when we set a new date.
- Andrew Otto Senior Systems Engineer, WMF
On Tue, May 15, 2018 at 11:43 AM, Andrew Otto <otto@wikimedia.orgmailto:otto@wikimedia.org> wrote: Hi all!
If you are not an active user of the EventStreams service, you can ignore this email.
We’re in the process of upgradinghttps://urldefense.proofpoint.com/v2/url?u=https-3A__phabricator.wikimedia.org_T152015&d=DwMFaQ&c=gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=XYb0dICC34f7i19sp8q3kXzrSJMkWJPZqcu5o_ACx1c&m=kbEBLIedzcmqhbAKl1o4w_UaOXCI7jEjzow7VfHG58c&s=liwOKh6qZp7X591FC77JTa0pvnHzIWgLwrS5tWNATJk&e= the backend infrastructure that powers the EventStreams service. When we switch EventStreams to the new infrastructurehttps://urldefense.proofpoint.com/v2/url?u=https-3A__phabricator.wikimedia.org_T185225&d=DwMFaQ&c=gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=XYb0dICC34f7i19sp8q3kXzrSJMkWJPZqcu5o_ACx1c&m=kbEBLIedzcmqhbAKl1o4w_UaOXCI7jEjzow7VfHG58c&s=-6WHYdlOeJJx-mP66KxQK3zvCOc9TxUncTy9nnNxG1E&e=, the ‘offsets’ AKA Last-Event-IDs will change.
Connected EventStreams SSE clients will reconnect and not be able to automatically consume from the exact position in the stream where they left off. Instead, reconnecting clients will begin consuming from the latest messages in the stream. This means that connected clients will likely miss any messages that occurred during the reconnect period. Hopefully this will be a very small number of messages, as your SSE client should reconnect quickly.
This switch is scheduled to happen on June 5 2018, at around 17:30 UTC.
Let us know if you have any questions.
Thanks! - Andrew Otto Senior Systems Engineer, WMF