Forwarding to the public Discovery list.

In summary, we're upgrading from Elasticsearch 1.7 to Elasticsearch 2.3. If everything goes according to plan, users should not notice us doing this. Stay tuned for more info. :-)

Thanks,
Dan

On 25 May 2016 at 05:22, Guillaume Lederrey <glederrey@wikimedia.org> wrote:
Hello all!

There was some communication and multiple phab tickets [1], but I want
to make sure the message is going through correctly. Let me know if
there are some more steps that needs to be taken in term of
communication. I will update the deployment page [2] with key actions
this evening (I'm waiting for a more detailed timing).

We are starting to upgrade Elasticsearch to version 2.3 this Thursday
(May 26). If all goes as planned, this should be entirely transparent
(but we all know what happens to the best laid plans).

Rough timeline:

May 26-27: upgrade Elasticsearch and Mediawiki on beta
May 30: upgrade Elasticsearch in codfw, search traffic sent to eqiad
May 31: upgrade Mediawiki (as part of the standard deploy train)
June 3-6: upgrade Elasticsearch in eqiad, search traffic sent to
codfw, send traffic back to normal routes once upgrade is completed

A more detailed timeline is available in phab [1].

Things to note:
* This change affect all extensions talking to Elasticsearch,
including Translate, ApiFeatures and GeoData
* New mediawiki code is compatible with Elasticsearch 2.3, but NOT
with 1.7. Rollback of that deployment means we have to also re route
traffic to a 1.7 Elasticsearch cluster.
* Logstash upgrade will be done in a different change (tracked in phab [3])
* We tested this as much as we could, but this is a major upgrade. The
Discovery search team will be available for fast patching of any issue
we find.

@Christopher: while we do not expect user impact, it might make sense
to send a more general warning about those operations to our
community. If only to let them know we are working hard to keep our
systems up to date. Let me know if you want to have a chat about that.

Thanks all for your patience!

  Guillaume


[1] https://phabricator.wikimedia.org/T133124 (and related)
[2] https://wikitech.wikimedia.org/wiki/Deployments
[3] https://phabricator.wikimedia.org/T136001

--
Guillaume Lederrey
Operations Engineer, Discovery
Wikimedia Foundation

_______________________________________________
discovery-private mailing list
discovery-private@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/discovery-private



--
Dan Garry
Lead Product Manager, Discovery
Wikimedia Foundation