Forwarding to the public Discovery list.
In summary, we're upgrading from Elasticsearch 1.7 to Elasticsearch 2.3. If everything goes according to plan, users should not notice us doing this. Stay tuned for more info. :-)
Thanks, Dan
On 25 May 2016 at 05:22, Guillaume Lederrey glederrey@wikimedia.org wrote:
Hello all!
There was some communication and multiple phab tickets [1], but I want to make sure the message is going through correctly. Let me know if there are some more steps that needs to be taken in term of communication. I will update the deployment page [2] with key actions this evening (I'm waiting for a more detailed timing).
We are starting to upgrade Elasticsearch to version 2.3 this Thursday (May 26). If all goes as planned, this should be entirely transparent (but we all know what happens to the best laid plans).
Rough timeline:
May 26-27: upgrade Elasticsearch and Mediawiki on beta May 30: upgrade Elasticsearch in codfw, search traffic sent to eqiad May 31: upgrade Mediawiki (as part of the standard deploy train) June 3-6: upgrade Elasticsearch in eqiad, search traffic sent to codfw, send traffic back to normal routes once upgrade is completed
A more detailed timeline is available in phab [1].
Things to note:
- This change affect all extensions talking to Elasticsearch,
including Translate, ApiFeatures and GeoData
- New mediawiki code is compatible with Elasticsearch 2.3, but NOT
with 1.7. Rollback of that deployment means we have to also re route traffic to a 1.7 Elasticsearch cluster.
- Logstash upgrade will be done in a different change (tracked in phab [3])
- We tested this as much as we could, but this is a major upgrade. The
Discovery search team will be available for fast patching of any issue we find.
@Christopher: while we do not expect user impact, it might make sense to send a more general warning about those operations to our community. If only to let them know we are working hard to keep our systems up to date. Let me know if you want to have a chat about that.
Thanks all for your patience!
Guillaume
[1] https://phabricator.wikimedia.org/T133124 (and related) [2] https://wikitech.wikimedia.org/wiki/Deployments [3] https://phabricator.wikimedia.org/T136001
-- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation
discovery-private mailing list discovery-private@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery-private