Hi all,
The Toolforge Elasticsearch cluster is being replaced with a cluster based on OpenSearch v2[0]. If your tool uses the writable Elastic/OpenSearch functionality you will need to manually migrate your tool to the new cluster as described in the rest of this email. (Note that this is different from the "Cloud Elastic" service which provides read-only access to the search indexes of Wikimedia wikis.)
The Wikitech page[0] has been updated with the details of the new cluster, which are almost identical to the previous cluster except the hostname and software version used. The same set of credentials will also work on the new cluster. There are, however, some breaking API changes between the old version and the new one, which is why we are not just migrating all indexes for all tools at once.
To help migrate data from the old cluster to the new one, we have temporarily added a `toolforge migrate-index` command to the bastion servers to copy over an index and its mappings, aliases and replication settings. The tool takes a space-separated list of indexes to migrate, and will use credentials saved as envvars by default (and prompt you if those are not available). Migration is relatively quick, in my tests an index with about 400k records and 1+1 replication takes about a minute to migrate.
The old Elasticsearch cluster will be shut down on 24 August.
This work is tracked as T401818.[1]
[0]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/OpenSearch [1]: https://phabricator.wikimedia.org/T401818
Hi,
This is a reminder that we plan to shut down the old Toolforge Elasticsearch 7 cluster early next week. If you maintain a tool still using that cluster, please plan to migrate your tool to the new OpenSearch cluster before the shutdown by following the instructions in my previous email[0] or reach out for assistance.
[0]: https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.o...
thanks, Taavi
On Thu, 30 Jul 2026 at 12:53, Taavi Väänänen taavi@wikimedia.org wrote:
Hi all,
The Toolforge Elasticsearch cluster is being replaced with a cluster based on OpenSearch v2[0]. If your tool uses the writable Elastic/OpenSearch functionality you will need to manually migrate your tool to the new cluster as described in the rest of this email. (Note that this is different from the "Cloud Elastic" service which provides read-only access to the search indexes of Wikimedia wikis.)
The Wikitech page[0] has been updated with the details of the new cluster, which are almost identical to the previous cluster except the hostname and software version used. The same set of credentials will also work on the new cluster. There are, however, some breaking API changes between the old version and the new one, which is why we are not just migrating all indexes for all tools at once.
To help migrate data from the old cluster to the new one, we have temporarily added a `toolforge migrate-index` command to the bastion servers to copy over an index and its mappings, aliases and replication settings. The tool takes a space-separated list of indexes to migrate, and will use credentials saved as envvars by default (and prompt you if those are not available). Migration is relatively quick, in my tests an index with about 400k records and 1+1 replication takes about a minute to migrate.
The old Elasticsearch cluster will be shut down on 24 August.
This work is tracked as T401818.[1]
-- Taavi Väänänen (he/they) Site Reliability Engineer, Tools Infrastructure Wikimedia Foundation
As previously announced[0], the old Toolforge Elasticsearch 7 cluster is no longer accessible. The data stored on the cluster is still around, so please reach out as soon as possible if there are indexes that still need migrating.
[0]: https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.o...
taavi
On Wed, 19 Aug 2026 at 14:32, Taavi Väänänen taavi@wikimedia.org wrote:
Hi,
This is a reminder that we plan to shut down the old Toolforge Elasticsearch 7 cluster early next week. If you maintain a tool still using that cluster, please plan to migrate your tool to the new OpenSearch cluster before the shutdown by following the instructions in my previous email[0] or reach out for assistance.
thanks, Taavi
On Thu, 30 Jul 2026 at 12:53, Taavi Väänänen taavi@wikimedia.org wrote:
Hi all,
The Toolforge Elasticsearch cluster is being replaced with a cluster based on OpenSearch v2[0]. If your tool uses the writable Elastic/OpenSearch functionality you will need to manually migrate your tool to the new cluster as described in the rest of this email. (Note that this is different from the "Cloud Elastic" service which provides read-only access to the search indexes of Wikimedia wikis.)
The Wikitech page[0] has been updated with the details of the new cluster, which are almost identical to the previous cluster except the hostname and software version used. The same set of credentials will also work on the new cluster. There are, however, some breaking API changes between the old version and the new one, which is why we are not just migrating all indexes for all tools at once.
To help migrate data from the old cluster to the new one, we have temporarily added a `toolforge migrate-index` command to the bastion servers to copy over an index and its mappings, aliases and replication settings. The tool takes a space-separated list of indexes to migrate, and will use credentials saved as envvars by default (and prompt you if those are not available). Migration is relatively quick, in my tests an index with about 400k records and 1+1 replication takes about a minute to migrate.
The old Elasticsearch cluster will be shut down on 24 August.
This work is tracked as T401818.[1]
-- Taavi Väänänen (he/they) Site Reliability Engineer, Tools Infrastructure Wikimedia Foundation
-- Taavi Väänänen (he/they) Site Reliability Engineer, Tools Infrastructure Wikimedia Foundation
cloud-announce@lists.wikimedia.org