*TL;DR* - Please test https://superset-next.wikimedia.org and let us know of any problems. Thanks.
Hello,
This message is specifically addressed to any users of superset.wikimedia.org https://superset.wikimedia.org.
We in the Data Platform SRE team would be grateful for your assistance in the acceptance testing phase of an upgrade to Superset, please. Our production Superset instance is currently running version *1.5.3*, but superset-next.wikimedia.org https://superset-next.wikimedia.org has now been upgraded to version *3.1.0* and is ready for testing. Its database was copied from the production instance yesterday, so it is relatively fresh.
If you could spend a little time reviewing whether your dashboards, charts, dataset, and SQL queries etc. work properly, that would be really helpful. There are lots of changes between the 1.5 and 3.1 releases, so please feel free to read through the following release notes, where the highlights are listed.
* release-notes-2-0 https://github.com/apache/superset/blob/master/RELEASING/release-notes-2-0/README.md * release-notes-3-1 https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md
One particular point of note in the latest upgrade is that a viz migrations https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md#cli-command-to-execute-viz-migrations CLI tool has been added, which can help migrate legacy (Area, Bubble, Line, and Sunburst) chart types to the newer ECharts based versions. Please let us know if this tool would be of interest to you and we can look at running it on your behalf.
Once we assess feedback from users of superset-next, we will be able to schedule a date for the upgrade of the production instance. All things being well, we would hope to do this upgrade within *a week or two*.
Feel free to share any feedback or queries about this upgrade in the #data-engineering-collab Slack channel, or the #wikimedia-analytics IRC channel, or any of the mailing lists where you read this, or simply by reply if you prefer.
Kind regards, Ben
Hello,
We are scheduling an upgrade of our production instance of Superset: *tomorrow*, *2024/02/01 at 10:00 UTC* now that we have had version 3.1.0 on the staging instance for a week with no reports of new issues.
Please be aware that there will some short periods of unavailability of Superset, whilst the upgrade takes place. I expect this disturbance to last no more than 15 minutes.
If you are a Superset user and you have not yet had a chance to test version 3.1.0 for any incompatibilities, feel free to do so now and let me know of any concerns that you may have. We can then see if there is a workaround, or if we need to defer the upgrade. I will create a database dump prior to the upgrade, so that we can roll back to version 1.5.3, should the need arise.
Kind regards, Ben
On 24/01/2024 5:17 pm, Ben Tullis wrote:
*TL;DR* - Please test https://superset-next.wikimedia.org and let us know of any problems. Thanks.
Hello,
This message is specifically addressed to any users of superset.wikimedia.org https://superset.wikimedia.org.
We in the Data Platform SRE team would be grateful for your assistance in the acceptance testing phase of an upgrade to Superset, please. Our production Superset instance is currently running version *1.5.3*, but superset-next.wikimedia.org https://superset-next.wikimedia.org has now been upgraded to version *3.1.0* and is ready for testing. Its database was copied from the production instance yesterday, so it is relatively fresh.
If you could spend a little time reviewing whether your dashboards, charts, dataset, and SQL queries etc. work properly, that would be really helpful. There are lots of changes between the 1.5 and 3.1 releases, so please feel free to read through the following release notes, where the highlights are listed.
- release-notes-2-0 https://github.com/apache/superset/blob/master/RELEASING/release-notes-2-0/README.md
- release-notes-3-1 https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md
One particular point of note in the latest upgrade is that a viz migrations https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md#cli-command-to-execute-viz-migrations CLI tool has been added, which can help migrate legacy (Area, Bubble, Line, and Sunburst) chart types to the newer ECharts based versions. Please let us know if this tool would be of interest to you and we can look at running it on your behalf.
Once we assess feedback from users of superset-next, we will be able to schedule a date for the upgrade of the production instance. All things being well, we would hope to do this upgrade within *a week or two*.
Feel free to share any feedback or queries about this upgrade in the #data-engineering-collab Slack channel, or the #wikimedia-analytics IRC channel, or any of the mailing lists where you read this, or simply by reply if you prefer.
Kind regards, Ben
Good morning,
This Superset https://superset.wikimedia.org upgrade is now complete and the process went according to plan.
You may also like to know that during the upgrade we enabled a feature that allows for the expansion of nested columns in Hive tables, when using SQL Lab. This additional work was carried out under T340144. https://phabricator.wikimedia.org/T340144 Expansion of nested columns is something that Hue https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hue can do, but has not been possible in Superset until today. I have included a screenshot below , showing how this feature functions.
In addition, here are some release notes that are relevant to versions 3.1 https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md and 2.0 https://github.com/apache/superset/blob/master/RELEASING/release-notes-2-0/README.md, which you may find useful.
Please do let us know if you have any issues or queries regarding the upgrade and we will do our best to help.
Kind regards, Ben
On 31/01/2024 12:19 pm, Ben Tullis wrote:
Superset upgrade: 2024/02/01 @ 10:00 UTC
Hello,
We are scheduling an upgrade of our production instance of Superset: *tomorrow*, *2024/02/01 at 10:00 UTC* now that we have had version 3.1.0 on the staging instance for a week with no reports of new issues.
Please be aware that there will some short periods of unavailability of Superset, whilst the upgrade takes place. I expect this disturbance to last no more than 15 minutes.
Awesome work, Ben!
~B
Brian King SRE, Data Platform/Search Platform Wikimedia Foundation IRC: inflatador
On Feb 1, 2024, at 5:11 AM, Ben Tullis btullis@wikimedia.org wrote:
Good morning,
This Superset https://superset.wikimedia.org/ upgrade is now complete and the process went according to plan.
You may also like to know that during the upgrade we enabled a feature that allows for the expansion of nested columns in Hive tables, when using SQL Lab. This additional work was carried out under T340144. https://phabricator.wikimedia.org/T340144 Expansion of nested columns is something that Hue https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hue can do, but has not been possible in Superset until today. I have included a screenshot below , showing how this feature functions.
In addition, here are some release notes that are relevant to versions 3.1 https://github.com/apache/superset/blob/master/RELEASING/release-notes-3-1/README.md and 2.0 https://github.com/apache/superset/blob/master/RELEASING/release-notes-2-0/README.md, which you may find useful.
Please do let us know if you have any issues or queries regarding the upgrade and we will do our best to help.
Kind regards, Ben
<15AVdV6NWJ06gQrB.png>
On 31/01/2024 12:19 pm, Ben Tullis wrote:
Hello,
We are scheduling an upgrade of our production instance of Superset: tomorrow, 2024/02/01 at 10:00 UTC now that we have had version 3.1.0 on the staging instance for a week with no reports of new issues.
Please be aware that there will some short periods of unavailability of Superset, whilst the upgrade takes place. I expect this disturbance to last no more than 15 minutes.
-- Ben Tullis (he/him) Senior Site Reliability Engineer Wikimedia Foundation https://wikimediafoundation.org/
