This change went live today, one week later than planned. If you notice any issues with Toolforge Redis, please let us know.
On Tue, May 21, 2024 at 5:05 PM Francesco Negri fnegri@wikimedia.org wrote:
Starting next week, May 27th, connections to Toolforge Redis [0] that remain idle for more than 10 minutes will be forcibly closed. [1]
This change is in order to prevent a situation where too many connections are active [2] and Redis stops accepting new connections, causing an outage [3] for several tools.
If your tool is using Toolforge Redis, we expect it to continue to work without issues, as most Redis clients automatically create a new connection to Redis in case an existing one is terminated.
If you have a tool that relies on long-lived Redis connections and would be negatively impacted by this change, please let us know.
[0] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Redis_for_Toolforge [1] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1029158 [1] https://phabricator.wikimedia.org/T363709 [2] https://wikitech.wikimedia.org/wiki/Incidents/2024-04-28_WMCS_Toolforge_Redi...
-- Francesco Negri (he/him) -- IRC: dhinus Site Reliability Engineer, Cloud Services team Wikimedia Foundation