On Fri, Dec 9, 2022 at 2:26 AM Russell Blau russblau@imapmail.org wrote:
So, putting two and two together, it sounds likely that when Francesco re-enabled write mode on toolsdb yesterday, they did not restart it with the same configuration options that it was using before, particularly whatever control the max key length.
I think that after the reboot the value for innodb_large_prefix changed to "false", and innodb_file_format changed to "Antelope", because those variables (introduced in [1]) were removed recently from the tools.my.cnf.erb file in [2] and [3].
I re-instated the values innodb_file_format=Barracuda and innodb_large_prefix=1 by manually running "SET GLOBAL" on clouddb1001.
Those variables will no longer be needed after we upgrade ToolsDB to MariaDB 10.4 [4]
[1] https://gerrit.wikimedia.org/r/c/operations/puppet/+/389477/ [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/837490/ [3] https://gerrit.wikimedia.org/r/c/operations/puppet/+/769025/ [4] https://phabricator.wikimedia.org/T301949