Hello,
Pretty much everyone who's dealt with creating views for new wikis on the
labs hosts have experienced issues with "Access denied" sometimes.
This was usually due to the MariaDB grant role being missed. We tried to
workaround this by including the grant addition on the maintain-views
script.
Unfortunately, we ran into very weird problems when doing so and this is an
example: https://phabricator.wikimedia.org/T193187#4273281
After lots of back and forth we decided to create a bug to MariaDB (
https://jira.mariadb.org/browse/MDEV-16466) which was confirmed by MariaDB
yesterday and pointed to a similar issue (
https://jira.mariadb.org/browse/MDEV-14732).
The expected fix will come in 10.4 (we are in 10.1), so quite long ahead of
us.
So, for now, the workaround before adding new views is to manually add the
GRANT on the DB and then run the script:
GRANT SELECT, SHOW VIEW ON `newiki\_p`.* to labsdbuser';
Hopefully with this email everyone is on the same page now.
Thanks everyone (specially Brooke for helping me out with the
troubleshooting!)
Manuel.
Just a heads up that tomorrow at the usual 8:15 time, project members
may start to receive emails about their Cloud VPS instances that have
Puppet failures.
https://gerrit.wikimedia.org/r/c/operations/puppet/+/475875
--
Giovanni Tirloni
Operations Engineer
Wikimedia Cloud Services
Hello,
A new clushmaster host (tools-clushmaster-02) has been deployed using
the refactored Puppet code and Debian Stretch (T209701).
The old clushmaster host (tools-clushmaster-01) has been shut down and
will be deleted in a few days if there are no issues with the new one.
If you find any issues with it, please let us know.
Thanks,
--
Giovanni Tirloni
Operations Engineer
Wikimedia Cloud Services
I added the new icinga@ sender for hte new icinga boxes to the approved
sender list here and trashed about 170 seemingly spam subscription requests
today while doing other things FYI.
--
Chase Pettet
chasemp on phabricator <https://phabricator.wikimedia.org/p/chasemp/> and
IRC
Hello,
A new mail relay (tools-mail-02) based on Stretch was deployed today
(T208579). It replaces the old tools-mail server which was running on
Trusty.
The new server adds TLS support (using Let's Encrypt certificates),
which wasn't available in tools-mail before.
Please let us know if you notice any regressions.
Regards,
--
Giovanni Tirloni
Operations Engineer
Wikimedia Cloud Services