Due to repeated recent outages in the past 30 days and a long history of previous outages
due to log files filling up NFS for Toolforge, I’ve deployed a change to restrict the
maximum file size that can be created from the Toolforge system of 50 GB.
When a process hits that limit, it will fail to continue writing to the file with the
message that the “maximum file size” has been reached. There are files over this size in
the environment now that are not going to be affected, but moving them within the same
filesystem is likely to require help from someone with root access.
If the limit becomes a problem, it can be revisited. Please let us know on the cloud
discussion list or on #wikimedia-cloud if problems arise from the change.
Thanks!
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org <mailto:bstorm@wikimedia.org>
IRC: bstorm_