logstash is up and running again on deployment-prep. For those who are interested, the logstash plugins that we used were deployed correctly, present on disk, but not reloaded by logstash. The reloading part is triggered by puppet [1], but that code does not seem to be robust enough.

Logstash was down and logs were not collected between ~12:40 and 15:15 UTC.

All my apologises for this inconvenience....

[1] https://github.com/wikimedia/puppet/blob/production/modules/logstash/manifes...

On Tue, May 9, 2017 at 4:49 PM, Guillaume Lederrey glederrey@wikimedia.org wrote:

Hello all!

While aligning elasticsearch / logstash / kibana versions on deployment-logstash2, I am running into some issues. Logstash does not want to restart...

This is tracked on phabricator [1], I'll let you know as soon as I know what is going on...

[1] https://phabricator.wikimedia.org/T163709

Have fun!

Guillaume

-- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation UTC+2 / CEST