logstash is up and running again on deployment-prep. For those who are interested, the logstash plugins that we used were deployed correctly, present on disk, but not reloaded by logstash. The reloading part is triggered by puppet [1], but that code does not seem to be robust enough.
Logstash was down and logs were not collected between ~12:40 and 15:15 UTC.
All my apologises for this inconvenience....
[1] https://github.com/wikimedia/puppet/blob/production/modules/logstash/manifes...
On Tue, May 9, 2017 at 4:49 PM, Guillaume Lederrey glederrey@wikimedia.org wrote:
Hello all!
While aligning elasticsearch / logstash / kibana versions on deployment-logstash2, I am running into some issues. Logstash does not want to restart...
This is tracked on phabricator [1], I'll let you know as soon as I know what is going on...
[1] https://phabricator.wikimedia.org/T163709
Have fun!
Guillaume
-- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation UTC+2 / CEST