Notification Type: PROBLEM
Service: ElasticSearch health check for shards on 9200
Host: logstash1007
Address: 10.64.0.37
State: CRITICAL
Date/Time: Wed Sept 25 18:25:38 UTC 2019
Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration
Acknowledged by :
Additional Info:
CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Max retries exceeded with url: /_cluster/health (Caused by NewConnectionError(requests.packages.urllib3.connection.HTTPConnection object at 0x7f150cbe5358: Failed to establish a new connection: [Errno 111] Connection refused,))
Notification Type: RECOVERY
Service: Check the last execution of search-drop-query-clicks
Host: stat1007
Address: 10.64.21.118
State: OK
Date/Time: Wed Sept 25 01:24:25 UTC 2019
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit search-drop-query-clicks
Notification Type: PROBLEM
Service: Check the last execution of search-drop-query-clicks
Host: stat1007
Address: 10.64.21.118
State: CRITICAL
Date/Time: Wed Sept 25 01:13:47 UTC 2019
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
connect to address 10.64.21.118 port 5666: Connection refused
Notification Type: RECOVERY
Service: Check the last execution of search-drop-query-clicks
Host: stat1007
Address: 10.64.21.118
State: OK
Date/Time: Tue Sept 24 05:25:47 UTC 2019
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit search-drop-query-clicks
Notification Type: PROBLEM
Service: Check the last execution of search-drop-query-clicks
Host: stat1007
Address: 10.64.21.118
State: CRITICAL
Date/Time: Tue Sept 24 03:39:25 UTC 2019
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
CRITICAL: Status of the systemd unit search-drop-query-clicks