October 2020 - Discovery-alerts - lists.wikimedia.org

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-10-1-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-23-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-14-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-7-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-6-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-5-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-9-2-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

Fatal Error - Oozie Job discovery-query-clicks-hourly-discovery.query_clicks_hourly-2020-10-8-21-wf

by oozie＠an-coord1001.eqiad.wmnet

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

3 years, 6 months

1
0
0 0

** RECOVERY alert - relforge1001/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: relforge1001 Address: 10.64.4.13 State: OK Date/Time: Thu Oct 8 18:52:40 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status relforge-eqiad: unassigned_shards: 0, timed_out: False, number_of_pending_tasks: 0, number_of_nodes: 2, number_of_data_nodes: 2, status: green, active_primary_shards: 83, task_max_waiting_in_queue_millis: 0, initializing_shards: 0, relocating_shards: 0, number_of_in_flight_fetch: 0, active_shards: 104, cluster_name: relforge-eqiad, active_shards_percent_as_number: 100.0, delayed_unassigned_shards: 0

3 years, 6 months

1
0
0 0

** PROBLEM alert - relforge1001/ElasticSearch health check for shards on 9200 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: relforge1001 Address: 10.64.4.13 State: CRITICAL Date/Time: Thu Oct 8 18:50:58 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch inactive shards 52 threshold =0.15 breach: active_primary_shards: 52, task_max_waiting_in_queue_millis: 608, unassigned_shards: 46, active_shards: 52, initializing_shards: 6, number_of_pending_tasks: 9, relocating_shards: 0, number_of_data_nodes: 2, delayed_unassigned_shards: 0, number_of_nodes: 2, active_shards_percent_as_number: 50.0, status: red, cluster_name: relforge-eqiad, timed_out: False, number_of_in_flight_fetch: 0

3 years, 6 months

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts October 2020