- Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - graphite1001/CirrusSearch codfw 95th percentile latency - more_like is CRITICAL **
by icinga＠einsteinium.wikimedia.org 12 Dec '16

12 Dec '16

Notification Type: PROBLEM Service: CirrusSearch codfw 95th percentile latency - more_like Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Mon Dec 12 15:56:29 UTC 2016 Additional Info: CRITICAL: 20.00% of data above the critical threshold [2000.0]

1 0

** RECOVERY alert - search.svc.eqiad.wmnet/ElasticSearch health check for shards is OK **
by icinga＠einsteinium.wikimedia.org 08 Nov '16

08 Nov '16

Notification Type: RECOVERY Service: ElasticSearch health check for shards Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: OK Date/Time: Tue Nov 8 14:03:06 UTC 2016 Additional Info: OK - elasticsearch status production-search-eqiad: status: yellow, number_of_nodes: 31, unassigned_shards: 802, number_of_pending_tasks: 3, number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 3040, task_max_waiting_in_queue_millis: 146246, cluster_name: production-search-eqiad, relocating_shards: 0, active_shards_percent_as_number: 90.2583187391, active_shards: 8246, initializing_shards: 88, number_of_data_nodes: 31, delayed_unassigned_shards: 0

1 0

** ACKNOWLEDGEMENT alert - search.svc.eqiad.wmnet/ElasticSearch health check for shards is CRITICAL **
by icinga＠einsteinium.wikimedia.org 08 Nov '16

08 Nov '16

Notification Type: ACKNOWLEDGEMENT Service: ElasticSearch health check for shards Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL Date/Time: Tue Nov 8 13:45:26 UTC 2016 Additional Info: CRITICAL - elasticsearch inactive shards 1146 threshold =0.1% breach: status: yellow, number_of_nodes: 31, unassigned_shards: 1047, number_of_pending_tasks: 7, number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 3040, task_max_waiting_in_queue_millis: 28704, cluster_name: production-search-eqiad, relocating_shards: 0, active_shards_percent_as_number: 87.4562171629, active_shards: 7990, initializing_shards: 99, number_of_data_nodes: 31, delayed_unassigned_shards: 0

1 0

** PROBLEM alert - search.svc.eqiad.wmnet/ElasticSearch health check for shards is CRITICAL **
by icinga＠einsteinium.wikimedia.org 08 Nov '16

08 Nov '16

Notification Type: PROBLEM Service: ElasticSearch health check for shards Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL Date/Time: Tue Nov 8 13:34:06 UTC 2016 Additional Info: CRITICAL - elasticsearch inactive shards 970 threshold =0.1% breach: status: yellow, number_of_nodes: 30, unassigned_shards: 859, number_of_pending_tasks: 52, number_of_in_flight_fetch: 1436, timed_out: False, active_primary_shards: 3040, task_max_waiting_in_queue_millis: 122407, cluster_name: production-search-eqiad, relocating_shards: 0, active_shards_percent_as_number: 89.3826619965, active_shards: 8166, initializing_shards: 111, number_of_data_nodes: 30, delayed_unassigned_shards: 0

1 0

Fatal Error - Oozie Job discovery-popularity-score-wmf.pageview_hourly->ebernhardson.popularity_score-7, 2016-10-17-wf
by oozie＠analytics1003.eqiad.wmnet 20 Oct '16

20 Oct '16

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-popularity-score-wmf.pageview_hourly->ebernhardson.popularity_score-7, 2016-10-10-wf
by oozie＠analytics1003.eqiad.wmnet 20 Oct '16

20 Oct '16

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-popularity-score-wmf.pageview_hourly->ebernhardson.discovery_popularity_score-7, 2016-10-17-wf
by oozie＠analytics1003.eqiad.wmnet 19 Oct '16

19 Oct '16

Error details: - Job id: UNSET - Failing action: aggregate - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

The Wikimedia Developer Summit wants YOU!
by Srishti Sethi 18 Oct '16

18 Oct '16

Hello! The Wikimedia Developer Summit <https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit> is the annual meeting to push the evolution of MediaWiki and other technologies supporting the Wikimedia movement. The next edition will be held in San Francisco on January 9-11, 2017. We welcome all Wikimedia technical contributors, third party developers, and users of MediaWiki and the Wikimedia APIs. We specifically want to increase the participation of volunteer developers and other contributors dealing with extensions, apps, tools, bots, gadgets, and templates. Important deadlines: - Monday, October 24: This is the last day to request travel sponsorship. Applying takes less than five minutes. - Monday, October 31: This is the last day to propose an activity. Bring the topics you care about! Subscribe to weekly updates: https://www.mediawiki.org/ wiki/Topic:Td5wfd70vptn8eu4 Please feel free to forward this email to anyone who might be interested in attending! Thanks, Srishti -- Srishti Sethi ssethi(a)wikimedia.org

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2016, 9, 12->http://elastic2010.codfw.wmnet:9200-wf
by oozie＠analytics1003.eqiad.wmnet 12 Sep '16

12 Sep '16

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2016, 9, 12->http://elastic1017.eqiad.wmnet:9200-wf
by oozie＠analytics1003.eqiad.wmnet 12 Sep '16

12 Sep '16

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts