sudo -u analytics kerberos-run-command analytics refine_event
--ignore_failure_flag=true
--table_include_regex='mediawiki_visual_editor_feature_use|mediawiki_structured_task_article_link_suggestion_interaction'
--since='2022-11-29T02:00:00.000Z' --until='2022-11-30T03:00:00.000Z'
application_1663082229270_439925
22/11/30 13:35:10 INFO Refine: Finished refinement of dataset
hdfs://analytics-hadoop/wmf/data/raw/event/codfw.mediawiki.visual_editor_feature_use/year=2022/month=11/day=30/hour=01
-> `event`.`mediawiki_visual_editor_feature_use`
/wmf/data/event/mediawiki_visual_editor_feature_use/datacenter=codfw/year=2022/month=11/day=30/hour=1.
(# refined records: 0)
The mediawiki_structured_task_article_link_suggestion_interaction ones have
been _REFINED already?
On Tue, Nov 29, 2022 at 11:32 PM <refine(a)an-worker1102.eqiad.wmnet> wrote:
Refine failures for path /wmf/data/raw/event ->
database event
(/wmf/data/event)
The following 2 of 2 dataset partitions for output table
`event`.`mediawiki_structured_task_article_link_suggestion_interaction`
failed refinement:
org.wikimedia.analytics.refinery.job.refine.RefineTargetException:
Failed refinement of
hdfs://analytics-hadoop/wmf/data/raw/event/codfw.mediawiki.structured_task.article.link_suggestion_interaction/year=2022/month=11/day=30/hour=01
-> `event`.`mediawiki_structured_task_article_link_suggestion_interaction`
/wmf/data/event/mediawiki_structured_task_article_link_suggestion_interaction/datacenter=codfw/year=2022/month=11/day=30/hour=1.
Original exception: java.lang.IllegalArgumentException: uri` node should be
an object when building DataType
org.wikimedia.analytics.refinery.job.refine.RefineTargetException:
Failed refinement of
hdfs://analytics-hadoop/wmf/data/raw/event/eqiad.mediawiki.structured_task.article.link_suggestion_interaction/year=2022/month=11/day=30/hour=01
-> `event`.`mediawiki_structured_task_article_link_suggestion_interaction`
/wmf/data/event/mediawiki_structured_task_article_link_suggestion_interaction/datacenter=eqiad/year=2022/month=11/day=30/hour=1.
Original exception: java.lang.IllegalArgumentException: uri` node should be
an object when building DataType
The following 1 of 2 dataset partitions for output table
`event`.`mediawiki_visual_editor_feature_use` failed refinement:
org.wikimedia.analytics.refinery.job.refine.RefineTargetException:
Failed refinement of
hdfs://analytics-hadoop/wmf/data/raw/event/codfw.mediawiki.visual_editor_feature_use/year=2022/month=11/day=30/hour=01
-> `event`.`mediawiki_visual_editor_feature_use`
/wmf/data/event/mediawiki_visual_editor_feature_use/datacenter=codfw/year=2022/month=11/day=30/hour=1.
Original exception: java.lang.IllegalArgumentException: `content_language`
schema must contain 'type' field
applicationId: application_1663082229270_437514
To rerun, use the following options:
--ignore_failure_flag=true
--table_include_regex='mediawiki_visual_editor_feature_use|mediawiki_structured_task_article_link_suggestion_interaction'
--since='2022-11-29T02:00:00.000Z' --until='2022-11-30T03:00:00.000Z'
_______________________________________________
Data-engineering-alerts mailing list --
data-engineering-alerts(a)lists.wikimedia.org
List information:
https://lists.wikimedia.org/postorius/lists/data-engineering-alerts.lists.w…