Try 6 out of 6
Exception:
Cannot execute: ['/usr/lib/spark2/bin/spark-submit', '--master', 'yarn', '--conf', 'spark.yarn.maxAppAttempts=1', '--conf', 'spark.dynamicAllocation.maxExecutors=20', '--files', 'hdfs:///wmf/data/discovery/ores/thresholds/drafttopic_20210425.json#thresholds.json', '--py-files', '/srv/deployment/wikimedia/discovery/analytics/spark/wmf_spark.py', '--name', 'airflow-spark', '--queue', 'root.default', '--deploy-mode', 'cluster', '/srv/deployment/wikimedia/discovery/analytics/spark/prepare_mw_rev_score.py', '--input-partition', 'event.mediawiki_revision_score/@2021-04-26/2021-05-03', '--input-kind', 'mediawiki_revision_score', '--output-partition', 'discovery.ores_drafttopic/year=2021/month=4/day=26/hour=3/source=ores_predictions_hourly', '--thresholds-path', 'thresholds.json', '--prediction', 'drafttopic']. Error code is: 1.
Log: Link
Host: an-airflow1001.eqiad.wmnet
Log file: /var/log/airflow/ores_predictions_hourly/extract_drafttopic_predictions/2021-04-26T03:00:00+00:00.log
Mark success: Link