Try 6 out of 6
Exception:
Cannot execute: ['/usr/lib/spark2/bin/spark-submit', '--master', 'yarn', '--conf', 'spark.yarn.maxAppAttempts=1', '--conf', 'spark.sql.shuffle.partitions=200', '--conf', 'spark.dynamicAllocation.maxExecutors=70', '--conf', 'spark.sql.executor.memoryOverhead=640M', '--conf', 'spark.sql.shuffle.service.enabled=true', '--executor-cores', '3', '--executor-memory', '6G', '--driver-memory', '1G', '--name', 'airflow-spark', '--queue', 'default', '--deploy-mode', 'cluster', '/srv/deployment/wikimedia/discovery/analytics/artifacts/glent-latest-jar-with-dependencies.jar', 'm2run', '--wmf-log-name', 'event.mediawiki_cirrussearch_request', '--log-ts-from', '2021-05-01T00:00:00Z', '--log-ts-to', '2021-05-08T00:00:00Z', '--max-n-queries-per-ident', '2000', '--map-wikiid-to-lang-name', 'canonical_data.wikis', '--input-table', 'glent.suggestions', '--input-partition', '20210501', '--earliest-legal-ts', '2021-02-13T00:00:00Z', '--output-table', 'glent.suggestions', '--output-partition', '20210508', '--max-output-partitions', '2']. Error code is: 1.
Log: Link
Host: an-airflow1001.eqiad.wmnet
Log file: /var/log/airflow/glent_weekly/generate_dictionary_similarity_suggestions/2021-05-01T02:00:00+00:00.log
Mark success: Link