Try 6 out of 6
Exception:
Cannot execute: ['/usr/lib/spark2/bin/spark-submit', '--master', 'yarn', '--conf', 'spark.dynamicAllocation.maxExecutors=36', '--conf', 'spark.executor.extraJavaOptions=-XX:MaxDirectMemorySize=1024M', '--conf', 'spark.executor.memoryOverhead=4096M', '--conf', 'spark.executorEnv.REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt', '--conf', 'spark.yarn.maxAppAttempts=1', '--conf', 'spark.yarn.appMasterEnv.REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt', '--py-files', '/srv/deployment/wikimedia/discovery/analytics/spark/wmf_spark.py', '--executor-cores', '1', '--executor-memory', '4g', '--driver-memory', '8g', '--name', '[Search Airflow Job] Import Cirrus Indexes Weekly: Import', '--queue', 'default', '--deploy-mode', 'cluster', '/srv/deployment/wikimedia/discovery/analytics/spark/import_cirrus_indexes.py', '--elasticsearch', 'https://search.svc.codfw.wmnet:9243,https://search.svc.codfw.wmnet:9443,https://search.svc.codfw.wmnet:9643', '--output-partition', 'discovery.cirrus_index/snapshot=20221127']. Error code is: 1.
Log: Link
Host: an-airflow1001.eqiad.wmnet
Log file: /var/log/airflow/import_cirrus_indexes_weekly/import/2022-11-27T00:00:00+00:00.log
Mark success: Link