Try 6 out of 6
Exception:
Cannot execute: ['/usr/lib/spark2/bin/spark-submit', '--master', 'yarn', '--conf', 'spark.dynamicAllocation.maxExecutors=450', '--conf', 'spark.executor.memory=2g', '--conf', 'spark.jars.ivy=/tmp/airflow_ivy2', '--conf', 'spark.jars.ivySettings=/etc/maven/ivysettings.xml', '--conf', 'spark.pyspark.python=mjolnir_venv/bin/python', '--conf', 'spark.sql.shuffle.partitions=1000', '--conf', 'spark.yarn.maxAppAttempts=1', '--archives', '/srv/deployment/wikimedia/discovery/analytics/environments/mjolnir/venv.zip#mjolnir_venv', '--jars', 'hdfs://analytics-hadoop/wmf/refinery/current/artifacts/refinery-hive-shaded.jar', '--packages', 'org.wikimedia.search:mjolnir:0.7', '--driver-memory', '2g', '--name', 'mjolnir-feature_vectors-norm_query-20180215-query_explorer-20230118-spark', '--queue', 'default', '--deploy-mode', 'cluster', '/srv/deployment/wikimedia/discovery/analytics/spark/mjolnir-utilities.py', 'feature_vectors', '--date', '20230118', '--output-path', 'hdfs://analytics-hadoop/wmf/data/discovery/mjolnir/feature_vectors/date=20230118/feature_set=20180215-query_explorer', '--brokers', 'kafka-jumbo1001.eqiad.wmnet:9092,kafka-jumbo1002.eqiad.wmnet:9092,kafka-jumbo1003.eqiad.wmnet:9092', '--clicks-table', 'mjolnir.query_clicks_ltr', '--clustering-algorithm', 'norm_query', '--clustering-table', 'mjolnir.query_clustering', '--feature-set', '20180215-query_explorer', '--output-table', 'mjolnir.feature_vectors', '--samples-per-wiki', '27000000', '--topic-request', 'mjolnir.msearch-prod-request', '--topic-response', 'mjolnir.msearch-prod-response', '--wikis', 'arwiki', 'dewiki', 'enwiki', 'fawiki', 'fiwiki', 'frwiki', 'hewiki', 'idwiki', 'itwiki', 'jawiki', 'kowiki', 'nlwiki', 'nowiki', 'plwiki', 'ptwiki', 'ruwiki', 'svwiki', 'viwiki', 'zhwiki']. Error code is: 1.
Log: Link
Host: an-airflow1001.eqiad.wmnet
Log file: /var/log/airflow/mjolnir/feature_vectors-norm_query-20180215-query_explorer/2023-01-18T19:07:56.735718+00:00.log
Mark success: Link