Try 6 out of 6
Exception:
Cannot execute: ['/usr/lib/spark2/bin/spark-submit', '--master', 'yarn', '--conf', 'spark.yarn.maxAppAttempts=1', '--conf', 'spark.dynamicAllocation.maxExecutors=25', '--executor-cores', '8', '--executor-memory', '16g', '--driver-memory', '2g', '--name', 'airflow-spark', '--class', 'org.wikidata.query.rdf.spark.WikibaseRDFDumpConverter', '--queue', 'root.default', '--deploy-mode', 'cluster', '/srv/deployment/wikimedia/discovery/analytics/artifacts/rdf-spark-tools-latest-jar-with-dependencies.jar', '--input-path', 'hdfs://analytics-hadoop/wmf/data/raw/commons/dumps/mediainfo-ttl/20210221/wikidata-20210221-mediainfo.ttl.bz2,', '--output-table', 'discovery.wikibase_rdf/date=20210221/wiki=commons', '--skolemize', '--site', 'commons']. Error code is: 1.
Log: Link
Host: an-airflow1001.eqiad.wmnet
Log file: /var/log/airflow/import_commons_ttl/munge_dumps/2021-02-17T03:00:00+00:00.log
Mark success: Link