Spark 1.x is pretty old. We only keep it around because it is a standard
part of the Cloudera distribution we use in the analytics Hadoop cluster.
The Analytics Engineering team uses Spark 2 for all of our jobs, and you
Spark 2 has been available in our cluster for over a year now. If you
don't yet use it, see
for more info on how to.
We'd like to remove Spark 1 during the week of February 11. Please migrate
any Spark 1 jobs to Spark 2 by then (if there are any left!). (If this
timeline doesn't work for you just let us know and we'll adjust.)
- Andrew Otto & Analytics Engineering