• You are here : 
  • Learn for Master
  • /Class com.hadoop.compression.lzo.LzoCodec not found for Spark

Class com.hadoop.compression.lzo.LzoCodec not found for Spark

August 10, 2016 Author: david
No comment yet

Here is the solution to solve the Class com.hadoop.compression.lzo.LzoCodec not found for Spark:

Put the following command at spark-env.sh, or simply run it before submit the spark jobs. 

export SPARK_CLASSPATH=”$(ls ${HADOOP_PREFIX}/share/hadoop/common/hadoop-gpl-compression.jar)”

Related posts:

  1. spark submit multiple jars
  2. A Spark program using Scopt to Parse Arguments
  3. Spark: Solve Task not serializable Exception
  4. Run spark on oozie with command line arguments
  5. Most popular hadoop commands
  6. Run hadoop command in Python
  7. memoryOverhead issue in Spark
  8. Learn spark by examples (2)
  9. How to setup ipython notebook server to run spark in local or yarn model
  10. Learn Spark by Examples
  11. Spark MLlib Example
  12. run pyspark on oozie
Posted in :  Uncategorized
Tags : 

URL for this post : http://www.learn4master.com/algorithms/class-com-hadoop-compression-lzo-lzocodec-not-found-for-spark