Skip to content Skip to sidebar Skip to footer
Home / Apache Spark / Pyspark / Python / Rdd

Rdd Collect Issue

Post a Comment
I configured a new system, spark 2.3.0, python 3.6.0, dataframe read and other operations working as expected. But, RDD collect is failing - distFile = spark.sparkContext.textFile(

Solution 1:

spark has some compatibility issues with the current latest version of java. The best solution for the moment is

  1. uninstall Java 10
  2. install Java 8 instead

You may like these posts

Post a Comment for "Rdd Collect Issue"