How To Read Parquet Files Under A Directory Using Pyspark?

I have searched online and the solutions provided online didn't resolve my issue. I am trying to read parquet files under a directory which are hierarchical. I am getting the follo

Solution 1:

Can you try this option?

df = spark.read.option("header","true").option("recursiveFileLookup","true").parquet("/path/to/root/")