Databricks Write Json file is too slow

Solved by using “I would say” better spark apis, like read –> spark.read.format(“json”).load(“path”) write –> res.write.format(“parquet”).save(“path) and writing in parquet format as it is compressed and very optimized for spark

CLICK HERE to find out more related problems solutions.

Leave a Comment

Your email address will not be published.

Scroll to Top