Spark read csv
csv read mode and options
•
csv read mode and options
set json parse mode to identify json format issue
a summary of how spark partition number is determined
reduce the number of partitions