Part 7 - Spark Transform Local vs Cloud ⚡ This part continues from the API client layer and explains the transformation job in spark_jobs/air_quality_to_parquet.py. What the Spark job does The job reads raw OpenAQ and weather JSON, flattens nested structures, joins the datasets, and writes parquet into a staging layer partitioned by time. That is the classic lakehouse-style move from raw JSON to