How to Check Data Quality in PySpark
dutchengineer.substack.com
Discover more from Dutch Engineer’s Newsletter
Easy-to-understand explanations of data and machine learning engineering techniques so you can grow in your career
Over 5,000 subscribers
Continue reading
How to Check Data Quality in PySpark
Using deequ to calculate metrics and set constraints on your big datasets