Data Quality

Testing

Soda Core Data Quality Testing: Validate Data in CI/CD Pipelines

Soda Core is an open-source data quality framework that lets you define checks in SodaCL (Soda Checks Language) — a YAML-based DSL — and run them against your database or data lake. Unlike Great Expectations, Soda Core uses declarative YAML instead of Python code, making checks readable by data analysts

Machine Learning

Data Quality Testing for ML Pipelines: Great Expectations, Soda, and Deequ

ML models fail silently when their input data changes. A column that was never null suddenly has 30% nulls. A categorical feature gains new values the model was never trained on. A numeric distribution shifts because a upstream system changed its calculation. Data quality testing catches these problems before they