Great Expectations

“Unit tests for your data”

With Great Expectations, you can assert what you expect from the data you load and transform, and catch data issues quickly – Expectations are basically unit tests for your data. Not only that, but Great Expectations also creates data documentation and data quality reports from those Expectations. Data science and data engineering teams use Great Expectations to:

https://greatexpectations.io/

key points

• Test data they ingest from other teams or vendors and ensure its validity.
• Validate data they transform as a step in their data pipeline in order to ensure the correctness of transformations.
• Prevent data quality issues from slipping into data products.
• Streamline knowledge capture from subject-matter experts and make implicit knowledge explicit.
• Develop rich, shared documentation of their data.