Great Expectations (EN)

Framework

Open-source framework for creating and validating data quality expectations

Architecture

flowchart TD     A[Data Source] --> B[Data Connector]     B --> C[DataContext]     C --> D[Expectation Suite]     D --> E[Validation Result]     E --> F[Data Docs]     E --> G[Alert System] 

In Context

  • Typically used together with Apache Spark, Pandas, or SQL databases
  • Related to: Apache Griffin, Deequ, Soda Core
  • Example use case: Validation of data pipelines in data warehousing environments
Quelle: AI Generated