Automated testing and deployment for data pipelines
- The challenge
- Pipeline and report changes are deployed by hand, and a small mistake can break dashboards across the business.
- What we build
- Version control for all data assets, CI/CD with automated tests and controlled promotion from development to test to production.
- The outcome
- Confident, frequent releases and far fewer broken reports.
- Azure DevOps
- GitHub Actions
- dbt
- Microsoft Fabric
Vilko Poznovia
