DataOps / Data Quality Engineer
The search
We’re hiring a hands-on DataOps / Data Quality Engineer to build and automate data validation and testing across Azure-based data platforms. The role focuses on ensuring reliable, observable, and well-governed data pipelines while applying Data Reliability Engineering (SRE) principles.
Responsibilities
-
Build and automate data validation frameworks and quality checks
-
Test and validate Azure data pipelines and PySpark notebooks
-
Define monitoring, alerting, KPIs, and SLAs using Azure Monitor and KQL
-
Automate validations and reconciliations using SQL and scripting
-
Embed DataOps and reliability best practices across engineering teams
Essential skills
-
Strong experience in data quality, validation, and automated testing
-
Experience working with PySpark and large-scale data processing
-
Familiarity with CI/CD and Azure DevOps