We are seeking a Senior Data Quality Engineer with strong experience in Python, SQL, and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities:
โข Build and maintain automated testing frameworks for data pipelines
โข Validate data ingestion, transformations, and data quality across multiple sources
โข Implement data quality tools such as Great Expectations, dbt tests, or similar
โข Integrate testing into CI/CD pipelines
โข Collaborate with engineering teams to improve data reliability and observability
Required Skills:
โข 5+ years of experience in Data Quality Engineering, Data Engineering, or related field
โข Strong hands-on experience with Python and SQL
โข Experience with automated testing frameworks and pipeline validation
โข Familiarity with Databricks, data transformation workflows, and CI/CD tools
โข Strong problem-solving and communication skills
Preferred:
โข Experience with PySpark, Delta Lake, Kafka, or Azure cloud technologies
โข Exposure to AI-assisted development tools and data observability practices