Senior ETL & AI/ML Test Automation Engineer
Must Have Technical/Functional Skills
ETL & Data Testing
โข Validate end-to-end ETL/ELT pipelines across enterprise data platforms.
โข Perform Source-to-Target validation and reconciliation testing.
โข Validate data transformations, aggregations, business rules, and lineage.
โข Execute data quality checks on large-scale structured and semi-structured datasets.
โข Perform schema, metadata, and Delta Lake validations.
โข Write complex SQL queries for backend validation and data integrity testing.
โข Validate CDC (Change Data Capture) and incremental data loading processes.
โข Test batch and streaming data pipelines.
Databricks Testing
โข Validate Databricks notebooks, Workflows, Jobs, Delta Live Tables, and Unity Catalog implementations.
โข Test Bronze, Silver, and Gold layer data transformations.
โข Verify workflow orchestration and dependency handling across Databricks jobs.
โข Perform performance validation of Spark and PySpark transformations.
โข Validate data quality frameworks implemented in Databricks.
AI/ML Testing
โข Validate AI/ML model integrations within enterprise applications.
โข Verify model scoring results and prediction outputs.
โข Perform data drift, schema drift, and feature validation testing.
โข Validate feature engineering pipelines and training datasets.
โข Execute model input/output verification against expected business outcomes.
โข Validate explainability, traceability, and auditability requirements.
โข Test model deployment workflows integrated through MLflow, Databricks ML, Azure ML, or similar platforms.
โข Validate GenAI/RAG workflows, prompt-response accuracy, and grounding mechanisms where applicable.
Integration Testing
โข Perform end-to-end integration testing across:
o Databricks
o Data warehouses
o APIs
o AI/ML services
o Cloud platforms
o Downstream reporting systems
โข Validate data flow between source systems, data lakes, ML models, and consuming applications.
โข Perform contract testing and API validation.
Test Automation
โข Design and develop automation frameworks for:
o ETL testing
o API testing
o Data validation
o ML model validation
โข Build reusable test utilities using Python.
โข Integrate automated tests into CI/CD pipelines.
โข Develop automated quality gates for deployment validation.
โข Generate automated execution reports and test metrics.
required
6+ years of experience in ETL/Data Testing.
3+ years of experience testing Databricks or Spark-based platforms.
Hands-on experience in AI/ML Model Testing or MLOps validation.
Strong coding experience in Python and SQL. Education
Bachelor's degree
TCS Employee Benefits Summary
โข Discretionary Annual Incentive.
โข Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
โข Family Support: Maternal & Parental Leaves.
โข Insurance Options: Auto & Home Insurance, Identity Theft Protection.
โข Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
โข Time Off: Vacation, Time Off, Sick Leave & Holidays.
โข Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $120000 - $130000 a year
#LI-JH1