Ab Initio Migration Specialist
Location: Phoenix, AZ (Onsite)
Job Type: Long-Term Contract
Job Summary
STAFFXPERT LLC is seeking an Ab Initio Migration Specialist on behalf of our client in Phoenix, AZ. We are looking for a highly skilled ETL and Data Engineering professional with strong expertise in Ab Initio and cloud migration technologies. This role is ideal for someone who has successfully led enterprise-scale ETL modernization initiatives and can collaborate effectively with business stakeholders and distributed engineering teams to deliver high-quality migration solutions.
The ideal candidate will play a key role in migrating legacy Ab Initio ETL workloads to Azure Databricks while ensuring data integrity, optimal performance, and seamless production deployment.
Key Responsibilities
- Analyze existing Ab Initio graphs, plans, and ETL workflows to understand current architecture.
- Design and implement migration strategies from Ab Initio to Azure Databricks.
- Translate complex Ab Initio logic into efficient Spark, PySpark, and SQL-based ETL pipelines.
- Develop reusable migration frameworks, standards, and best practices.
- Collaborate with business stakeholders to gather requirements and define technical solutions.
- Provide technical leadership and guidance to offshore development teams.
- Perform data validation, reconciliation, and root cause analysis to ensure data accuracy.
- Troubleshoot ETL execution issues throughout migration activities.
- Support System Integration Testing (SIT), User Acceptance Testing (UAT), production validation, and performance optimization.
- Ensure complete source-to-target data consistency and successful production rollout.
Required Skills
- Ab Initio (GDE, Co>Operating System, EME, Conduct>It, Continuous Flows)
- Azure Databricks
- Apache Spark
- PySpark
- SQL
- ETL Migration
- Data Validation & Reconciliation
- Azure Data Lake Storage (ADLS)
- Azure Data Factory (ADF)
- CI/CD for Data Pipelines
Required Qualifications
- 8+ years of overall experience in Data Engineering and ETL development.
- 5+ years of hands-on experience specializing in Ab Initio migration projects.
- Strong expertise in Ab Initio graph development, DML, transforms, joins, rollups, lookups, partitioning, normalization, and related components.
- Hands-on experience with Azure Databricks, Spark, PySpark, and SQL.
- Proven experience delivering enterprise ETL modernization or cloud migration initiatives.
- Strong analytical, troubleshooting, and debugging skills.
- Excellent communication and stakeholder management abilities.
- Experience collaborating with offshore development teams.
Preferred Qualifications
- Experience migrating legacy ETL platforms to Azure Databricks.
- Knowledge of Azure data services including ADLS, ADF, and Azure SQL.
- Experience implementing CI/CD pipelines for data engineering projects.
- Experience working within regulated industries such as Banking, Financial Services, or Healthcare.
- Prior experience leading or mentoring technical teams.