Ab Initio Metadata Hub Jobs (NOW HIRING)

Job Description Ab Initio Developer Location: Charlotte, NC (Hybrid) Duration: 24-Month Contract Overview We are seeking an experienced Ab Initio Developer to join the Home Lending Data & Insights team. This role focuses on designing, developing, and modernizing enterprise data pipelines across both legacy on-premises platforms and Google Cloud Platform (GCP). The ideal candidate has strong expertise in ETL development, cloud data engineering, and enterprise-scale data modernization, with experience supporting highly available, production-grade data environments.

You will help migrate legacy Teradata and Ab Initio solutions to cloud-native architectures while ensuring data quality, operational excellence, security, and scalability. Key Responsibilities Design, develop, and maintain scalable batch and near real-time data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL. Build and optimize Google BigQuery datasets, transformations, and data models using partitioning, clustering, and query optimization techniques.

Support migration initiatives from Teradata and Ab Initio to Google Cloud Platform, including data validation, reconciliation, parallel processing, and production cutovers. Develop and maintain workflow orchestration using Autosys, while driving modernization to Google Cloud Composer (Apache Airflow). Implement metadata management, governance, and data discovery using Google Dataplex.

Build and maintain enterprise data quality controls using Informatica Data Quality, including profiling, validation rules, exception handling, and quality monitoring. Monitor production pipelines, troubleshoot failures, perform root cause analysis, and implement continuous improvements to system reliability and performance. Apply secure data engineering practices including PII protection, data masking, access controls, retention policies, and audit documentation.

Partner with Product Owners, Architects, Analysts, and Engineering teams to define technical solutions and deliver curated, trusted datasets. Create and maintain technical documentation including data dictionaries, reconciliation documents, operational runbooks, and technical specifications. Utilize AI-assisted development tools such as GitHub Copilot, Devin, or similar to improve engineering productivity while maintaining secure coding practices, code reviews, and testing standards.

Provide technical leadership and mentor junior engineers by promoting engineering best practices and scalable solution design. Analyze complex business requirements and translate them into robust ETL and data engineering solutions. Required Qualifications 4+ years of professional Data Engineering experience.

4+ years of experience with PL/SQL and SQL, including complex query development, optimization, and troubleshooting. Hands-on experience with Oracle, Teradata, Python, and/or Google BigQuery. 4+ years of experience developing enterprise ETL solutions using Ab Initio, including graph development, Psets, and performance tuning.

3+ years of experience programming in Python with hands-on PySpark development. 3+ years of experience with ETL architecture, data warehousing concepts, dimensional modeling, and data integration best practices. Experience building scalable batch and near real-time data processing solutions.

Strong understanding of enterprise data governance, metadata management, and data lifecycle management. Must-have: Use AI-assisted coding tools (e.g., GitHub Copilot, Devin, or similar) to accelerate development while maintaining strong code review discipline, testing, and secure coding standards Preferred Qualifications Experience with Google Cloud Platform (GCP) services including: BigQuery Dataplex Google Cloud Composer (Apache Airflow) Experience migrating enterprise data platforms from on-premises environments to cloud-native architectures. Experience with Informatica Data Quality (IDQ)

Familiarity with Autosys scheduling and workload automation. Experience implementing secure data engineering practices for regulated environments. Experience using AI-assisted software development tools such as GitHub Copilot or Devin.

Experience working in Agile/Scrum environments. Financial services or mortgage/lending industry experience is a plus. Technical Environment Languages: Python, PySpark, SQL, PL/SQL ETL: Ab Initio Databases: Oracle, Teradata, BigQuery Cloud: Google Cloud Platform (BigQuery, Dataplex, Cloud Composer) Scheduling: Autosys, Apache Airflow (Cloud Composer) Data Quality: Informatica Data Quality Development Tools: GitHub Copilot, Devin, Git.