Job Overview:
Pay Range:ย $55hr - $60hr
Requirement/Must Have:
- 5-10 years of experience in MDM with 5+ years in Markit EDM IHS.
- Strong expertise in Core Matcher design, data mastering pipelines, and Workflow/UI development.
- Hands-on experience with Kafka or equivalent streaming, AWS cloud services, and REST API development.
- Strong database experience across RDBMS and cloud data warehouses.
- Experience with CI/CD, Git, and Terraform.
- Proficiency in Python or Spark-based data processing.
Responsibilities:
- Lead design and development of enterprise MDM solutions on Markit EDM CADIS.
- Architect and implement Core Matcher frameworks, entity resolution, survivorship rules, and Golden Record creation and lifecycle management.
- Develop end-to-end data mastering pipelines including Data Constructors, Data Porters, Data Flows, and Rules Engines.
- Ensure scalability, reusability, and performance optimization.
- Design and develop Workflow UI components including WF Pages, WF Elements, and user-driven stewardship flows.
- Implement data governance workflows, approval, exception handling, and audit trails.
- Enable data lineage transparency and stewardship across domains, especially Party/Client.
- Implement real-time data processing and notifications using Apache Kafka and event-driven EDM triggers.
- Design near real-time mastering and synchronization patterns.
- Integrate EDM into enterprise event ecosystems.
- Develop and expose RESTful APIs using Data Generators and Process Launchers.
- Integrate with microservices architecture using Spring Boot, Java, and Node.js.
- Deploy and manage EDM solutions on AWS or Azure equivalent including AWS Glue, Lambda, S3, RDS, and eventing.
- Integrate EDM with modern data platforms such as Snowflake, Databricks, and Redshift.
- Design hybrid architecture for EDM golden source and Data Lake analytical layer.
- Work with Python, PySpark, and Spark SQL for data transformation, enrichment pipelines, and large-scale data processing.
- Handle ingestion from APIs, flat files, streaming feeds, and databases.
- Optimize large-volume batch and streaming pipelines.
- Build and maintain CI/CD pipelines for EDM using GitHub, GitLab, Octopus Deploy, Jenkins, and Azure DevOps.
- Use Infrastructure as Code (IaC) tools such as Terraform and CloudFormation.
- Implement automated deployments, environment promotion, and version control strategies.
- Work with Docker and Kubernetes for microservices deployment and integration layers around EDM.
- Enable scalable, resilient cloud-native deployments.
- Implement monitoring and logging using Client , ELK, Prometheus, Grafana, and CloudWatch.
- Perform performance tuning of matchers and batch jobs, and conduct root cause analysis and production support.
- Design and optimize databases across SQL Server, Oracle, PostgreSQL, and cloud-native warehouses.
- Develop complex SQL, stored procedures, and indexing and performance tuning strategies.
- Lead onsite-offshore model delivery and act as technical SME and solution architect for EDM.
- Collaborate with Business Analysts, Data Architects, and Scrum Teams.
- Conduct code reviews, design reviews, and release governance.
Nice to Have:
- Experience with Markit EDM Cloud 19x.
- Strong domain knowledge in Party, Client, and Instrument MDM.
- Experience with Databricks, Snowflake ecosystems, and microservices architecture using Spring Boot and Node.js.
- Experience with Kubernetes and containerization.
- Exposure to data governance frameworks such as Collibra and Alation.
Skills:
- Deep expertise in Markit EDM and modern data ecosystem.
- Strong architecture and system design mindset.
- Ability to lead complex data platform transformations.
- Excellent communication and stakeholder management.
- Strong problem-solving and performance optimization skills.
ย
Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading staffing and recruiting powerhouse. Proudly recognized as a nationally and locally certified diversity firm, Cynet delivers agile, scalable talent solutions across industries. With an active footprint in all 50 U.S. states and Canada, we support thousands of consultants through our expansive, high-performing recruitment engine operating across North America and Asiaโensuring speed, quality, and consistency in every hire.