Dataflux Jobs (NOW HIRING)

Architect (ATC)Engagement Overview
Our client is undertaking a strategic modernization initiative to migrate their enterprise data quality, MDM, and
data integration workloads from SAS DataFlux (dfPower Studio, Data Management Studio, and the DataFlux Data
Management Server) to the Databricks Lakehouse Platform. We are seeking a Senior Onshore DataFlux Solution
Architect to lead the architectural strategy, target-state design, and migration blueprint for this multi-phase
program. This role is a hands-on, client-facing leadership position responsible for translating legacy DataFlux
logic, business rules, and MDM constructs into a modern, scalable Databricks-native architecture leveraging Delta
Lake, Unity Catalog, and Delta Live Tables.
Key Responsibilities
• Lead end-to-end solution architecture for the DataFlux to Databricks migration, including current-state
assessment, gap analysis, target-state design, and migration roadmap.
• Reverse-engineer and document existing DataFlux jobs, data services, business rules, QKBs (Quality
Knowledge Bases), and MDM hub configurations to produce a complete logical inventory.
• Design the target Databricks Lakehouse architecture (medallion: bronze/silver/gold) with Delta Lake, Unity
Catalog governance, and Delta Live Tables pipelines that replicate or improve upon DataFlux DQ and MDM
functionality.
• Define the strategy for migrating standardization, parsing, matching, clustering, and survivorship logic from
DataFlux into Databricks-native patterns (PySpark, SQL, and partner tools such as Reltio, Informatica CDQ,
or Zingg where appropriate).
• Architect MDM target-state for party, product, location, and reference data domains; define golden record
logic, hierarchy management, and stewardship workflows on the lakehouse.
• Establish data quality frameworks (DQ rules, scorecards, exception handling) using Delta Live Tables
expectations, Great Expectations, or Databricks Lakehouse Monitoring as DataFlux replacements.
• Partner with the client's enterprise architecture, data governance, and security teams to align on Unity
Catalog design, lineage, RBAC, and PII handling.
• Provide technical leadership and mentorship to a blended onshore/offshore engineering team; conduct design
reviews and enforce engineering standards.
• Serve as the senior client-facing technical advisor - present architecture decisions, trade-offs, and migration
progress to Director and VP-level stakeholders.
• Own technical risk identification and mitigation across the migration lifecycle, including cutover strategy,
parallel run validation, and decommissioning of DataFlux infrastructure.
Required Qualifications
DataFlux Expertise (Non-Negotiable)
• 10+ years of enterprise data architecture experience, with a minimum of 5 years of hands-on experience
designing and deploying solutions on SAS DataFlux (dfPower Studio and/or Data Management Studio).
• Deep working knowledge of DataFlux Data Management Server, Architect jobs, Profile jobs, data services,
and the QKB (Quality Knowledge Base) - including authoring custom definitions, regex libraries, phonetics,
and locale-specific rules.
• Demonstrated experience with DataFlux match codes, clustering, entity resolution, and survivorship rule
design at enterprise scale.
• Proven ability to reverse-engineer complex, undocumented DataFlux job flows and translate them into
modern equivalents.
Master Data Management (MDM)
• Strong architectural experience across MDM domains - Customer/Party, Product, Location, Vendor,
Employee, and Reference Data.
• Hands-on experience with at least one enterprise MDM platform in addition to DataFlux: Informatica MDM,
Reltio, Profisee, IBM InfoSphere MDM, or Stibo STEP.
• Expertise in match/merge logic, golden record creation, hierarchy management, cross-reference (XREF)
design, and data stewardship workflows.
Databricks & Modern Data Stack
• Production experience architecting solutions on Databricks, including Delta Lake, Unity Catalog, Delta Live
Tables, Workflows, and the medallion architecture pattern.
• Strong PySpark and Spark SQL skills; able to design performant patterns for large-scale matching,
deduplication, and DQ workloads.
• Working knowledge of cloud platforms (Azure, AWS, or GCP) and modern ingestion tools (Fivetran, ADF,
Airflow, dbt).
Data Domains & Governance
• Broad fluency across data quality, data governance, data modeling (3NF, dimensional, Data Vault), and
metadata management.
• Experience implementing data governance tooling (Collibra, Alation, Atlan, or Unity Catalog-native
governance).
• Familiarity with regulatory and privacy frameworks (HIPAA, GDPR, CCPA, SOX) and their impact on MDM
and DQ design.
Preferred Qualifications
• Prior experience leading at least one DataFlux modernization or sunset program.
• Databricks certifications (Data Engineer Professional, Solutions Architect Professional).
• Experience in healthcare payer, financial services, or insurance verticals.
• Background in consulting or professional services - comfortable with SOW-driven delivery and billable
utilization expectations.