Databricks Engineer Jobs in New Mexico (NOW HIRING)

Position: Databricks Solutions Architect

Location: Los Alamos, NM

Job Id: 473

# of Openings: 1

SMSI is an Equal Employment Opportunity employer, all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

SMSI LLC is seeking a Databricks Solutions Architect to assist our client, Los Alamos National Laboratory (LANL). This position will be mostly remote, with occasional trips onsite in Los Alamos, NM as needed.

Los Alamos National Laboratory has selected SAP for their next-generation Cloud ERP solution. In parallel, they will require a future state data strategy to take advantage of new tools and technology to help modernize their current on-prem operational data store. This work plays a critical role in supporting key institutional initiatives such as enabling real-time analytics, AI/ML capabilities, and enhanced operational efficiency.

This role will be critical in transformation of their legacy data environment into a modern, cloud-native architecture. In concert with institutional knowledge experts and ERP implementation planner and integrators, you will define the data strategy, standards, and blueprints for migrating and integrating high-volume operational data into a new platform, ensuring data integrity, security, and accessibility across the enterprise.

• 5+ years of progressive experience in data architecture, data modernization, and cloud-based data solutions.
• Advise on the Databricks reference architecture covering Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps
• Advise on design of both data movement (e.g. batch, real-time streaming) and zero-copy patterns
• Guide platform migrations from legacy SQL and document stores onto Databricks and related cloud data platforms
• Recommend security, governance, and compliance-as-code: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security and compliance security profiles.
• Advise on design of segregated/tiered data pool architectures aligned to the organization's data classification policy and applicable regulatory requirements, including cross-tier data movement
• Recommend FinOps and performance standards, workload and cost management
• Mentor data engineers, analysts, and AI/ML teams participate in architecture reviews and contribute to standards
• Work with information & cyber security, and other teams as needed for compliance to policies and standards
• Evaluate emerging Databricks capabilities and recommend adoption strategies, including endpoint integrations with third parties as they evolve
• Excellent verbal and written communication skills.
• Candidate must have the ability to work with many team members across multiple disciplines.
• The candidate must be able to obtain and maintain a DOE Q clearance.
• The candidate must have an active Real ID diver's license for badging and onboarding.

7+ years designing, building, and operating Databricks workloads with medallion layer architecture

Hands-on experience with Delta Lake, Unity Catalog,, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving

Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)

Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks

Production streaming and CDC experience

Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation

Strong Python and SQL, Spark, Notebooks

Excellent verbal and written communication skills

Active (or recent) Q clearance is a plus but not required.

• Active Databricks certifications
• GenAI and agent systems on Databricks experience
• Delta Sharing and Databricks Clean Rooms for controlled, governed data exchange across organizational/cross-tier/system boundaries
• Familiarity with Oracle EBS and SAP enterprise data
• Experience with SAP BDC/DataSphere and Databricks integration to SAP BDC, with zero-copy patterns
• Lakeflow Designer, Databricks Apps, Genie, Databricks One
• CI/CD, Infrastructure-as-Code (e.g. Terraform) for data platforms
• Data Quality and Data Governance experience
• Prior experience in regulated industries (e.g. utilities, life sciences, government services) and exposure to related frameworks (e.g. FERC/NERC, HIPAA, GxP, GDPR, FedRAMP, ITAR, etc.)

• Bachelor’s degree, preferably in computer science, engineering, information systems, or related discipline, along with 12 years of experience. Equivalent combination of education and experience will be considered.