Senior Data Platform Engineer Jobs in Raleigh, NC

Architect, build, and maintain complex data pipelines that ingest and integrate information from laboratory instruments, automation systems, sequencers, operational platforms, APIs, autonomous robotics platforms, databases and file based data sources.

Own critical pipelines and data models end to end, from design through production operation, working independently on problems of diverse scope and adapting existing approaches where limited precedent exists.

Define and evolve the data architecture, modeling standards, and engineering patterns that the broader team builds on, and drive adoption across the group.

Support downstream analytics, reporting, and AI systems by delivering clean, trustworthy datasets and timely data extracts for troubleshooting, root-cause investigations and platform improvements.

Develop and optimize advanced SQL and transformation logic to cleanse, standardize, and model raw instrument and production data into reliable, well structured datasets.

Build and support datasets and data models used by operational dashboards, analytics, process monitoring, troubleshooting, and governed AI enabled workflows.

Design and implement orchestration, testing, monitoring and alerting so that data failures, freshness issues, schema changes, and incomplete processing are identified and resolved early.

Establish and enforce data validation and quality standards to ensure datasets are accurate, complete, and reliable across the platform.

Partner with and advise systems engineers, lab operations, data scientists, and automation engineers on difficult technical matters, adapting your communication for both technical and non-technical stakeholders.

Mentor and provide technical guidance to junior engineers, and contribute to the team's overall engineering practices and standards.

Document pipelines, data models, and datasets to support reproducibility and compliance with ISO, CLIA, CAP, NYS, GMP, and FDA requirements.

Continuously improve your technical skills and the team's engineering practices.

Degree in Computer Science, Mathematics, Software Engineering, Data Science, Life Sciences, Physics or similar field.

BS/BA degree with 5+ years or Master's degree with 3+ years of relevant experience in data engineering, analytics engineering, or software development.

Advanced proficiency in SQL, including performance optimization and complex transformation logic.

Strong proficiency with one or more programming languages, such as Python, Rust, C++, or similar.

Solid understanding of ETL/ELT pipeline design, relational databases, data modeling, and structured or semi-structured data.

Demonstrated ability to own data pipelines and infrastructure end to end and to work independently on problems of diverse scope.

Strong attention to detail and a commitment to data quality, reliability and accuracy.

Ability to collaborate effectively with, and advise, both technical and non-technical individuals, and comfort working in a rapidly changing environment with dynamic objectives and fast iteration.

Ability to investigate complex technical problems methodically, continuously learn, and communicate clearly to a range of audiences.

A highly analytical mindset and eagerness to solve difficult technical problems.

Hands-on experience with data pipeline orchestration and transformation tools such as Airflow, dbt, or comparable technologies.

Experience with cloud data platforms, object storage and warehouses such as AWS S3, Redshift, Glue, Snowflake or comparable technologies.

Experience integrating AI/agentic tooling into the data engineering SDLC.

Experience with semantic data modeling, data lineage, and automated data quality testing.

Experience mentoring engineers or leading technical projects and setting engineering standards.

Familiarity with statistical methods or process analytics.

Exposure to manufacturing, clinical laboratory operations, diagnostics, or biotechnology.

Proficiency with version control systems such as Git and collaborative development practices.

Understanding of APIs, file transfers, networking and system integrations.