Remote Databricks Data Engineer Jobs in Hayward, CA

Description
Salary Verbiage: "GlobalLogic estimates the starting pay range for this role, performed remotely in USA is 95,000 - 100,000, reflecting base salary only. This pay range is provided as a good faith estimate and the amount offered may be higher or lower. GlobalLogic takes many factors into consideration in making an offer, including candidate qualifications, work experience, operational needs, travel and onsite requirements, internal peer equity, prevailing wage, responsibilities, and other market and business considerations."
We are seeking a highly analytical and detail-oriented Data Validation & QA Engineer to support enterprise data and analytics initiatives. In this role, you will be responsible for validating and reconciling data across the end-to-end reporting ecosystem-from source systems through Databricks data pipelines down to Power BI semantic models and reports.
You will collaborate closely with Data Architects, Data Engineers, Business Analysts, and Power BI Developers to ensure data accuracy, completeness, and consistency prior to UAT, executive reviews, customer demos, and production releases.
Requirements
Education & Experience:
Bachelor's Degree in Computer Science, Data Engineering, Information Systems, or a related quantitative field.
4+ years of relevant experience in Data QA, Data Validation Engineering, or BI/Analytics Quality Assurance within an enterprise environment.
Technical & Sourcing Skills:
Advanced SQL & PySpark: Proficiency in writing complex SQL queries and PySpark scripts to perform cross-environment data validation, aggregate checks, and source-to-target reconciliation.
Databricks Ecosystem: Hands-on experience working with Databricks Lakehouse architecture, including Medallion layers (Bronze, Silver, Gold), Delta Lake tables, and data ingestion pipelines.
Power BI Expertise: Deep understanding of Power BI semantic models, DAX measures, dimensional modeling, row-level security (RLS), and report/dashboard validation.
Data Quality Frameworks: Proven experience validating key data quality dimensions-Completeness, Accuracy, Uniqueness, Consistency, and Timeliness.
Defect Management Tools: Proficiency with Jira or similar Agile project management tools for tracking issues, logging bugs, and coordinating with engineering teams.
Job responsibilities
1. End-to-End Reconciliation & Flow ValidationPerform end-to-end data flow testing across the complete architecture: {Source System} -->{Databricks Bronze} -->{Databricks Silver}-->{Databricks Gold} -->{Power BI Semantic Model} -->{Power BI Reports}
Execute source-to-Databricks reconciliation, validating source data against Bronze, Silver, and Gold layers via record counts, aggregates, and metric-level checks.Validate business logic, transformation rules, field mappings, and complex calculations across all layers to ensure seamless metric alignment.
2. Data Availability & Databricks Data QualityMaintain an inventory of available datasets across brands and source systems; assess historical coverage, refresh frequency, and completeness.Identify data gaps, missing datasets, and source readiness for project onboarding.Validate ingestion pipelines, transformation logic, and key data quality dimensions: Completeness, Accuracy, Uniqueness, Consistency, and Timeliness.Investigate, document root causes, and resolve data loss, duplicates, and transformation defects.
3. Semantic Model & Power BI Report ValidationValidate Power BI semantic models against Databricks Gold datasets, verifying DAX calculations, measures, dimensions, relationships, and hierarchies against approved business definitions.Validate report visuals, filters, slicers, drill-throughs, and aggregations against business benchmarks.Ensure report functionality and row/column-level security behave properly across diverse user roles and scenario profiles.Conduct thorough pre-demo and pre-release validation testing.
4. Defect Management & TrackingLog, prioritize, track, and manage reconciliation issues and defects in Jira.Partner with engineering and reporting teams to coordinate rapid defect resolution.Validate technical fixes and execute regression testing to ensure solution integrity.5. UAT, Documentation & Signoff SupportSupport business users through User Acceptance Testing (UAT) and document evidence of validation results.Provide data readiness assessments for executive reviews, customer demos, and production deployments.Maintain comprehensive reconciliation artifacts, validation logs, and signoff documentation.
What we offer
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.