ZipRecruiter

Log In

1

Manager Databricks Data Engineer Jobs in California

GEI Consultants

Data Engineer

Rancho Cordova, CA · On-site

$90K - $150K/yr

This includes building ingestion pipelines, managing data stores, implementing quality and ... Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect ...

GEI Consultants

Data Engineer

Rancho Cordova, CA · On-site

$122K - $146K/yr

This includes building ingestion pipelines, managing data stores, implementing quality and ... Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect ...

GEI Consultants

Data Engineer

Pasadena, CA · On-site

$90K - $150K/yr

This includes building ingestion pipelines, managing data stores, implementing quality and ... Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect ...

GEI Consultants

Data Engineer

Pasadena, CA · On-site

$124K - $150K/yr

This includes building ingestion pipelines, managing data stores, implementing quality and ... Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect ...

TekLeaders, Inc

Databricks Architect

San Francisco, CA · On-site

$76.25 - $100.25/hr

Databricks Data Engineering Professional certification (or equivalent advanced Databricks ... Working knowledge of MLOps principles, machine learning lifecycle management, model deployment, and ...

previous pagenext page

Showing results 21-40

All JobsDatabricks Data Engineer JobsManager Databricks Data Engineer JobsManager Databricks Data Engineer Jobs in California

Manager Databricks Data Engineer information

What is the difference between Manager Databricks Data Engineer vs Data Engineer?

AspectManager Databricks Data EngineerData Engineer
Primary FocusTeam leadership, project management, strategic planningData pipeline development, data modeling, ETL processes
Required SkillsLeadership, Databricks platform knowledge, data architectureSQL, Spark, Python, cloud platforms
CertificationsDatabricks certifications, leadership credentialsDatabricks certifications, technical skills
Work EnvironmentManagement, cross-team collaboration, strategic oversightHands-on data processing, coding, pipeline implementation

The Manager Databricks Data Engineer oversees data engineering teams and manages projects on the Databricks platform, focusing on strategy and leadership. In contrast, a Data Engineer primarily handles technical tasks like building data pipelines and coding. Both roles require Databricks platform knowledge and relevant certifications, but the managerial role emphasizes leadership and project management, while the Data Engineer role is more technical and execution-focused.

How much does a Manager Databricks Data Engineer make?

A Manager Databricks Data Engineer typically earns between $120,000 and $160,000 annually, depending on experience, location, and company size. They often require strong skills in Spark, SQL, and cloud platforms like Azure or AWS, along with leadership responsibilities. Compensation may also include bonuses and stock options.

Is a Manager Databricks Data Engineer in demand?

Manager Databricks Data Engineers are in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. They typically require expertise in Spark, SQL, and cloud environments, making their roles critical in data-driven organizations seeking scalable analytics solutions.

What are the most commonly searched types of Databricks Data Engineer jobs in California?

The most popular types of Databricks Data Engineer jobs in California are:

What are popular job titles related to Manager Databricks Data Engineer jobs in California?

For Manager Databricks Data Engineer jobs in California, the most frequently searched job titles are:

What job categories do people searching Manager Databricks Data Engineer jobs in California look for?

The top searched job categories for Manager Databricks Data Engineer jobs in California are:

What cities in California are hiring for Manager Databricks Data Engineer jobs?

Cities in California with the most Manager Databricks Data Engineer job openings:

Manager Databricks Data Engineer jobs near you

Lead Data Engineer (Data Engineering Tower Lead)

Irvine, CA • On-site

ClifyX
Recruiting and Staffing Services • 51 - 200 employees
Learn more about ClifyXexternal

$110K - $144K/yr

Other

Re-posted 13 days ago

Key responsibilities

  • Oversee enterprise-scale data engineering initiatives and manage multiple delivery teams.

  • Own end-to-end data platform delivery, ensuring platform stability, reliability, and operational excellence.

  • Partner with stakeholders to understand requirements, manage dependencies, and provide delivery updates.

Job description

Lead Data Engineer (Data Engineering Tower Lead)

Location: Irvine, CA
Experience: 8–14 Years

Position Overview

We are seeking an experienced Lead Data Engineer to oversee enterprise-scale data engineering initiatives and manage multiple delivery teams. This role will be responsible for end-to-end data platform delivery, operational excellence, platform reliability, and stakeholder engagement while driving scalable data solutions that support critical business functions.

The ideal candidate will possess strong expertise in modern data engineering platforms, workflow orchestration, cloud-native architectures, and large-scale data processing environments.

Required Skills & QualificationsData Engineering & Big Data Technologies
  • Strong hands-on experience with:
    • Databricks
    • Apache Spark
    • Distributed Data Processing
    • Performance Tuning & Optimization
  • Deep understanding of:
    • Data Engineering Architecture
    • ETL/ELT Frameworks
    • Data Warehousing Concepts
    • Large-Scale Data Platforms
  • Experience building scalable and reliable data pipelines.
Workflow Orchestration
  • Expertise in:
    • Apache Airflow
    • Astronomer
    • Workflow Automation
    • DAG Design & Management
  • Experience managing complex data workflows and dependencies.
DevOps & Platform Engineering
  • Strong knowledge of:
    • CI/CD Pipelines
    • DevOps Practices
    • Infrastructure as Code (IaC)
    • Automation Frameworks
  • Experience supporting cloud-native and enterprise data platforms.
Platform Operations & Reliability
  • Experience with:
    • Platform Monitoring
    • Incident Management
    • Alerting & Observability
    • Production Support
    • Operational Readiness
  • Proven ability to maintain highly available and resilient data environments.
Leadership & Stakeholder Management
  • Experience leading multiple data engineering teams, pods, or delivery streams.
  • Strong communication and stakeholder management skills.
  • Ability to coordinate across onshore, offshore, and distributed global teams.
  • Experience managing project risks, dependencies, and escalations.
Preferred Industry Experience
  • Asset Management
  • Investment Management
  • Capital Markets
  • Portfolio Analytics Platforms
  • Market Data Platforms
  • Financial Services Data Ecosystems
Key ResponsibilitiesTeam Leadership
  • Lead and manage multiple data engineering teams and delivery pods.
  • Provide technical direction, mentorship, and delivery oversight.
  • Foster collaboration across geographically distributed teams.
Data Platform Delivery
  • Own end-to-end delivery of enterprise data engineering solutions.
  • Drive development of scalable, high-performance data pipelines.
  • Ensure platform stability, reliability, and operational excellence.
Platform Operations
  • Establish and maintain monitoring, alerting, and incident management processes.
  • Ensure platform availability and production support readiness.
  • Drive continuous improvements in platform performance and reliability.
Stakeholder Engagement
  • Partner with business, technology, and leadership teams to understand requirements and priorities.
  • Manage cross-functional dependencies and project communications.
  • Provide regular updates on delivery progress, risks, and operational metrics.
Governance & Best Practices
  • Define and implement standards for:
    • Data Engineering Best Practices
    • Platform Governance
    • Operational Readiness
    • Performance Optimization
    • Automation & Deployment Processes
  • Promote engineering excellence and continuous improvement across teams.
Delivery & Operational Excellence
  • Ensure adherence to SLAs and operational objectives.
  • Drive data quality, scalability, and performance initiatives.
  • Lead issue resolution, root cause analysis, and production support activities.
Preferred Leadership Skills
  • Strong leadership and people management capabilities.
  • Excellent communication and stakeholder engagement skills.
  • Experience leading enterprise-scale data engineering programs.
  • Strong analytical, problem-solving, and decision-making abilities.
  • Ability to operate effectively in fast-paced, highly collaborative environments.
  • Experience managing globally distributed teams and complex delivery programs.
Keywords

Data Engineer Lead, Data Engineering Manager, Databricks, Apache Spark, Apache Airflow, Astronomer, ETL, ELT, Data Pipelines, Data Platform, CI/CD, DevOps, Infrastructure as Code, Cloud Data Engineering, Data Architecture, Big Data, Platform Reliability, Incident Management, Financial Services, Asset Management, Investment Management, Capital Markets, Team Leadership.

ClifyX logo

About ClifyX

Sourced by ZipRecruiter

ClifyX is a well-established player in the IT Services sector that specializes in providing result-oriented technological solutions to a wide range of industrial verticals. Based in South Plainfield, New Jersey, ClifyX offers a comprehensive selection of IT services that include project staffing, application development, professional consulting, and other IT-based solutions. While the company's website, clifyx.com, does not divulge the exact founding date, it is clear that ClifyX has grown into a renowned name within their domain, thanks to their unwavering commitment to innovative practices. The company's mission statement revolves around harnessing the power of technology to assist their clientele in steering their respective businesses towards success.

Industry

Recruiting and staffing services

Company size

51 - 200 Employees

Headquarters location

South Plainfield, NJ, US

Year founded

1998

View All ClifyX Jobs

Apply