1

Temporary Databricks Data Engineer Jobs in California

Senior Databricks Data Engineer Location-Type: Onsite, Santa Monica, CA (office relocation to Century City anticipated within approximately one year) Start Date: ASAP Duration: Permanent Compensation ...

Senior Data Engineer (AI & Databricks) Location: Las Vegas, NV / Calabasas, CA Work Model: Onsite (4 days/week) Employment Type: Full-Time Work Authorization: U.S. Citizens (USC) & Green Card Holders ...

Senior Databricks Data Engineer

Calabasas, CA ยท On-site

$120K - $145K/yr

Senior Data Engineer (AI & Databricks) Location: Las Vegas, NV / Calabasas, CA Work Model: Onsite (4 days/week) Employment Type: Full-Time Work Authorization: U.S. Citizens (USC) & Green Card Holders ...

Data Engineer

Bay Point, CA ยท On-site

$125K - $151K/yr

Databricks Data Engineer Location: [Bay Area, CA] Duration : 12+ Months Need experience with Databricks Job Summary: We are seeking a skilled Data Engineer with hands-on Databricks experience to ...

Data Engineer

Pleasanton, CA ยท On-site

$127K - $152K/yr

Job#: 3044330 Apex Systems is hiring a Data Engineer with Databricks experience for a large Healthcare client. Location: Fully remote anywhere in the US. Role Overview We are seeking a Data Engineer ...

Data Engineer

Rancho Cordova, CA ยท On-site

$122K - $146K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Data Engineer

Rancho Cordova, CA ยท On-site

$90K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Data Engineer

Rancho Cordova, CA ยท On-site

$124K - $148K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Data Engineer

Pasadena, CA ยท On-site

$124K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Data Engineer

Pasadena, CA ยท On-site

$124K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

next page

Showing results 1-20

Temporary Databricks Data Engineer information

What is the difference between Temporary Databricks Data Engineer vs Temporary Spark Data Engineer?

AspectTemporary Databricks Data EngineerTemporary Spark Data Engineer
Required SkillsDatabricks platform, Spark, SQL, Python, cloud servicesApache Spark, Scala, Python, SQL, cloud environments
CertificationsDatabricks Certified Data Engineer, cloud certificationsApache Spark certifications, cloud certifications
Work EnvironmentCloud-based Databricks platform, collaborative environmentOn-premises or cloud Spark clusters, flexible environments
Industry UsageData engineering projects leveraging Databricks platformBig data processing using Spark in various environments

While both roles involve Spark and cloud skills, a Temporary Databricks Data Engineer specializes in the Databricks platform, offering integrated tools and collaborative features. A Temporary Spark Data Engineer focuses on Spark core technology, often working in diverse environments. The choice depends on the specific platform and tools used by the employer.

What are the most commonly searched types of Databricks Data Engineer jobs in California?

The most popular types of Databricks Data Engineer jobs in California are:

What cities in California are hiring for Temporary Databricks Data Engineer jobs?

Cities in California with the most Temporary Databricks Data Engineer job openings:

AWS Databricks Data Engineer

Tror AI for everyone

Los Angeles, CA โ€ข On-site

$123K - $148K/yr

Contractor

Re-posted 7 days ago


Job description

Job Title: AWS Databricks Data Engineer

Job Location: Los Angeles CA (Hybrid)

Hire type: FTE / CTH

Note: Only Locals to California

 

Job Description –

We are seeking a highly skilled AWS Data Engineer with strong expertise in SQL, Python, PySpark, Data Warehousing, and Cloud-based ETL to join our data engineering team. The ideal candidate will design, implement, and optimize large-scale data pipelines, ensuring scalability, reliability, and high performance. This role requires close collaboration with cross-functional teams and business stakeholders to deliver modern, efficient data solutions.

Key Responsibilities

1. Data Pipeline Development

  • Build and maintain scalable ETL/ELT pipelines using Databricks on AWS.
  • Leverage PySpark/Spark and SQL to transform and process large, complex datasets.
  • Integrate data from multiple sources including S3, relational/non-relational databases, and AWS-native services.

2. Collaboration & Analysis

  • Partner with downstream teams to prepare data for dashboards, analytics, and BI tools.
  • Work closely with business stakeholders to understand requirements and deliver tailored, high‑quality data solutions.

3. Performance & Optimization

  • Optimize Databricks workloads for cost, performance, and efficient compute utilization.
  • Monitor and troubleshoot pipelines to ensure reliability, accuracy, and SLA adherence.
  • Apply query optimization, Spark tuning, and shuffle minimization best practices when handling tens of millions of rows.

4. Governance & Security

  • Implement and manage data governance, access control, and security policies using Unity Catalog.
  • Ensure compliance with organizational and regulatory data‑handling standards.

5. Deployment & DevOps

  • Use Databricks Asset Bundles for deployment of jobs, notebooks, and configuration across environments.
  • Maintain effective version control of Databricks artifacts using GitLab or similar tools.
  • Use CI/CD pipelines to support automated deployments and environment setups.

Technical Skills (Required)

  • Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Workflows, Delta Live Pipelines, Databricks Runtime, etc.).
  • Proven ability to implement robust PySpark solutions.
  • Hands‑on experience with Databricks Workflows & orchestration.
  • Solid knowledge of Medallion Architecture (Bronze/Silver/Gold).
  • Significant experience designing or rebuilding batch‑heavy data pipelines.
  • Strong background in query optimization, performance tuning, and Spark shuffle optimization.
  • Ability to handle and process tens of millions of records efficiently.
  • Familiarity with Genie enablement concepts (understanding required; deep experience optional).
  • Experience with CI/CD, environment setup, and Git-based development workflows.
  • Solid understanding of AWS cloud, including:
  • IAM
  • Networking fundamentals
  • Storage integration (S3, Glue Catalog, etc.)

Preferred Experience

  • Experience with Databricks Runtime configurations and advanced features.
  • Knowledge of streaming frameworks such as Spark Structured Streaming.
  • Experience developing real-time or near real-time data solutions.
  • Exposure to GitLab pipelines or similar CI/CD systems.

Certifications (Optional)

  • Databricks Certified Data Engineer Associate / Professional
  • AWS Data Engineer or AWS Solutions Architect certification

Thanks & Regards

Akhil

akhil@tror.ai