1

Data Engineer Python Jobs in California (NOW HIRING)

Data Engineer

Sunnyvale, CA · On-site

$136K - $163K/yr

Data Engineer ( python, pyspark, scala, airflow) Location:Sunnyvale CA ( Hybrid ) Duration: 6 to 12+ Months Rate: DOE Bachelor or master's degree in computer science, Software Engineering, or a ...

AWS Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

AWS Data Engineer (Python, Dataiku) Location: SFO, CA - Hybrid Job Brief As an AWS Data Engineer, your role will be to design, develop, and maintain scalable data pipelines on AWS. You will work ...

Job Summary : Diverse Lynx is seeking a Lead Python Data Engineer to join their team. The role involves hands-on experience in Python data engineering and requires expertise in AWS and data ...

Must have strong experience in Python Programming. Must have strong experience in SQL. Experience in building and optimizing data pipelines, architectures and data sets. Experience in processing and ...

The Role As a Python Software Engineer, you will own AnySignal's data aggregation, test, and automation framework that enables testing of hardware, software, and DSP systems. You will work closely ...

The Role As a Python Software Engineer, you will own AnySignal's data aggregation, test, and automation framework that enables testing of hardware, software, and DSP systems. You will work closely ...

The Role As a Python Software Engineer, you will own AnySignal's data aggregation, test, and automation framework that enables testing of hardware, software, and DSP systems. You will work closely ...

New

next page

Showing results 1-20

Data Engineer Python information

What is a data engineer python?

A Data Engineer Python job involves designing, building, and maintaining data pipelines using Python. These professionals ensure data is collected, processed, and stored efficiently for analytics and machine learning. They work with databases, cloud platforms, and big data technologies to optimize data workflows. Strong Python skills, SQL knowledge, and experience with ETL processes are essential for this role.

What does a data engineer python do?

As a Data Engineer Python, your daily tasks will often include designing, building, and maintaining robust data pipelines to collect, process, and store large sets of structured and unstructured data. You’ll frequently work with Python to automate data workflows and ensure data quality, while also collaborating with data scientists, analysts, and other engineering teams to support shared objectives. Monitoring system performance, troubleshooting issues, and optimizing data processes for scalability and efficiency are also key parts of the role. This position offers an engaging mix of technical problem-solving and cross-functional teamwork in a dynamic data-driven environment.

What are the key skills and qualifications needed to thrive in the data engineer python position?

To thrive as a Data Engineer Python, you need strong programming skills in Python, a solid understanding of data modeling, ETL processes, and often a degree in computer science or a related field. Experience with big data tools like Apache Spark or Hadoop, cloud data platforms such as AWS or Azure, and certifications in data engineering are valuable assets. Analytical thinking, attention to detail, and effective communication are important soft skills for collaborating across teams and solving complex data challenges. These qualifications are critical for successfully designing, building, and maintaining scalable data pipelines that support organizational decision-making.

How much does a Data Engineer Python make?

A Data Engineer specializing in Python typically earns between $90,000 and $130,000 annually, depending on experience, location, and industry. Senior roles or those with expertise in big data tools like Spark or Hadoop may have higher salaries, especially in high-demand markets.

What job categories do people searching Data Engineer Python jobs in California look for?

The top searched job categories for Data Engineer Python jobs in California are:

Infographic showing various Data Engineer Python job openings in California as of August 2026, with employment types broken down into 1% As Needed, 88% Full Time, 9% Part Time, and 2% Contract. Highlights an 85% Physical, 4% Hybrid, and 11% Remote job distribution.

Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract [...]

Central Business Solutions, Inc

Irvine, CA • On-site

$170 - $250/hr

Other

Posted 2 days ago

New


Job description

  • Irvine, CA
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) |

Title: Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big-data)

Location: Irvine, CA (Hybrid)

Position Type: Contract to Hire

Responsibilities
  • As a Data Software Engineer Sr. Staff, you will be responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems. They will support software developers, database architects, data scientists on data initiatives and will contribute optimal data delivery architecture.
What you will be doing
  • Data Operations
  • Lead the creation of data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc.
  • Perform offline analysis of large data sets using components of a big data software ecosystem.
  • Validate the solution of root cause analysis escalated by various technical staff in multiple organizations and with differing levels of expertise.
  • Investigate, evaluate, test and recommend technical solutions for future systems.
Data Management
  • Own product data sets from the definition phase through to production deployment (end-to-end).
  • Provide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.
  • Deploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.
  • Monitor HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.
  • Lead and develop tools and procedures to monitor and automate system tasks on servers and clusters
  • Lead and collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases.
  • Data Design
  • Lead and design distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
  • Lead and design big data technologies and prototype solutions to improve data processing architecture.
Qualifications
  • Bachelor’s degree in computer science, computer engineering, or a related technical field.
  • 12+ years of professional experience as a data software engineer; or 16+ years of related experience as a data software engineer in lieu of 4-year degree.
  • 2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning.
  • Related AWS certification, preferred.
  • Previous experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.
  • Expertise in database concepts, object and data modeling techniques and design principles.
  • Expertise in database architectures, software, and facilities
  • Expertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL
  • Expertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR
  • Expertise with stream-processing systems: Kinesis, Kafka, MQTT
  • Expertise with relational NoSQL databases including DyanamoDB
  • Expertise in writing JSON, XML, YAML and other data definition schemas
  • Excellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.
  • Ability to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry.
  • Ability to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.
  • Ability to lead and mentor junior engineers and colleagues.

Central Business Solutions, Inc(A Certified Minority Owned Organization)

#J-18808-Ljbffr