ZipRecruiter

Log In

1

Python Kubernetes Software Engineer Data Jobs in Walnut Creek, CA

Sift

Staff Software Engineer, Data

San Francisco, CA · On-site

The Staff Software Engineer, Data will design and build scalable data infrastructure to support ... Rust, or Python • Familiarity with DevOps and cloud infrastructure tools such as Kubernetes ...

Airtable

Software Engineer, Data

San Francisco, CA · On-site

$134K - $162K/yr

They are seeking a Software Engineer, Data to design and maintain critical data pipelines that ... Python) and are willing to pick up others as the work demands. • Highly effective with SQL and ...

OpenAI

Software Engineer, Data Acquisition

San Francisco, CA · On-site

$134K - $162K/yr

They are looking for a skilled Software Engineer to join their Data Acquisition team, responsible ... Kubernetes Infrastructure-as-Code environment and perform routine system checks. • Conduct and ...

next page

Showing results 1-20

All JobsPython Kubernetes Software Engineer Data JobsPython Kubernetes Software Engineer Data Jobs in Walnut Creek, CA

Python Kubernetes Software Engineer Data information

What are popular job titles related to Python Kubernetes Software Engineer Data jobs in Walnut Creek, CA? For Python Kubernetes Software Engineer Data jobs in Walnut Creek, CA, the most frequently searched job titles are:
What job categories do people searching Python Kubernetes Software Engineer Data jobs in Walnut Creek, CA look for? The top searched job categories for Python Kubernetes Software Engineer Data jobs in Walnut Creek, CA are:
What cities near Walnut Creek, CA are hiring for Python Kubernetes Software Engineer Data jobs? Cities near Walnut Creek, CA with the most Python Kubernetes Software Engineer Data job openings:
Python Kubernetes Software Engineer Data jobs near you

Software Engineer, Data Infrastructure

Peregrine

San Francisco, CA • On-site

$134K - $162K/yr

Full-time

Re-posted 19 days ago

Job description

Job Summary:
Peregrine is a company that helps public safety organizations and governments address societal challenges using their AI-enabled platform. They are seeking a Data Infrastructure Engineer to own the data layer and build systems for ingesting, storing, and serving real-time operational data, enabling critical decision-making for their customers.
Responsibilities:
• Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
• Architecting a scalable open table format layer for reliable data storage at petabyte scale
• Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
• Driving performance, reliability, and cost efficiency across the full data infrastructure stack
• Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
• Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization
Qualifications:
Required:
• 2-5 years of experience operating large-scale data infrastructure systems in production environments
• Experience with open table formats, particularly Apache Iceberg — including schema evolution, partitioning strategies, compaction, and time travel
• Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
• Background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
• Experience with data pipeline orchestration using Airflow or similar tools
• Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
• Experience with AWS or comparable cloud platforms, including S3-based data lake architectures
• Experience with Kubernetes and containerized deployment of data workloads
• Degree in Computer Science, Engineering, or a related field, or equivalent practical experience
• Located in San Francisco and open to working in office
Company:
Context changes everything. Founded in 2018, the company is headquartered in San Francisco, USA, with a team of 201-500 employees. The company is currently Growth Stage.

Apply