... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...

60 Apache Software Designer Jobs Hiring Near You
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
California, MD · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
California, MD · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Toronto, ON · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Toronto, ON · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Senior Software Engineer - UDS Registry Team (RD119)
$125K - $165K/yr
You'll collaborate closely with product managers, designers, and end users to ensure we're building ... Participating in Cloud Native Computing Foundation (CNCF), Apache Software Foundation (ASF), or ...
Senior Software Engineer - UDS Registry Team (RD119)
$125K - $165K/yr
You'll collaborate closely with product managers, designers, and end users to ensure we're building ... Participating in Cloud Native Computing Foundation (CNCF), Apache Software Foundation (ASF), or ...
Staff Software Engineer - Apache Spark
Ottawa, ON · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Ottawa, ON · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
CA$184K - CA$230K/yr
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale--running Spark on thousands of nodes and ...
CA$184K - CA$230K/yr
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale--running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Washington, DC · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Washington, DC · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Virginia, IL · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Staff Software Engineer - Apache Spark
Virginia, IL · On-site +1
... Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You ... designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and ...
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Annapolis Junction, MD · On-site
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Annapolis Junction, MD · On-site
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Senior Software Engineer - Zarf Team (RD120)
$125K - $165K/yr
You'll collaborate closely with product managers, designers, and end users to ensure we're building ... Participating in Cloud Native Computing Foundation (CNCF), Apache Software Foundation (ASF), or ...
Senior Software Engineer - Zarf Team (RD120)
$125K - $165K/yr
You'll collaborate closely with product managers, designers, and end users to ensure we're building ... Participating in Cloud Native Computing Foundation (CNCF), Apache Software Foundation (ASF), or ...
Senior Software Engineer - Apache Kafka Infrastructure
New York, NY · On-site
$134K - $176K/yr
Senior Software Engineer - Apache Kafka Infrastructure Location New York Business Area Engineering ... Experience designing and implementing low-latency, high-volume, and high-availability distributed ...
Senior Software Engineer - Apache Kafka Infrastructure
New York, NY · On-site
$134K - $176K/yr
Senior Software Engineer - Apache Kafka Infrastructure Location New York Business Area Engineering ... Experience designing and implementing low-latency, high-volume, and high-availability distributed ...
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Annapolis, MD · On-site
$130K - $270K/yr
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Annapolis, MD · On-site
$130K - $270K/yr
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Apache Doris Infrastructure
Sunnyvale, CA · On-site
... available software services or platform infrastructure - Experience in designing, building, and ... Apache Kafka or similar
Quick apply
Apache Doris Infrastructure
Sunnyvale, CA · On-site
... available software services or platform infrastructure - Experience in designing, building, and ... Apache Kafka or similar
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
$130K - $270K/yr
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
$130K - $270K/yr
... Apache Spark based distributed processing ... In this role, the Software Engineer shall be responsible for designing, implementing, and ...
Software Development Manager, Managed Streaming for Apache Kafka
Santa Monica, CA · On-site
$138K - $183K/yr
The ideal candidate has experience driving and designing large-scale systems supporting millions of ... or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark ...
Software Development Manager, Managed Streaming for Apache Kafka
Santa Monica, CA · On-site
$138K - $183K/yr
The ideal candidate has experience driving and designing large-scale systems supporting millions of ... or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark ...
Apache Jobs Information
What other companies are hiring for Software Designer jobs?
What are the most popular jobs at Apache?

Job description
Business Area:
EngineeringSeniority Level:
Mid-Senior levelJob Description:
At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world's largest enterprises.
The Data Platform Pillar is the bedrock of Cloudera's technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance.
Are you ready to architect the future of big data? Cloudera is searching for a visionary Staff Software Engineer with deep expertise in distributed systems to join the Apache Spark Team. You will be at the forefront of innovation, building our next-generation, enterprise-grade system designed to conquer data challenges at a massive scale-running Spark on thousands of nodes and crunching petabytes of data for the world's largest companies. This is your chance to directly influence the open-source community as a key contributor to Apache Spark while collaborating with a high-impact, distributed team that includes multiple Spark committers. If you're passionate about pushing the boundaries of distributed data processing, come build the impossible with us.
As a Staff Engineer you will:
-
Pioneer Scalable Solutions: Architect, implement, and deliver next-generation features for Cloudera's Data Engineering Experience, operating at a massive scale on thousands of production nodes.
-
Drive Open-Source Innovation: Be a core contributor to Apache Spark, directly shaping the future of distributed data processing in the open-source community.
-
Build with Modern Stacks: Develop high-performance features using Scala, Java, and Python on modern data platforms.
-
Deepen Technical Mastery: Gain and apply expert-level knowledge in core distributed data processing concepts, including:
-
SQL Planners and Optimizers
-
Data layout and modern table formats like Apache Parquet and Iceberg
-
Fault tolerance and resilience in large-scale distributed systems.
-
-
Own the Technology Stack: Develop a deep technical understanding of components across the Cloudera Data Engineering Experience, with a focus on Iceberg and Spark, applying this knowledge to your daily tasks.
-
Conquer Large-Scale Challenges: Work hands-on with massive distributed systems, scaling from hundreds to thousands of nodes in live production clusters.
-
Ensure System Integrity: Conduct thorough root cause analysis, debug complex system-level deployment issues, and resolve failures to maintain high system quality.
-
Enhance Engineering Velocity: Improve internal infrastructure and tooling to streamline development, testing, and deployment processes.
-
Collaborate and Influence: Work closely with a high-impact, distributed team and stakeholders to drive product vision and delivery.
-
Professional Experience: 5-7+ years of experience in professional software development.
-
Spark Internals Expertise: requirement, specifically calling for hands-on experience with query execution plans (logical and physical), memory management (Tungsten, off-heap allocation, GC tuning), and core data processing flows.
-
Leadership & Delivery: Proven experience leading technical initiatives and delivering complex product enhancements from concept to production.
-
Core Languages: Strong proficiency in Java, Scala, or other JVM-based language.
-
Systems Expertise: Solid experience in the design and development of distributed systems.
-
Engineering Excellence: Passion for clean coding, attention to detail, and a focus on software quality and maintainability.
-
Communication: Strong oral and written communication skills for effective collaboration across a distributed team.
-
Autonomy: Demonstrated ability to research, problem-solve, and operate independently without constant supervision.
-
Growth Mindset: An open-minded approach with a desire to learn new technologies and an unwavering passion for building exceptional products.
-
Spark & Ecosystem Experience with using/developing Apache Spark, Apache Iceberg, or other related technologies.
-
Distributed Systems Mastery: Deep experience with large-scale, distributed systems design and development, including a strong understanding of scaling, performance optimization, and scheduling.
-
SQL Expertise: Experience with SQL Planners and Optimizers
-
Open-Source Contributions: Prior experience as a contributor to open-source projects.
Why this role matters:
You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling.
Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact.
The expected base salary range for this role in:
-
California & Washington is $184,000 - $230,000 USD
-
Canada is $165,000 - $206,000 CAD
The salary will vary depending on your job-related skills, experience and location.
This position is not eligible for sponsorship.
What you can expect from us:
-
Generous PTO Policy
-
Support work life balance with Unplugged Days
-
Flexible WFH Policy
-
Mental & Physical Wellness programs
-
Phone and Internet Reimbursement program
-
Access to Continued Career Development
-
Comprehensive Benefits and Competitive Packages
-
Paid Volunteer Time
-
Employee Resource Groups
EEO/VEVRAA
#LI-REMOTE
#LI-SZ1
About Cloudera
Sourced by ZipRecruiter
Industry
Software development
Company size
1,001 - 5,000 Employees
Headquarters location
Santa Clara, CA, US
Year founded
2008