ZipRecruiter

Log In

1

Software Engineer Data Infrastructure Kafka Jobs

Instacart

Staff Software Engineer, Data Infrastructure

OR · Remote

$114K - $137K/yr

We're looking for a Staff Software Engineer to join our Data Governance and Foundations Team. In ... Experience with event-driven and streaming infrastructure (e.g., Kafka, Flink) for real-time ...

next page

Showing results 1-20

People also search for

All JobsSoftware Engineer Data Infrastructure Kafka Jobs

Software Engineer Data Infrastructure Kafka information

See salary details

$44.5K

$129.7K

$177.5K

How much do software engineer data infrastructure kafka jobs pay per year?

As of Jun 7, 2026, the average yearly pay for software engineer data infrastructure kafka in the United States is $129,716.00, according to ZipRecruiter salary data. Most workers in this role earn between $114,500.00 and $137,500.00 per year, depending on experience, location, and employer.

What is the difference between Software Engineer Data Infrastructure Kafka vs Data Engineer?

AspectSoftware Engineer Data Infrastructure KafkaData Engineer
Primary FocusDeveloping and maintaining Kafka-based data pipelines and infrastructureDesigning, building, and managing data systems and pipelines across various platforms
Required SkillsKafka, distributed systems, programming (Java, Python), data streamingSQL, ETL, data modeling, cloud platforms, scripting
Work EnvironmentCollaborates with data teams, DevOps, and software developers in tech environmentsWorks with data analysts, data scientists, and business teams in data-driven companies

Both roles involve data infrastructure but differ in scope. Software Engineer Data Infrastructure Kafka specializes in Kafka and streaming data pipelines, while Data Engineers focus on broader data systems and pipelines across multiple platforms. The choice depends on whether the focus is on Kafka-specific infrastructure or comprehensive data system management.

What are the key skills and qualifications needed to thrive as a Software Engineer Data Infrastructure Kafka, and why are they important?

To thrive as a Software Engineer Data Infrastructure Kafka, you need strong programming skills (Java, Scala, or Python), experience with distributed systems, and a solid understanding of data architecture, typically supported by a degree in computer science or a related field. Proficiency in Apache Kafka, stream processing frameworks (e.g., Kafka Streams, Flink), and familiarity with cloud platforms (AWS, GCP, or Azure) are essential, with certifications in cloud technologies or Kafka being advantageous. Excellent problem-solving, collaboration, and communication skills help you work effectively in cross-functional teams and address complex data challenges. These skills and qualities are crucial for building reliable, scalable data pipelines that support business-critical applications.

What does a Software Engineer Data Infrastructure Kafka do?

A Software Engineer Data Infrastructure Kafka specializes in designing, building, and maintaining large-scale data systems that use Apache Kafka for real-time data streaming and processing. This role involves developing robust pipelines, ensuring data reliability and scalability, and supporting the integration of Kafka with other data storage and analytics systems. Engineers in this position also monitor system performance, troubleshoot issues, and implement best practices for security and data management. They work closely with data engineers, application developers, and operations teams to deliver high-quality data solutions.

What are some common challenges faced by Software Engineers working on Data Infrastructure with Kafka, and how can they be addressed?

Software Engineers focusing on Data Infrastructure with Kafka often encounter challenges such as ensuring high availability, managing large-scale data throughput, and maintaining data consistency across distributed systems. Another common hurdle is tuning Kafka for optimal performance under varying workloads. These challenges can be addressed by implementing robust monitoring, practicing careful partitioning and replication strategies, and collaborating closely with DevOps and data engineering teams. Staying updated with Kafka's latest features and best practices also helps in proactively mitigating issues.
More about Software Engineer Data Infrastructure Kafka jobs
What states have the most Software Engineer Data Infrastructure Kafka jobs? States with the most job openings for Software Engineer Data Infrastructure Kafka jobs include:
What job categories do people searching Software Engineer Data Infrastructure Kafka jobs look for? The top searched job categories for Software Engineer Data Infrastructure Kafka jobs are:
Software Engineer Data Infrastructure Kafka jobs near you
Infographic showing various Software Engineer Data Infrastructure Kafka job openings in the United States as of May 2026, with employment types broken down into 11% Internship, and 89% Full Time. Highlights an 89% In-person, and 11% Remote job distribution, with an average salary of $129,716 per year, or $62.4 per hour.

Staff Software Engineer, Data Platform (Strong Clojure Required)

Ladder

Remote

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 16 days ago

Job description

Staff Software Engineer, Data Platform
About Ladder
We saw a problem within the life insurance industry: getting covered took too long, involved too much paperwork, and required too many in-person meetings with sales agents. Having lost his father at a young age, our CEO, Jamie, was determined to make it easier for people to get the coverage they needed to provide for their families. So, we got to work. We developed a method of real-time underwriting leveraging AI and, in doing so, reduced the months-long process of applying for life insurance to minutes. Our digital experience is quick (instant decisions!), loved by users (check out our Trustpilot or Google reviews) and prolific ($74 billion+ in coverage provided).
About the role
We are looking for a powerhouse Staff Software Engineer with battle-tested experience building ETL pipelines at massive scale. You will take ownership of our toughest backend and data plumbing challenges, bridging our transactional systems (Datomic) with our analytical and streaming infrastructure (BigQuery, Kafka, Flink, DBT) to architect resilient, elegant, and high-volume data pipelines. If you dream in immutable data structures and love using functional programming to untangle architectural knots, we need you.
The ideal candidate brings demonstrated experience in software engineering, leadership maturity and a deep understanding of engineering infrastructure.
This is a remote role based in one of the 22 States Ladder is currently hiring in - AZ, CA, CO, CT, FL, GA, KS, MA, MD, MN, NC, NH, NJ, NV, NY, OH, OR, PA, TX, VA, WA, WI. Please note, Ladder is not currently sponsoring or transferring OPT or H1-B visa's.
How You'll Make a Difference
As a senior technical leader on the team, you won't just be writing code, you'll be shaping our entire data strategy. You will:
  • Architect and Build: Design, deploy, and scale robust data pipelines that reliably move and transform data between Datomic, Kafka, and BigQuery.
  • Tame the Chaos: Build elegant, fault-tolerant ETL systems leveraging frameworks like DBT to ingest, sanitize, and normalize messy, unstructured data from dozens of third-party APIs and legacy vendors.
  • Master the Stream: Evolve our event-driven architecture, optimizing streaming performance (Kafka/BEAM) to support real-time machine learning models
  • Drive Technical Excellence: Act as a force multiplier for the engineering team. You'll set standards for backend architecture in Clojure, mentor peers, and make high-stakes technical decisions that scale with our rapid growth.
  • Bridge the Gap: Partner closely with Data Science, Product and Business Development teams to ensure our data infrastructure proactively serves the evolving needs of the business.
Who You Are
  • A seasoned technical leader: You bring 8+ years of rigorous software or data engineering experience to the table, backed by a strong academic foundation (BS or MS in Computer Science or a related field). You have a proven track record operating at a Staff or Principal level, where you don't just write code - you define technical strategy and mentor teams.
  • A Clojure authority: You have deep, production-grade experience natively architecting complex backend systems in Clojure and the JVM. Functional programming and immutable data structures aren't just concepts to you; they are your preferred tools for building highly reliable software.
  • A medallion architect: You have 4+ battle-tested years designing high-volume ETL/ELT pipelines at massive scale. You are an expert at structuring data lakes through Raw/Bronze, Cleansed/Silver, and Curated/Gold layers, and you rely on advanced dbt modeling to ensure pristine data quality.
  • A modern data stack master: You have extensive, hands-on experience operating cloud data warehouses (specifically BigQuery), streaming infrastructure (Kafka), and processing frameworks (Apache Beam, Flink, or Spark). Wrangling messy, unstructured third-party API data into clean, ready-to-query models is second nature to you.
  • An autonomous systems thinker: You thrive in ambiguity and deeply understand the harsh realities of distributed systems. You don't just patch bugs; you design elegant, event-driven architectures that prevent entire classes of problems from happening in the first place.
Technologies We Use
  • Backend: Clojure, JVM
  • Data: Datomic, BigQuery, BEAM, Sigma, SQL
  • Infrastructure: Kafka, Docker, Kubernetes, Packer, Terraform, GCP, GraphQL
  • Frontend: Typescript, JavaScript, React
What we Offer
Ladder is highly collaborative and fun. To support you in your role, we offer fantastic perks and benefits that reflect our mission of care and support, including:
  • Excellent medical, dental, and vision coverage | We offer competitive healthcare,dental and vision plans for you and your family.
  • Flexible paid time off | Take the time that you need to rest and recharge, including our week-long winter holiday closure.
  • Stock options | We offer competitive stock option packages to participate in the success of building Ladder
  • A rewarding 401k match program | We'll match up to 4% of your contributions as you save for your retirement goals.
  • Ladder Fit Program | Your health matters. That's why Ladder provides a monthly reimbursement for wellness-related expenses.
  • Paid parental leave |We think it's crucial that new parents have time to adjust to their new lives without worrying about work, so we provide all parents inclusive of birthing, adoption, or fostering ten weeks of paid baby bonding.
  • Work-from-home flexibility and support | We recognize that everyone's homelife is different and support remote work. Upon joining, we provide a one-time remote office stipend for all team members and then a monthly stipend to cover WFH costs such as the internet.
  • Fun company-wide events | Whether we work locally or remotely, we genuinely enjoy spending time together. That's why we plan fun virtual and in-person events to let loose and laugh.

The base pay range targeted for this position is $160,000 - $230,000. This role is eligible for equity and benefits as shared above. Base pay is determined by market location and may vary depending on job-related knowledge, skills, and experience.
Ladder is building a diverse team of talented and enthusiastic people. We are an equal opportunity workplace. At Ladder, differences are celebrated and supported to benefit our people, product, and community. Let us know why you're interested in this position and what unique contributions you can make to the Ladder team. We look forward to hearing from you.
Research shows that candidates from underrepresented backgrounds often don't apply for roles if they don't meet all the criteria - unlike majority candidates meeting significantly fewer requirements. We strongly encourage you to apply if you're interested: we'd love to know how you can elevate our team with your unique experience!
By clicking "Submit Application," you acknowledge that you have read and agree to the Ladder Job Applicant Privacy Policy and Notice at Collection.

Apply