Python Kubernetes Software Engineer Data Jobs in Texas

About the Team

Cloudflare handles traffic for almost 25% of the Internet. That's a lot of data. On the Town Lake team, our mission is to make that data accessible and valuable for users across the company. We connect data from dozens of source systems and make it available so that any user in the company can answer any question in 5 minutes or less, using SQL or plain english. 

We're building a modern, agentic-first data lakehouse platform based on Trino and Apache Iceberg, and all the supporting services for ingestion, transformation access control, governance, dashboarding and agentic access are built on Cloudflare's own platform. R2 and R2 Data Catalog for storage, Workers and Workers AI for compute, Workflows for orchestration, Durable Objects and D1 for state, Cloudflare Access for authentication. 

This is a small but growing team already having an outsized and highly visible impact at the company. If you're looking for an opportunity to make a splash, have a foundational say in a new, exciting and growing platform, and steer the direction on the frontier of data platforms, this team might be a good fit for you.

Read more about our platform in the Cloudflare blog (https://blog.cloudflare.com/our-unified-data-platform/). 

About the Role

We are looking for an experienced, product-minded principal software engineer to help take Town Lake from a fast-growing internal platform into the foundational data infrastructure for the entire company. 

You'll lead technical architecture and drive implementation for services across our whole stack, covering areas such as access control, an ingestion framework, AI-driven data classification, a semantic and governance layer, data product/ELT platform, a dashboarding and query tool, and more.

We are an agentic first team: we leverage AI deeply and comprehensively to accelerate development and make things possible that wouldn't be otherwise, and all our tools and services are agentic first for our users and the products they build on top of them.

Town Lake is already used by dozens of teams across Cloudflare including Billing, Trust & Safety, Developer Platform, GTM and Support organizations. This is a high-impact, high-visibility role where you'll work with critical teams across the company to solve real and interesting problems.

What You'll Do

• Define, design and execute strategic technical architecture for highly visible, highly critical data infrastructure at the company.

• Lead the design and development of tools and infrastructure to improve and scale our data infrastructure at Cloudflare.

• Lead the design and development of data pipelines and data products to serve customers throughout the company, including tools to automate delivery of those services.

• Become a subject matter expert across both our data platforms, tools and infrastructures as well as our data itself to guide and enable stakeholders with data needs.

• Work across our tech stack, which includes Kubernetes, Trino, Iceberg, Clickhouse, and PostgreSQL, with software built using Go, Javascript/Typescript, Python, and others.

• Mentor and support junior engineers on the team, reinforcing a culture of exceptional delivery and accountability on the team.

Requirements

• 8+ years of experience as a software engineer with a focus on designing, building and scaling data infrastructure

• Proven experience leading technical initiatives in a cross-functional context, working with multiple stakeholders and driving value delivery.

• Extensive experience with data infrastructure at scale, including tools like Trino, Spark, Iceberg/Delta Lake, Kafka, Clickhouse, PostgreSQL

• Experience designing, building and debugging data pipelines at scale

• Proficient using backend languages like Go, Python, Typescript, and Rust, along with SQL

• Excellent analytical skills, with a focus on understanding data and how stakeholders use it to drive value

• Strong communication skills, especially around articulating technical concepts for technical and non-technical audiences

• Experience creating and using agentic development workflows and an AI-first mentality

Desirable Skills

• Experience with data orchestration and infrastructure platforms like Airflow and DBT

• Experience deploying and managing infrastructure in Kubernetes

• Experience with data governance platforms and processes, with a focus on privacy and auditability

• Knowledge about machine learning models and MLOps