Fireworks AI

60 Fireworks Ai Jobs Hiring Near You

Software Engineer, AI Infrastructure

Manhattan, NY ยท On-site

$190K - $225K/yr

Fireworks AI is a leading company in generative AI infrastructure, known for its high-quality models and fast inference capabilities. The Software Engineer on the AI Infrastructure team will design ...

Enterprise Account Executive

New York, NY ยท On-site +1

$300K - $330K/yr

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been ...

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been ...

Strategic Projects Lead

San Mateo, CA ยท On-site

$160K - $200K/yr

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been ...

Gain a deep understanding of Fireworks AI's offerings and value proposition, effectively articulating them in the market * Focus on pipeline generation within your targeted accounts to ensure ...

next page

Showing results 1-20

Fireworks AI Jobs Information

What are the most popular states for Fireworks Ai jobs?
What are the most popular categories at Fireworks Ai?
Infographic showing various job openings at Fireworks Ai in the United States as of July 2026, with employment types broken down into 100% Full Time. Highlights an 76% Physical, and 24% Remote job distribution.

Software Engineer, AI Infrastructure

Fireworks AI

Manhattan, NY โ€ข On-site

$190K - $225K/yr

Full-time

Posted 24 days ago


Job description

Job Summary:
Fireworks AI is a leading company in generative AI infrastructure, known for its high-quality models and fast inference capabilities. The Software Engineer on the AI Infrastructure team will design and build core systems to ensure the reliability and performance of the generative AI platform, collaborating closely with various teams to deliver effective infrastructure solutions.
Responsibilities:
โ€ข Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines
โ€ข Build and maintain core backend services such as LLM CI/CD pipeline, control plane, and model serving systems
โ€ข Support performance optimization, cost efficiency, and reliability improvements across compute, storage, and networking layers
โ€ข Building frameworks and safeguards to ensure Fireworks AI has the best model quality in the industry
โ€ข Collaborate with performance, training, and product teams to translate research and product needs into infrastructure solutions
โ€ข Participate in code reviews, technical discussions, and continuous integration and deployment processes
Qualifications:
Required:
โ€ข Bachelorโ€™s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
โ€ข 3 years of experience in software engineering, with a focus on infrastructure or machine learning systems
โ€ข Strong programming skills in Python, Go, or a similar language
โ€ข Proven experience in ML infrastructure and tooling (e.g., PyTorch, MLflow, Vertex AI, SageMaker, Kubernetes, etc.)
โ€ข Basic understanding of LLM knowledge (e.g., context length, disaggregated prefill, KV cache memory estimation, etc)
Preferred:
โ€ข 5+ years of experience in software engineering, with a focus on infrastructure or machine learning systems
โ€ข Experience with open source inference engine like vLLM, Sglang, or TRT-LLM
โ€ข Contributions to open-source infrastructure or ML projects
โ€ข Experience in building large scale ML/MLOps infrastructure
Company:
Fireworks AI is an advanced platform that enables users to build, tune, and scale AI applications using open-source models Founded in 2022, the company is headquartered in Redwood City, USA, with a team of 51-200 employees. The company is currently Growth Stage.