Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI inference. In this role, you will lead the architecture, development, and optimization of the inference ...
Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI inference. In this role, you will lead the architecture, development, and optimization of the inference ...
Senior AI SDE III -- GenAI & ML Platform
San Jose, CA · On-site
$143K - $189K/yr
Senior Software Development Engineer, Advertising Technology Austin Domain 11 - HomeAway onsite Jul ... Senior Software Development Engineer (GenAI, Agentic AI) Washington - Seattle Campus onsite Jun 30 ...
Senior AI SDE III -- GenAI & ML Platform
San Jose, CA · On-site
$143K - $189K/yr
Senior Software Development Engineer, Advertising Technology Austin Domain 11 - HomeAway onsite Jul ... Senior Software Development Engineer (GenAI, Agentic AI) Washington - Seattle Campus onsite Jun 30 ...
Sr. Software Engineer, GenAI
Concord, NC · Remote
$220K/yr
Required * 7+ years of professional software engineering experience, with deep, recent, multi-year Python and strong relational database and schema design skills. * Solid CS fundamentals and a ...
Quick apply
Sr. Software Engineer, GenAI
Concord, NC · Remote
$220K/yr
Required * 7+ years of professional software engineering experience, with deep, recent, multi-year Python and strong relational database and schema design skills. * Solid CS fundamentals and a ...
AI Software Engineer (GenAI / LLM)
Barnegat, NJ · On-site
$110K - $148K/yr
Descripcion del empleo Estamos buscando un/a profesional AI Software Engineer (GenAI / LLM) para incorporarse en nuestro equipo y formar parte de un proyecto internacional del sector asegurador.
AI Software Engineer (GenAI / LLM)
Barnegat, NJ · On-site
$110K - $148K/yr
Descripcion del empleo Estamos buscando un/a profesional AI Software Engineer (GenAI / LLM) para incorporarse en nuestro equipo y formar parte de un proyecto internacional del sector asegurador.
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
WI · On-site
$150 - $210/hr
Experience in software engineering or a directly related field. * Experience in developing and/or implementing web-based or mobile applications. * Experience in a leadership role with or without ...
New
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
Software Engineer, GenAI Integrations
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
Software Engineer, GenAI Integrations
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
As a Visa Software Engineer, you will be an integral part of a multi-functional development team ... Proven ability to build end-to-end GenAI features, from data ingestion and backend services to APIs ...
Staff Software Engineer - GenAI Performance and Kernel
San Francisco, CA · On-site
$164K/yr
P-1285 About This Role As a staff software engineer for GenAI Performance and Kernel, you will own the design, implementation, optimization, and correctness of the high-performance GPU kernels ...
Staff Software Engineer - GenAI Performance and Kernel
San Francisco, CA · On-site
$164K/yr
P-1285 About This Role As a staff software engineer for GenAI Performance and Kernel, you will own the design, implementation, optimization, and correctness of the high-performance GPU kernels ...
Software Engineer, GenAI Integrations
San Mateo, CA · On-site
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
Software Engineer, GenAI Integrations
San Mateo, CA · On-site
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
Sr. Software Engineer, GenAI
$220K/yr
Required * 7+ years of professional software engineering experience, with deep, recent, multi-year Python and strong relational database and schema design skills. * Solid CS fundamentals and a ...
Sr. Software Engineer, GenAI
$220K/yr
Required * 7+ years of professional software engineering experience, with deep, recent, multi-year Python and strong relational database and schema design skills. * Solid CS fundamentals and a ...
Software Engineer, GenAI Integrations
San Mateo, CA · On-site
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
Quick apply
Software Engineer, GenAI Integrations
San Mateo, CA · On-site
$120K - $140K/yr
We are looking for a Software Engineer to join our Agent Creator team, focusing on building and maintaining LLM integrations within the SnapLogic integration platform. In this role, you will design ...
ML Software Engineer, GenAI for Youth
Mountain View, CA · On-site
$207 - $301/hr
About the job Google's software engineers develop the next‑generation technologies that change ... As a part of the GenAI for Youth, a team within Kids and Families, you will be dedicated to ...
ML Software Engineer, GenAI for Youth
Mountain View, CA · On-site
$207 - $301/hr
About the job Google's software engineers develop the next‑generation technologies that change ... As a part of the GenAI for Youth, a team within Kids and Families, you will be dedicated to ...
Staff Software Engineer - GenAI Performance and Kernel
San Francisco, CA · On-site
$164K/yr
Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI Performance and Kernel. In this role, you will own the design and optimization of high-performance GPU ...
Staff Software Engineer - GenAI Performance and Kernel
San Francisco, CA · On-site
$164K/yr
Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI Performance and Kernel. In this role, you will own the design and optimization of high-performance GPU ...
Lead AI Engineer (GenAI & RAG) Overview / Summary We are seeking an experienced Python Developer with 10+ years of software engineering experience, including 1+ years of experience with AI/RAG. Key ...
Lead AI Engineer (GenAI & RAG) Overview / Summary We are seeking an experienced Python Developer with 10+ years of software engineering experience, including 1+ years of experience with AI/RAG. Key ...
Software Engineer Genai information
See salary details
$63.5K - $76.4K
2% of jobs
$76.4K - $89.3K
4% of jobs
$89.3K - $102.2K
6% of jobs
$102.2K - $115.1K
8% of jobs
$122.1K is the 25th percentile. Wages below this are outliers.
$115.1K - $128K
7% of jobs
$128K - $141K
18% of jobs
The median wage is $144K / yr.
$141K - $153.9K
16% of jobs
$153.9K - $166.8K
2% of jobs
$172.1K is the 75th percentile. Wages above this are outliers.
$166.8K - $179.7K
26% of jobs
$179.7K - $192.6K
1% of jobs
$192.6K - $205.5K
8% of jobs
$63.5K
$147.5K
$205.5K
How much do software engineer genai jobs pay per year?
As of Aug 16, 2026, the average yearly pay for software engineer genai in the United States is $147,524.00, according to ZipRecruiter salary data. Most workers in this role earn between $120,000.00 and $173,000.00 per year, depending on experience, location, and employer.
What cities are hiring for Software Engineer Genai jobs?
Cities with the most Software Engineer Genai job openings:
What states have the most Software Engineer Genai jobs?
States with the most job openings for Software Engineer Genai jobs include:
What job categories do people searching Software Engineer Genai jobs look for?
The top searched job categories for Software Engineer Genai jobs are:
Full-time
Re-posted 12 days ago
Job description
Job Summary:
Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI inference. In this role, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API, ensuring high throughput, low latency, and robust scaling.
Responsibilities:
• Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference
• Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine
• Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware utilization across GPUs, and accelerators
• Define and guide standards to build and maintain instrumentation, profiling, and tracing tooling to uncover bottlenecks and guide optimizations
• Architect scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads
• Ensure reliability, reproducibility, and fault tolerance in the inference pipelines, including A/B launches, rollback, and model versioning
• Collaborate cross-functionally on Integrating with federated, distributed inference infrastructure – orchestrate across nodes, balance load, handle communication overhead
• Drive cross-team collaboration: with platform engineers, cloud infrastructure, and security/compliance teams
• Represent the team externally through benchmarks, whitepapers, and open-source contributions
Qualifications:
Required:
• BS/MS/PhD in Computer Science, or a related field
• Strong software engineering background (6+ years or equivalent) in performance-critical systems
• Proven track record of owning complex system components and driving architectural decisions end-to-end
• Deep understanding of ML inference internals: attention, MLPs, recurrent modules, quantization, sparse operations, etc.
• Hands-on experience with CUDA, GPU programming, and key libraries (cuBLAS, cuDNN, NCCL, etc.)
• Strong background in distributed systems design, including RPC frameworks, queuing, RPC batching, sharding, memory partitioning
• Demonstrated ability to uncover and solve performance bottlenecks across layers (kernel, memory, networking, scheduler)
• Experience building instrumentation, tracing, and profiling tools for ML models
• Ability to lead through influence - work closely with ML researchers, translate novel model ideas into production systems
• Excellent communication and leadership skills, with a proactive and ownership-driven mindset
Preferred:
• Bonus: published research or open-source contributions in ML systems, inference optimization, or model serving
Company:
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture. Founded in 2013, the company is headquartered in San Francisco, USA, with a team of 5001-10000 employees. The company is currently Late Stage.
Databricks is the data and AI company, and they are seeking a Staff Software Engineer for GenAI inference. In this role, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API, ensuring high throughput, low latency, and robust scaling.
Responsibilities:
• Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference
• Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine
• Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware utilization across GPUs, and accelerators
• Define and guide standards to build and maintain instrumentation, profiling, and tracing tooling to uncover bottlenecks and guide optimizations
• Architect scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads
• Ensure reliability, reproducibility, and fault tolerance in the inference pipelines, including A/B launches, rollback, and model versioning
• Collaborate cross-functionally on Integrating with federated, distributed inference infrastructure – orchestrate across nodes, balance load, handle communication overhead
• Drive cross-team collaboration: with platform engineers, cloud infrastructure, and security/compliance teams
• Represent the team externally through benchmarks, whitepapers, and open-source contributions
Qualifications:
Required:
• BS/MS/PhD in Computer Science, or a related field
• Strong software engineering background (6+ years or equivalent) in performance-critical systems
• Proven track record of owning complex system components and driving architectural decisions end-to-end
• Deep understanding of ML inference internals: attention, MLPs, recurrent modules, quantization, sparse operations, etc.
• Hands-on experience with CUDA, GPU programming, and key libraries (cuBLAS, cuDNN, NCCL, etc.)
• Strong background in distributed systems design, including RPC frameworks, queuing, RPC batching, sharding, memory partitioning
• Demonstrated ability to uncover and solve performance bottlenecks across layers (kernel, memory, networking, scheduler)
• Experience building instrumentation, tracing, and profiling tools for ML models
• Ability to lead through influence - work closely with ML researchers, translate novel model ideas into production systems
• Excellent communication and leadership skills, with a proactive and ownership-driven mindset
Preferred:
• Bonus: published research or open-source contributions in ML systems, inference optimization, or model serving
Company:
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture. Founded in 2013, the company is headquartered in San Francisco, USA, with a team of 5001-10000 employees. The company is currently Late Stage.
About Databricks
Sourced by ZipRecruiter
Industry
Software development
Company size
5,001 - 10,000 Employees
Headquarters location
San Francisco, CA, US
Year founded
2013