ZipRecruiter

Log In

1

Prompt Engineer Jobs in San Ramon, CA (NOW HIRING)

Highlight AI

Senior ML Engineer

San Francisco, CA · On-site

$200K - $350K/yr

Implement and iterate on RAG systems, ranking models, and prompt engineering to improve quality * Build comprehensive evals and monitoring to measure and improve ML system performance * Investigate ...

Broadcom, Inc.

Staff Applications Engineer

San Jose, CA · On-site

$120K - $192K/yr

Perform LLM testing, search optimization, and prompt engineering. * Lead meetings with other AEs to solicit feedback and facilitate sharing of enhanced support workflows and AI-enhanced use cases.

Broadcom

Staff Applications Engineer

San Jose, CA · On-site

$120K - $192K/yr

Perform LLM testing, search optimization, and prompt engineering. * Lead meetings with other AEs to solicit feedback and facilitate sharing of enhanced support workflows and AI-enhanced use cases.

CodeRabbit

Applied AI Engineer

San Francisco, CA · On-site

$200K - $300K/yr

Prompt Engineering: Strong skills in prompt engineering * Data Fluency: Ability to extract insight from telemetry, logs, user signals, and structured feedback * Practical Mindset: Comfortable ...

Prohires

W2 - Principal AI Engineer

Concord, CA · On-site

Principal AI Engineer Location: Concord, CA (Onsite) Job Type: Contract Duration: Long term Key ... prompt orchestration, and multi‑model routing strategies. Drive production readiness for GenAI ...

New

Trinity Technology Solutions

AI Engineer

San Jose, CA · On-site

Extensive hands on experience in building GenerativeAI application using methodologies such as RAG prompt engineering embedding fine tuning etc * Experience in working with structured as well as ...

Instabase

Sales Engineer, Applied AI

San Francisco, CA · On-site

$157K - $175K/yr

You know how to prompt a model to get the best result (Prompt Engineering) and understand the practicalities of Generative AI, LLMs (GPT, Gemini, Anthropic), and RAG (Retrieval-Augmented Generation)

Instead

Software Engineer

San Francisco, CA · On-site

Build and integrate AI-powered components including production-level inference and prompt engineering * Make key product improvements based on customer feedback and usage analytics * Solve critical ...

Accenture

Forward Deployed Engineer

San Francisco, CA · On-site

You will contribute across the full AI lifecycle - from researching and fine-tuning foundation models to prompt engineering, system integration, and deployment into production environments. You will ...

Instead

Software Engineer

San Francisco, CA

Build and integrate AI-powered components including production-level inference and prompt engineering * Make key product improvements based on customer feedback and usage analytics * Solve critical ...

The Mortgage Office

AI Engineer

San Mateo, CA · On-site

... prompt engineering, fine-tuning, and evaluation methods for improving real-world model performance. Preferred : • Experience with knowledge graphs, recommendation engines, or rules engines. • ...

next page

Showing results 1-20

All JobsPrompt Engineer JobsPrompt Engineer Jobs in San Ramon, CA

Prompt Engineer information

See San Ramon, CA salary details

$11

$52

$98

How much do prompt engineer jobs pay per hour?

As of Jul 2, 2026, the average hourly pay for prompt engineer in San Ramon, CA is $52.62, according to ZipRecruiter salary data. Most workers in this role earn between $40.05 and $67.98 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive in the Prompt Engineer position, and why are they important?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a typical day look like for a Prompt Engineer?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What engineer makes $500,000 a year?

Senior software engineers, especially those working in high-demand fields like AI, machine learning, or at major tech companies, can earn $500,000 or more annually through base salary, bonuses, and stock options. Achieving this level typically requires extensive experience, specialized skills, and often leadership roles or equity compensation.

What is a Prompt Engineer job?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

Is prompt engineer still a thing?

Prompt engineering is an emerging role focused on designing effective prompts for AI language models. It is increasingly in demand as organizations seek to optimize AI interactions, often requiring skills in natural language processing and familiarity with tools like GPT. The role continues to grow alongside advancements in AI technology.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance. Skills in programming, data analysis, and familiarity with AI tools are commonly needed.

Is prompt engineer salary?

Prompt engineers typically earn salaries comparable to other AI and machine learning specialists, with average annual pay ranging from $80,000 to $150,000 depending on experience, location, and industry. Skills in natural language processing, prompt design, and familiarity with AI tools like GPT are highly valued and can influence compensation.
What are popular job titles related to Prompt Engineer jobs in San Ramon, CA? For Prompt Engineer jobs in San Ramon, CA, the most frequently searched job titles are:
What cities near San Ramon, CA are hiring for Prompt Engineer jobs? Cities near San Ramon, CA with the most Prompt Engineer job openings:
Prompt Engineer jobs near you

Senior ML Engineer

Highlight AI

San Francisco, CA • On-site

$200K - $350K/yr

Full-time

Medical, Dental, Vision, PTO

Posted 13 days ago

Job description

Highlight is building a shared intelligence layer for the modern workforce. Highlight unifies context across every person and tool on your team, seamlessly bridging information silos. It evolves with your organization to proactively route knowledge and reliably automate workflows.
The Role
We're hiring a Senior ML Engineer to help build the AI systems that power Highlight. You will work across the full ML stack: data pipelines, model training, retrieval, ranking, evals, and deployment. You will ship features that make Highlight feel like magic. This is a hands on IC role where you will own critical systems end to end and collaborate closely with our Head of AI Engineering to scale our ML capabilities.
You will thrive here if you love shipping production ML systems, obsess over output quality, and want to work on hard problems with real user impact. We move fast, hold a high bar, and believe the best ideas win regardless of title.
Note: this is an on site role, requiring five days a week in our office.
Job Responsibilities
  • Design, build, and optimize ML pipelines for context retrieval, action detection, and output generation
  • Implement and iterate on RAG systems, ranking models, and prompt engineering to improve quality
  • Build comprehensive evals and monitoring to measure and improve ML system performance
  • Investigate alternative models and fine tuning approaches for our heavy background processing workloads, implementing better systems to increase quality while improving cost efficiency
  • Collaborate with Backend and Product Engineering to ship AI powered features
  • Contribute to ML infrastructure decisions and best practices across the engineering org
  • Stay current on LLM advances, retrieval techniques, and ML tooling; bring insights back to the team

Profile
We're looking for someone who is interested in building the AI user experience for the future. We punch above our weight so we value extreme ownership, accountability, and proactiveness. The ideal candidate is a master craftsman who enjoys building great products with LLMs at scale.
You are a good fit if you have:
  • 4+ years in ML/AI engineering, with significant experience shipping production systems
  • Strong software engineering fundamentals: you write clean, maintainable code
  • Deep experience with retrieval, ranking, RAG, or search systems at scale
  • Hands on proficiency with PyTorch, vector databases, and modern ML infrastructure
  • Experience with LLM applications (prompt engineering, fine tuning, eval frameworks)
  • Product thinker: understands how to connect great ML products to constraints, evals, and modeling when building them
  • A bias toward action: you ship fast, measure rigorously, and iterate based on data
  • Ownership mentality (no task is too small for you) - it's all hands on deck here and we need everyone rowing the boat.
  • Excellent communication skills and a collaborative mindset - we're extremely lean so we're looking for a team player who works well with others.
  • Type-A tendencies: maybe you're extremely detail-oriented. Or maybe you take pride in shipping high-quality products. Whatever it is you do, you give it your all.
  • Must be based in or willing to relocate to SF - although we're flexible with days off & schedules, we have a 100% in-office culture during the week.

And even if you don't fall neatly into any of these buckets, we're looking for scrappy and motivated self-starters above all. Hustle is expected, grit is required.
Perks
  • Competitive salary and generous equity package
  • Health, dental, and vision insurance
  • Flexible PTO and parental leave
  • Paid team lunches during the week
  • Relocation package

Apply