Ai Prompt Engineer Jobs in San Rafael, CA (NOW HIRING)

Founded in 2012, H2O.ai is on a mission to democratize AI. As the world’s leading agentic AI company, H2O.ai converges Generative and Predictive AI to help enterprises and public sector agencies develop purpose-built GenAI applications on their private data. With a focus on Sovereign AI—secure, compliant, and infrastructure-flexible deployments—H2O.ai delivers solutions that align with the highest standards of data privacy and control.
Our open-source technology is trusted by over 20,000 organizations worldwide, including more than half of the Fortune 500. H2O.ai powers AI transformation for companies like AT&T, Commonwealth Bank of Australia, Chipotle, Workday, Progressive Insurance, and NIH.
H2O.ai partners include NVIDIA, Dell Technologies, Deloitte, Ernst & Young (EY), Snowflake, AWS, Google Cloud Platform (GCP), VAST Data and MinIO. H2O.ai’s AI for Good program supports nonprofit groups, foundations, and communities in advancing education, healthcare, and environmental conservation. With a vibrant community of 2 million data scientists worldwide, H2O.ai aims to co-create valuable AI applications for all users.
H2O.ai has raised 256 million from investors, including Commonwealth Bank, NVIDIA, Goldman Sachs, Wells Fargo, Capital One, Nexus Ventures and New York Life.
For more information, visit www.h2o.ai.

About This Opportunity 

We are looking for a Senior AI Engineer who builds things that matter. You will design and ship end-to-end AI solutions for some of APAC's most complex enterprise problems - spanning agentic AI systems, LLM applications, and production ML pipelines. This is a hands-on engineering role embedded within a customer-facing field team, meaning your work will be seen, used, and evaluated by real enterprises from day one.

You will work alongside Kaggle Grandmasters, ML engineers, and domain experts to deliver AI that goes beyond demos - into production, into workflows, and into measurable business outcomes.
This position is based in San Francisco, Bay Area.
What You Will Do

Customer Engagement Leadership

• Lead end-to-end technical engagement with enterprise customers, acting as the senior point of accountability for delivery quality, stakeholder relationships, and outcomes.
• Manage multiple concurrent engagement streams simultaneously – coordinating workplans, resourcing, and milestones across cross-functional teams.
• Serve as the primary technical escalation point for customer issues, proactively identifying risks and driving resolution across engineering, product, and leadership.
• Build and maintain trusted relationships with customer data science teams, engineering leads, and executive stakeholders – translating business needs into technical direction and back again.
• Lead pre-sales and proof-of-concept engagements, setting the technical strategy and ensuring the team delivers demonstrations that build genuine enterprise trust.
• Represent H2O.ai externally at customer workshops, executive briefings, and technical deep-dives as a credible senior voice.

Agentic AI & LLM Engineering

• Design and build agentic AI systems and multi-agent frameworks that automate complex, multi-step enterprise workflows.
• Develop and deploy LLM-powered applications using RAG, fine-tuning, prompt engineering, function calling, and tool use.
• Implement guardrails, evaluation frameworks, and responsible AI controls to ensure production-grade reliability and safety.
• Stay current with the rapidly evolving agentic AI landscape – MCP, LLM orchestration frameworks, reasoning models – and bring the best into customer engagements.

End-to-End AI Application Development

• Own the full development lifecycle across multiple streams: from problem framing and data exploration through model development, API integration, and production deployment.
• Build scalable backend services and APIs that expose AI capabilities to enterprise applications and workflows.
• Integrate AI models into customer environments – cloud, on-prem, and hybrid – ensuring performance, stability, and maintainability at scale.
• Develop ML pipelines and LLMOps infrastructure that support continuous model improvement and monitoring in production.

Team Collaboration & Delivery Excellence

• Coordinate delivery across engineers, program managers, and solution architects – ensuring workstreams are aligned, unblocked, and progressing to plan.
• Set the technical bar for the engagements you lead, reviewing outputs, shaping architecture decisions, and ensuring engineering quality across the team.
• Mentor and guide junior ML engineers and solution engineers within engagements, building team capability alongside delivery.
• Collaborate closely with H2O.ai product and engineering teams to surface customer feedback, shape roadmap input, and resolve platform-level issues.