Llm Ml Rag Jobs in California (NOW HIRING)

Job Description:

Job Definition:

The AI/ML Engineer - Agentic is a senior individual contributor responsible for designing, building, and operating aproduction-grade agentic orchestration platform, including multi-agent workflows and MCP server-based tool infrastructure. The role focuses onenterprise-scale LLM integration, shared retrieval and memory services, and highperformance backend systems that power agent execution. This position ownsreliability, observability, and cloud-native operationsfor non-deterministic agentic systems in production

Management Level Definition:

Contributions include applying developed subject matter expertise to solve common and sometimes complex technical problems and recommending alternatives where necessary. Might act as project lead and provide assistance to lower level professionals. Exercises independent judgment and consults with others to determine best method for accomplishing work and achieving objectives.

Responsibilities:

• Design, build, and own aproduction-grade agentic orchestration platform, implementing scalable multi-agent workflows using frameworks such as LangGraph or equivalent.
• Architect, develop, and operate theMCP server infrastructure, including inter-agent communication, tool/server registries, domain isolation, versioning, and lifecycle management.
• Integrate and operateLLM services at enterprise scale, supporting streaming, structured outputs, tool/function calling, and robust error handling across agent workflows.
• Build and maintainretrieval and memory servicesfor agentic systems, including RAG pipelines, OpenSearch-backed vector stores, hybrid search, and relevance optimization.
• Develop and operatehigh-performance backend services(FastAPI, gRPC, async systems, messaging) that power orchestration, tool execution, and agent runtime behavior.
• Ownobservability and reliabilityfor non-deterministic systems, delivering end-to-end tracing, monitoring, and cost/performance visibility for agent executions.
• Managecloud-native infrastructure and deployment, including Kubernetes workloads, containerized services, CI/CD pipelines, and resource optimization (CPU/memory, autoscaling).

Education and Experience Required:

• Bachelor's degree in computer science, engineering, information systems, or closely related quantitative discipline. Master's desirable.
• Typically, 4-7 years' experience.

Knowledge and Skills:

• Core Agentic/Orchestration:
  • Production experience with agentic frameworks: LangGraph (preferred), Claude Agent SDK, or equivalent (not just prototypes)
  • Deep understanding of multi-agent architectures: supervisor/worker patterns, hierarchical agent graphs, ReAct loops, ReWoo
  • Hands-on with inter-agent communication protocols: MCP (Model Context Protocol), A2A, tool registry / server registry
• LLM & ML Engineering:
  • LLM API integration at scale: structured outputs, streaming, function/tool calling, error handling
  • RAG pipeline design and optimization: chunking strategies, re-ranking, hybrid search - Know what knobs to turn for what issues
  • Vector store experience: OpenSearch or equivalent
  • Applied ML intuition: fine-tuning concepts, prompt engineering, evaluations, Qlora, PEFT
• Infrastructure & Production Systems:
  • Backend development: FastAPI, gRPC, Kafka, Redis, message queues, Async System design: Python, API Design GraphQL and/or REST at enterprise scale
  • Observability and monitoring for non-deterministic systems: LangFuse, Prometheus, or equivalent
  • Kubernetes: deploying, scaling, and managing workloads (Deployments, Services, ConfigMaps, Secrets)
  • Container image management: building, tagging, versioning, and pushing images via Docker; familiarity with a container registry (ECR, GCR, Docker Hub)
  • CI/CD pipelines for automated build and deploy (GitHub Actions, Jenkins, ArgoCD, or similar)
  • Resource management: CPU/memory limits, autoscaling (HPA/VPA), health probes
• Additional Preferred Skills
  • Multi-tenant architecture awareness: rate limiting, auth, tenant isolation
  • Knowledge base and cost optimization experience: AWS Bedrock, OpenSearch Serverless

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have - whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Job:

Job Level:

Information about employee benefits offered in the US can be found at https://myhperewards.com/main/new-hire-enrollment.html

Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.

HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.

Recruitment Fraud Alert

We have become aware of an increase in fraudulent recruitment activities in which individuals impersonate our company or authorized recruitment agencies to offer fake employment opportunities. These scams may occur through false websites, emails, social media, or chat-based applications and often aim to obtain personal information or money. Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment agencies/vendors will never charge a candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. We also never request personal information such as back account details, Social Security numbers, or national IDs via social media or chat applications.

All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual's own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.