ZipRecruiter

Log In

1

Llmops Jobs (NOW HIRING)

2T Consulting

$130K - $170K/yr

MLOps/LLMOps: CI/CD, Monitoring, Observability, Model Deployment, Governance

Oteemo Inc.

Sr. Data Engineer

Reston, VA · On-site

$110K - $149K/yr

Implement MLOps/LLMOps practices -- CI/CD for data workflows, automated agent evaluation, and infrastructure as code across AWS, Azure, and GCP. * Enforce data security and governance, including PII ...

Asurion

The role partners with Product and Engineering to deliver production AI systems while establishing best practices for AI evaluation, LLMOps, governance, and responsible AI. Success is measured by ...

2T Consulting

$104K - $137K/yr

MLOps/LLMOps: CI/CD, Monitoring, Observability, Model Deployment, Governance

Jobgether

$100K - $120K/yr

You will combine software engineering, machine learning, and MLOps/LLMOps expertise to create scalable and reliable AI products. The position involves solving complex business problems through ...

previous page

Showing results 41-60

All JobsLlmops Jobs

Llmops information

What is the difference between Llmops vs Data Scientist?

AspectLlmopsData Scientist
Required credentialsKnowledge of machine learning, AI frameworks, cloud platformsStatistics, programming, data analysis skills
Work environmentAI/ML teams, cloud environments, deployment pipelinesData analysis, modeling, reporting in various industries
Employer usageTech companies, AI startups, research labsFinance, healthcare, tech, retail

While both roles involve working with data and machine learning, Llmops focuses on deploying and maintaining large language models in production environments, requiring expertise in AI infrastructure. Data Scientists primarily analyze data, build models, and generate insights. Llmops professionals ensure models operate efficiently at scale, whereas Data Scientists develop the models and interpret results.

More about Llmops jobs

What cities are hiring for Llmops jobs?

Cities with the most Llmops job openings:

What states have the most Llmops jobs?

States with the most job openings for Llmops jobs include:

What job categories do people searching Llmops jobs look for?

The top searched job categories for Llmops jobs are:

Llmops jobs near you
Infographic showing various Llmops job openings in the United States as of August 2026, with employment types broken down into 97% Full Time, and 3% Contract. Highlights an 84% Physical, 7% Hybrid, and 9% Remote job distribution.

GenAI Engineer - LLM Infrastructure & Inference Services

2T Consulting

Mountain View, CA • On-site

$126K - $166K/yr

Full-time

Posted 10 days ago

Job description

We are looking for a GenAI Engineer with strong expertise in LLM infrastructure, model deployment, and high-performance inference services. The ideal candidate will build and manage scalable enterprise GenAI platforms across GPU infrastructure and cloud environments.

Key Responsibilities
  • Deploy, host, and manage Large Language Models (LLMs) on GPU infrastructure for production environments.
  • Build scalable, high-performance inference services using vLLM, TensorRT-LLM, Triton Inference Server, and Ray Serve.
  • Optimize model serving for latency, throughput, GPU utilization, and cost efficiency.
  • Develop AI platform services and APIs using Python, FastAPI, Microservices, and Kubernetes.
  • Implement RAG pipelines, vector databases, and agentic AI frameworks such as LangChain and LangGraph.
  • Manage GPU infrastructure, containerization, and cloud deployments across AWS, Azure, or GCP.
  • Establish MLOps/LLMOps practices including CI/CD, model deployment, monitoring, observability, and governance.
  • Perform performance tuning, benchmarking, capacity planning, and production support for enterprise GenAI platforms.
  • Collaborate with architects, data scientists, and product teams to deliver scalable, secure, and reliable AI solutions.
Core Technologies
  • LLM: vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve
  • AI/GenAI: RAG, LangChain, LangGraph, Vector Databases
  • Development: Python, FastAPI, Microservices
  • Infrastructure: Kubernetes, Docker, GPU Infrastructure
  • Cloud: AWS, Azure, GCP
  • MLOps/LLMOps: CI/CD, Monitoring, Observability, Model Deployment, Governance

Apply