1

Vllm Jobs in Ohio (NOW HIRING)

$82.15 - $105.62/hr

Erste Erfahrungen im Umgang mit LLMs und modernen Inferenz‑Runtimes (z. B. ollama, vllm). * Freude an der direkten Zusammenarbeit mit Partnern und Kunden. * Fließende Deutschkenntnisse in Wort ...

$91.34 - $102.76/hr

Du arbeitest über alle Schichten - Model-Serving (vLLM, eigene GPU-Cluster), Agent-Gateways und Runtimes, RAG-/GraphRAG-Pipelines, spezialisierte Agenten, Integration in ERP, CRM, DMS und Legacy ...

LangGraph * vLLM * Experience designing and orchestrating multi-agent workflows, tool integrations, and autonomous decision-making frameworks. * Ability to develop, test, and optimize AI-driven ...

$69.41 - $92.55/hr

Mindestens 2 Jahre Berufserfahrung in der Software-Entwicklung mit Fokus auf AI/ML * Erfahrung mit LLM-APIs (OpenAI, Anthropic Claude, lokale Modelle via Ollama/vLLM) * Erfahrung mit Vektor ...

$130 - $170/hr

LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM * Cloud infrastructure * Distributed systems * ML/data pipelines and workflow orchestration * GPU infrastructure and ...

$120 - $160/hr

Deep understanding of modern serving frameworks and techniques like vLLM or TRT‑LLM. * Model Acceleration. Hands‑on experience with quantization, distillation, caching strategies, continuous ...

$120 - $180/hr

LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM * Cloud infrastructure * Distributed systems * ML/data pipelines and workflow orchestration * GPU infrastructure and ...

next page

Showing results 1-20

Vllm information

What is a vLLM?

VLLM stands for 'Virtual Large Language Model.' In the context of AI development, VLLM professionals work with optimized inference engines for large language models, enabling faster and more efficient deployment of AI models in production environments. Their responsibilities often include integrating LLMs into applications, optimizing model performance, and ensuring scalability for real-time use cases. They may also collaborate with data scientists and engineers to manage resources and streamline AI workflows.

How does a vLLM engineer typically collaborate with data scientists and product teams during model deployment?

VLLM Engineers work closely with data scientists to understand the specific requirements and fine-tuning needs of large-scale language models. They are often responsible for integrating these models into production systems, ensuring scalability and efficiency. Collaboration with product teams is crucial to align model capabilities with user needs and to troubleshoot real-world application challenges. Frequent communication and agile workflows are common, as updates or optimizations may be needed rapidly based on feedback from both teams.

What are the key skills and qualifications needed to thrive as a machine learning engineer working with vLLM, and why are they important?

To thrive as a Machine Learning Engineer specializing in vLLM (a high-throughput LLM inference library), you need a strong understanding of machine learning principles, deep learning frameworks, and experience with Python programming. Familiarity with tools like PyTorch, CUDA, distributed computing, and cloud platforms, as well as relevant certifications in ML or data engineering, is highly valuable. Strong problem-solving, collaboration, and communication skills are essential for optimizing model performance and integrating with cross-functional teams. These capabilities ensure effective deployment and scaling of large language models, driving innovation and efficiency in AI applications.

What is the difference between Vllm vs Data Analyst?

AspectVllmData Analyst
Required CredentialsTypically requires knowledge of machine learning, AI, and programming languages like Python or RRequires skills in statistics, Excel, SQL, and data visualization tools
Work EnvironmentOften in tech companies, research labs, or AI-focused teamsCommonly in business, finance, healthcare, and marketing sectors
Industry UsageEmerging role in AI and machine learning projectsEstablished role in data-driven decision making
Common Search/ComparisonVllm vs Data Analyst

The main difference between Vllm and Data Analyst lies in their focus and skill set. Vllm professionals specialize in AI and machine learning models, often working in tech environments, while Data Analysts focus on interpreting data to inform business decisions. Both roles require analytical skills, but Vllm roles demand programming and AI expertise, whereas Data Analysts emphasize statistical analysis and data visualization.

What are popular job titles related to Vllm jobs in Ohio?

For Vllm jobs in Ohio, the most frequently searched job titles are:

What job categories do people searching Vllm jobs in Ohio look for?

The top searched job categories for Vllm jobs in Ohio are:

Infographic showing various Vllm job openings in Ohio as of August 2026, with employment types broken down into 89% Full Time, 7% Part Time, and 4% Contract. Highlights an 75% Physical, 6% Hybrid, and 19% Remote job distribution.

Sr Data Scientist- Generative AI

Citizens

Columbus, OH

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 27 days ago


Job description

Description

Join a team where innovation meets impact. As a Senior Data Scientist, Generative AI & Agentic Systems, you will help drive the bank's AI transformation by designing, developing, and deploying Large Language Model (LLM) solutions, Retrieval-Augmented Generation (RAG) systems, AI agents, and intelligent automation capabilities. You will work across business, technology, risk, and compliance teams to deliver responsible, scalable, and production-ready GenAI solutions that improve customer experiences, enhance operational efficiency, and create measurable business value.

This role is ideal for an experienced data scientist with strong software engineering and machine learning skills, deep expertise in NLP and Generative AI, and experience developing AI solutions within highly regulated environments.

Key Responsibilities

  • Design, develop, and deploy production-grade Generative AI solutions using LLMs, RAG frameworks, AI agents, and workflow orchestration platforms.
  • Build intelligent document processing capabilities for information extraction, summarization, classification, question answering, and conversational AI applications.
  • Develop agentic workflows capable of autonomous reasoning, task execution, tool utilization, and multi-step decision support.
  • Design and implement retrieval pipelines, vector search architectures, embedding strategies, and knowledge-grounded AI systems.
  • Evaluate and improve LLM performance through prompt engineering, model benchmarking, hallucination reduction, and faithfulness testing.
  • Build scalable AI solutions using modern frameworks and infrastructure including vLLM, LangChain, LangGraph, MLflow, Databricks, Snowflake, and cloud-native platforms.
  • Perform exploratory data analysis, feature engineering, and statistical analysis to support machine learning and GenAI model development.
  • Develop model monitoring, evaluation, and observability frameworks to measure quality, reliability, fairness, and operational performance.
  • Collaborate closely with Model Risk Management (MRM), Compliance, Audit, Legal, and Information Security teams to ensure responsible AI deployment.
  • Create technical documentation, model development artifacts, validation packages, and executive-level presentations.
  • Partner with product managers, engineers, data architects, and business stakeholders to identify and prioritize GenAI opportunities.
  • Stay current with advances in Generative AI, agentic systems, multimodal AI, foundation models, and emerging industry best practices.

Qualifications

Required

  • Ph.D. or Master's degree in Computer Science, Data Science, Statistics, Mathematics, Artificial Intelligence, or a related quantitative field.
  • 7+ years of experience in data science, machine learning, predictive analytics, or artificial intelligence.
  • 4+ years of hands-on experience developing NLP and Generative AI solutions.
  • Strong proficiency in Python and modern software development practices.
  • Experience developing and deploying LLM-based applications using commercial or open-source models.
  • Experience with Retrieval-Augmented Generation (RAG), vector databases, embeddings, and semantic search.
  • Experience with prompt engineering, prompt evaluation, and LLM performance optimization.
  • Strong understanding of machine learning algorithms, deep learning, statistical modeling, and model explainability techniques.
  • Experience working with structured and unstructured data at enterprise scale.
  • Experience collaborating with cross-functional stakeholders and communicating technical concepts to non-technical audiences.
  • Strong knowledge of model governance, validation processes, and documentation standards.

Preferred

  • Experience designing and deploying AI agents and multi-agent systems.
  • Experience with agent orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, CrewAI, Autogen, or similar technologies.
  • Experience serving open-source LLMs using vLLM, Hugging Face, or equivalent inference frameworks.
  • Experience with RAG evaluation frameworks such as RAGAS or other LLM evaluation methodologies.
  • Experience with model monitoring, MLOps, and production AI deployment.
  • Experience with cloud AI platforms such as AWS Bedrock, Azure AI, Databricks, Snowflake Cortex.
  • Experience building document intelligence solutions involving PDFs, OCR,  document extraction, knowledge extraction from images, and workflow automation.
  • Experience within banking, financial services, fintech, insurance, or other regulated industries.
  • Experience supporting Model Risk Management (MRM), model validation, audit reviews, or regulatory examinations.
  • Familiarity with MCP (Model Context Protocol), tool calling frameworks, and AI workflow automation platforms.

Technical Skills

Generative AI & LLMs

  • GPT, Claude, Llama and other foundation models
  • Retrieval-Augmented Generation (RAG)
  • AI Agents and Multi-Agent Systems
  • Prompt Engineering and Prompt Optimization
  • Fine-Tuning and Model Adaptation
  • LLM Evaluation and Guardrails
  • Knowledge Retrieval and Vector Search

Programming & Frameworks

  • Python
  • SQL
  • PyTorch
  • TensorFlow
  • Scikit-Learn
  • LangChain
  • LangGraph
  • Hugging Face

Data Platforms & MLOps

  • Experience with cloud-based data, AI, and ML platforms (AWS, SageMaker, Databricks, Snowflake, etc.)
  • Experience with distributed data processing frameworks (Spark / PySpark/Snowpark Snowflake)
  • Experience with ML lifecycle, orchestration, and deployment tools (MLflow, Airflow, CI/CD)
  • Experience with AI-assisted development and model monitoring solutions

NLP & Analytics

  • Text Classification
  • Information Extraction
  • Summarization
  • Topic Modeling
  • Question Answering
  • Sentiment Analysis
  • Explainable AI

Preferred Candidate Profile

The ideal candidate needs to demonstrate success building production-scale GenAI solutions such as RAG platforms, conversational AI systems, document intelligence solutions, AI agents, and automated decision-support systems. They possess strong technical depth, understand governance requirements in regulated industries, and can bridge the gap between cutting-edge AI capabilities and practical business outcomes. This individual is comfortable operating from concept through production deployment while maintaining a strong focus on quality, compliance, explainability, and measurable impact.

Hours & Work Schedule

  • Hours per Week: 40
  • Work Schedule: Monday - Friday
  • Hybrid: 4 days per week on-site, 1 day remote

Pay Transparency

The salary range for this position is $124,000- $165,000 per year, plus an opportunity to earn an annual discretionary bonus. Actual pay is based on various factors including but not limited to the budget, work location, and relevant skills and experience.

We offer competitive pay, comprehensive medical, dental and vision coverage, retirement benefits, maternity/paternity leave, flexible work arrangements, education reimbursement, wellness programs and more. Note, Citizens' paid time off policy exceeds the mandatory, paid sick or paid time-away policy of every local and state jurisdiction in the United States. For an overview of our benefits, visit https://jobs.citizensbank.com/benefits .

#LI-Citizens1

Some job boards have started using jobseeker-reported data to estimate salary ranges for roles. If you apply and qualify for this role, a recruiter will discuss accurate pay guidance.

Equal Employment Opportunity

Citizens, its parent, subsidiaries, and related companies (Citizens) provide equal employment and advancement opportunities to all colleagues and applicants for employment without regard to age, ancestry, color, citizenship, physical or mental disability, perceived disability or history or record of a disability, ethnicity, gender, gender identity or expression, genetic information, genetic characteristic, marital or domestic partner status, victim of domestic violence, family status/parenthood, medical condition, military or veteran status, national origin, pregnancy/childbirth/lactation, colleague's or a dependent's reproductive health decision making, race, religion, sex, sexual orientation, or any other category protected by federal, state and/or local laws. At Citizens, we are committed to fostering an inclusive culture that enables all colleagues to bring their best selves to work every day and everyone is expected to be treated with respect and professionalism. Employment decisions are based solely on merit, qualifications, performance and capability.

Education:Why Work for UsEmployment Type: 1ST