ZipRecruiter

Log In

1

Llm Engineer Jobs in Ohio (NOW HIRING)

LawPro.ai

OH · On-site

Continuous LLM Evaluation: Design and operate a systematic, ongoing process to evaluate new and ... Requirements * 5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying ...

RiseIT Solutions

AI Engineer

Cincinnati, OH · On-site

AI Engineer Location : Cincinnati, OH (Onsite) Job Responsibilities ... Build and deploy LLM-based applications, agents, and RAG solutions using LangChain/ LangGraph.

RIT Solutions, Inc.

Senior AI Engineer

Mason, OH · On-site

$98K - $134K/yr

RIT Solutions, Inc. is seeking a Senior AI Engineer to design and build production-grade LLM-powered applications and agentic systems. This role is responsible for the end-to-end development of ...

TwinThread

Senior Lead Security Engineer, AI

Columbus, OH · On-site

$107K - $146K/yr

Build secure LLM/RAG services and ML pipelines that integrate with SIEM/XDR, EDR, SOAR, IAM, ITSM, CMDB, code repos, and cloud telemetry. * Establish engineering standards for secure AI: prompt ...

Netomi

Build and maintain LLM evaluation systems, including LLM-as-judge workflows, regression evals ... Establish engineering best practices for continuous optimization of agentic systems * Stay current ...

New

JP Morgan Chase

Senior Lead AI Security Engineer

Columbus, OH · On-site

$107K - $147K/yr

Build secure LLM/RAG services and ML pipelines that integrate with SIEM/XDR, EDR, SOAR, IAM, ITSM, CMDB, code repos, and cloud telemetry. * Establish engineering standards for secure AI: prompt ...

SupportFinity™

AI Application Engineer

Hudson, OH · On-site

Develop and orchestrate complex LLM workflows to enable agentic systems capable of autonomous decision‑making and task execution. * Apply software engineering best practices, including modular ...

GE Aerospace

Software Engineer AI/ML

Evendale, OH · On-site

$109K - $132K/yr

Design, build, deliver, and maintain AI/ML products including LLM-powered applications, forecasting models, anomaly detection systems, and intelligent agents. Own the full AI/ML lifecycle ...

next page

Showing results 1-20

All JobsLlm Engineer JobsLlm Engineer Jobs in Ohio

Llm Engineer information

See Ohio salary details

$24

$50

$72

How much do llm engineer jobs pay per hour?

As of Sep 12, 2026, the average hourly pay for llm engineer in Ohio is $50.99, according to ZipRecruiter salary data. Most workers in this role earn between $41.15 and $59.18 per hour, depending on experience, location, and employer.

What does an LLM engineer do?

An LLM Engineer designs, develops, and optimizes applications that leverage large language models (LLMs). They fine-tune models, integrate them into products, and improve performance through prompt engineering and model customization. This role requires expertise in machine learning, natural language processing (NLP), and software development. LLM Engineers work closely with data scientists and developers to create AI-driven solutions for various applications such as chatbots, content generation, and code assistance.

What are the key skills and qualifications needed to thrive as an LLM engineer?

To thrive as an LLM Engineer, you need strong expertise in machine learning, natural language processing, and proficiency with Python, along with a solid understanding of transformer-based models and deep learning frameworks like PyTorch or TensorFlow. Familiarity with cloud platforms, version control systems (e.g., Git), and tools such as Hugging Face Transformers is typically required, and certifications in AI or data science can be advantageous. Excellent problem-solving, collaboration, and communication skills help you work effectively with interdisciplinary teams and present complex findings clearly. These skills enable you to develop, fine-tune, and deploy large language models efficiently in real-world applications.

How much do Llm engineers make?

Llm engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in machine learning and natural language processing can earn higher salaries, often exceeding $200,000 with bonuses and stock options.

What are the most commonly searched types of Llm Engineer jobs in Ohio?

The most popular types of Llm Engineer jobs in Ohio are:

What are popular job titles related to Llm Engineer jobs in Ohio?

For Llm Engineer jobs in Ohio, the most frequently searched job titles are:

What job categories do people searching Llm Engineer jobs in Ohio look for?

The top searched job categories for Llm Engineer jobs in Ohio are:

What cities in Ohio are hiring for Llm Engineer jobs?

Cities in Ohio with the most Llm Engineer job openings:

Llm Engineer jobs near you
Infographic showing various Llm Engineer job openings in Ohio as of September 2026, with employment types broken down into 1% Internship, 90% Full Time, 7% Part Time, and 2% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution, with an average salary of $106,052 per year, or $51 per hour.

Sr Agentic AI/ML Engineer - GenAI & Cloud Solutions

Mason, OH • On-site

Tanisha Systems, Inc.
1 - 5K employees
Learn more about Tanisha Systems, Inc.external

$52.50 - $70/hr

Other

This job post has expired 1 day ago. Applications are no longer accepted.

Key responsibilities

  • Lead the design and development of scalable, secure, and high-performance AI/ML systems leveraging Agentic Layer A2A frameworks and MCP Protocols.

  • Drive end-to-end solution development including vector embeddings, prompt engineering, and context engineering for enterprise-grade GenAI applications.

  • Architect and oversee deployment of AI/ML workloads on Azure Cloud, ensuring compliance, scalability, and cost optimization.

Job description

Sr Agentic AI/ML Engineer – GenAI & Cloud Solutions
Location: Woodland Hills, CA / Mason OH (onsite Role)
Salary: Market - based on exp.
FTE/Full time
Start: Immediate
Key Responsibilities
  • Architect and Design: Lead the design of scalable, secure, and high-performance AI/ML systems leveraging Agentic Layer A2A frameworks and MCP Protocols.
  • Solution Engineering: Drive end-to-end solution development including vector embeddings, prompt engineering, and context engineering for enterprise-grade GenAI applications.
  • Cloud Deployment: Architect and oversee deployment of AI/ML workloads on Azure Cloud, ensuring compliance, scalability, and cost optimization.
  • Data Architecture: Design and optimize data pipelines and storage solutions using Azure AI Search, Redis, Cosmos DB, Blob Storage, and Iceberg.
  • Application Development: Build and manage Azure Functions and Azure Container Apps for microservices-based AI solutions.
  • Performance & Scalability: Define cloud-native architecture patterns, implement performance tuning, and ensure resilience across distributed systems.
  • Domain Expertise: Apply deep knowledge of healthcare domain requirements, ensuring solutions meet regulatory standards (HIPAA, GDPR, etc.) and handle sensitive data securely.
  • Technical Leadership: Mentor engineering teams, establish best practices, and conduct design/code reviews.
  • Innovation & Research: Stay ahead of emerging GenAI, LLM/NLM trends, and integrate cutting-edge approaches into enterprise solutions.
Required Skills & Expertise
  • Agentic Layer & Protocols: Hands-on expertise with Agentic Layer A2A frameworks and MCP Protocol for multi-agent orchestration.
  • AI/ML Engineering: Strong background in vector embeddings, prompt engineering, context engineering, and fine-tuning LLMs.
  • GenAI & LLM Concepts: Deep understanding of Generative AI, Natural Language Models (NLM), and Large Language Models (LLM).
  • Programming: Advanced proficiency in Python; exposure to Java/Go is a plus.
  • Cloud Proficiency: Strong experience with Azure Cloud services, including deployment, monitoring, and scaling.
  • Databases: Expertise in Azure AI Search, Redis, Cosmos DB; familiarity with Blob Storage and Iceberg is advantageous.
  • Cloud-Native Architecture: Solid grasp of microservices, containerization, serverless computing, scalability, and performance optimization.
  • Healthcare Domain: Experience working with regulated data environments and compliance frameworks.
Evaluation Criteria (Critical Components)
1. Technical Depth
  • Ability to design and implement multi-agent AI systems.
  • Experience in LLM fine-tuning, embeddings, and context engineering.
  • Expertise in coding proficiency with production-grade systems in Python.
2. Architectural Vision
  • Ability to define enterprise-level AI/ML architecture aligned with cloud-native principles.
  • Experience in scalability, resilience, and performance optimization.
3. Cloud & Data Expertise
  • Hands-on deployment of AI workloads on Azure Cloud.
  • Strong knowledge of databases, search systems, and distributed storage.
4. Domain Knowledge
  • Familiarity with healthcare regulations and ability to design compliant solutions.
5. Leadership & Collaboration
  • Experience mentoring engineers, conducting reviews, and driving technical excellence.
  • Ability to collaborate with cross-functional teams including product, compliance, and operations.
6. Innovation & Research Orientation
  • Evidence of staying current with GenAI advancements and applying them to real-world problems.
Preferred Qualifications
  • Bachelors or master’s in computer science, AI/ML, or related field.
  • Certifications in Azure Solutions Architect or AI Engineering.
  • Publications, patents, or contributions to open-source AI/ML projects.

Apply