1

Llm Backend Engineer Jobs in Ohio (NOW HIRING)

Technical Specialist-App Development

Kettering, OH · On-site

$45 - $58.25/hr

Senior Java Backend Developer (AI & Microservices) REMOTE FULLTIME Role Overview We are seeking an ... AI/LLM Integration: Integrate Large Language Models (LLMs) and ML models into existing enterprise ...

Senior AI Engineer

Mason, OH · On-site

$98K - $134K/yr

RIT Solutions, Inc. is seeking a Senior AI Engineer to design and build production-grade LLM ... backend services, and cloud platforms • Establish evaluation, reliability, and performance ...

$76.14 - $99.57/hr

... der Backend-Entwicklung * Nachweisbare Praxis in der Entwicklung von LLM-Applikationen (API-Integration, Prompt Engineering, Tool-Calling, Agentic Workflows) * Umgang mit KI-Orchestrierungs ...

New

$103.60 - $149.65/hr

Strong Python backend development skills for AI services and APIs. * Experience with LLM engineering patterns, including: Tool calling and structured outputs; Retrieval systems and context management;

New

Automation Engineer

Westlake, OH · On-site +1

$100K - $125K/yr

RAG pipelines, LLM integrations, and prompt engineering where the problem genuinely calls for them ... Proven experience as a backend developer. * Strong proficiency in programming languages such as C# ...

New

Automation Engineer

Westlake, OH · On-site

$100K - $125K/yr

RAG pipelines, LLM integrations, and prompt engineering where the problem genuinely calls for them ... Proven experience as a backend developer. * Strong proficiency in programming languages such as C# ...

Senior AI Engineer

Mason, OH · On-site

$115K - $151K/yr

Required Skill and Experience AI engineer to design and build production-grade LLM-powered ... APIs, backend services, and cloud platforms Establish evaluation, reliability, and performance ...

$110 - $170/hr

Build end-to-end product features across frontend, backend, and AI integrations * Design agent ... Build robust fallback and recovery mechanisms for LLM and tool failures in production environments

New

Senior AI Engineer

Cleveland, OH · On-site +1

$101K - $139K/yr

By designing stable backend architectures and seamless integration layers, you will ensure our AI ... Deep experience building production applications with LLM frameworks such as LangChain, LangGraph ...

next page

Showing results 1-20

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What cities in Ohio are hiring for Llm Backend Engineer jobs?

Cities in Ohio with the most Llm Backend Engineer job openings:

Infographic showing various Llm Backend Engineer job openings in Ohio as of August 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 85% Physical, 6% Hybrid, and 9% Remote job distribution.

Mid Backend Engineer (Python & Java)

Nexaminds

Cincinnati, OH • On-site

Full-time

Re-posted 11 days ago


Job description

Unlock Your Future with Nexaminds!

At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.

Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.

Location: Cincinnati Ohio

Nexaminds is looking for a Mid Backend Engineer to join our growing engineering team. In this role, you'll help build, maintain, and scale high-performance backend systems and modern cloud applications. You'll collaborate closely with senior engineers to develop reliable cloud-native solutions, create scalable data pipelines, support AI and LLM integrations, and continuously improve application security while leveraging modern AI-assisted development tools.

Requirements:

  • 3–5 years of professional experience as a Backend Engineer or Software Engineer.
  • Strong hands-on experience developing backend applications primarily in Python, with working knowledge of Java
  • Experience building applications on Google Cloud Platform (GCP) or another major cloud platform.
  • Solid understanding of backend architecture, distributed systems, REST APIs, and microservices.
  • Experience building, maintaining, and troubleshooting scalable backend services and data pipelines.
  • Exposure to or strong interest in Large Language Models (LLMs) and AI/ML integration within backend applications.
  • Experience using AI-assisted development tools such as GitHub Copilot to improve productivity and code quality.
  • Good understanding of Application Security (AppSec) principles and secure coding best practices.
  • Experience writing unit and integration tests.
  • Familiarity with Git, code reviews, CI/CD pipelines, and Agile development methodologies.
  • Strong communication and collaboration skills in cross-functional engineering teams.

Nice to Have:

  • Experience working with Kubernetes and Docker.
  • Knowledge of Infrastructure as Code (Terraform or similar).
  • Experience with messaging/event-driven architectures (Kafka, Pub/Sub, RabbitMQ).
  • Experience integrating AI services or machine learning APIs.
  • Familiarity with monitoring and observability tools.
  • Experience optimizing cloud infrastructure costs and performance.

Job Duties:

  • Design, develop, test, and deploy scalable backend services, APIs, and microservices using Java, Python, and Google Cloud Platform (GCP).
  • Build, optimize, and maintain reliable cloud-based data pipelines and backend infrastructure.
  • Support integrations with Large Language Models (LLMs) and AI-powered backend services.
  • Utilize GitHub Copilot and modern development practices to accelerate software delivery while maintaining high code quality.
  • Identify, troubleshoot, and resolve backend performance issues and production incidents.
  • Assist in identifying, prioritizing, and remediating application security vulnerabilities.
  • Write clean, maintainable, and well-tested code following engineering best practices.
  • Participate in code reviews and contribute to continuous improvement of development standards.
  • Develop and maintain technical documentation for backend services and system architecture.
  • Collaborate with product managers, DevOps engineers, and cross-functional teams to deliver high-quality software solutions.

What you can expect from us

Here at Nexaminds, we're not your typical workplace. We're all about creating a friendly and trusting environment where you can thrive. Why does this matter? Well, trust and openness lead to better quality, innovation, commitment to getting the job done, efficiency, and cost-effectiveness.

  • Stock options