ZipRecruiter

Log In

1

Java Llm Jobs (NOW HIRING)

Programmers.io

Azure AI/ML Engineer

Bellevue, WA · On-site

$62 - $77/hr

NET 4.5,Java,LLM,Python,Vector,Semantic Kernel, AI Foundry ,LLMs (Azure OpenAI, OpenAI, Anthropic,MicroServices,Azure DevOps,Docker,Kubernetes Role Descriptions: 8 years of Strong proficiency in ...

Digital Links Inc

Java AI/LLM

Glen Lyn, VA · Remote

$52.25 - $67.50/hr

* 7+ years experience in designing and building Java Microservices, CICD skill to build and deploy on test and production environments * AI/LLM skill with * AI/LLM - hugging face model, OLAMA, LLAMA ...

SCI SOLUTIONS GLOBAL

Java Developer

Plano, TX · On-site

$50 - $60/hr

Experience with modern infrastructure-as-code practices and emerging LLM technologies is a plus. Responsibilities * Design, develop, test, deploy, maintain, and enhance Java/J2EE applications and ...

SCI SOLUTIONS GLOBAL

Java Developer

Wilmington, DE · On-site

$50 - $60/hr

Java Developer W2 Requirement Location: Wilmington, DE - Locals only USC/GC Only In person ... Familiarity with modern LLM techniques and practical LLM use case development on OpenAI Azure.

ITTConnect

Senior AI Engineer (Java)

Saint Louis, MO · On-site

$117K - $154K/yr

Integrate NLP, machine learning, and LLM capabilities into Java-based enterprise applications ... Build or integrate NLP solutions for text classification, clustering, intent detection, and related ...

ITTConnect

Senior AI Engineer (Java)

Saint Louis, MO · On-site

$121K - $159K/yr

Integrate NLP, machine learning, and LLM capabilities into Java-based enterprise applications ... Build or integrate NLP solutions for text classification, clustering, intent detection, and related ...

next page

Showing results 1-20

All JobsTechnology JobsJava Llm Jobs

Java Llm information

See salary details

$15

$56

$77

How much do java llm jobs pay per hour?

As of Sep 11, 2026, the average hourly pay for java llm in the United States is $56.70, according to ZipRecruiter salary data. Most workers in this role earn between $49.04 and $63.46 per hour, depending on experience, location, and employer.

What is a Java LLM?

A Java LLM typically refers to a large language model (LLM) that is integrated with or used alongside Java applications. These models, such as those developed by OpenAI or similar organizations, can process and generate natural language, enabling capabilities like chatbots, code suggestions, and automated documentation within Java environments. Java developers often use APIs or SDKs to connect their applications to LLMs for various AI-powered functionalities. The integration can enhance productivity and automate complex natural language processing tasks.

What are the key skills and qualifications needed to thrive as a Java LLM engineer?

To thrive as a Java LLM Engineer, you need strong proficiency in Java programming, understanding of machine learning fundamentals, and a degree in computer science or related fields. Familiarity with ML frameworks (like TensorFlow, PyTorch), cloud platforms (such as AWS or GCP), and version control systems (like Git) is typically required, along with relevant certifications. Excellent problem-solving, collaboration, and communication skills help you work efficiently on interdisciplinary teams and explain complex technical concepts. These competencies ensure you can build, deploy, and maintain scalable LLM solutions that meet business and user needs.

What are some common challenges faced by Java developers working on large language model integration projects?

Java developers working on LLM integration often face challenges such as managing resource-intensive computations, ensuring seamless interoperability between Java and Python-based AI frameworks, and handling large volumes of data securely and efficiently. Collaboration with data scientists and machine learning engineers is crucial, as these projects typically require cross-functional teamwork. Staying updated with the latest AI libraries and optimizing Java code for performance are key to overcoming these challenges and delivering robust LLM-powered applications.

What is the difference between Java Llm vs Java Developer?

AspectJava LlmJava Developer
Required CredentialsBachelor's in Computer Science, knowledge of machine learningBachelor's in Computer Science or related field, programming skills
Work EnvironmentAI/ML teams, research labs, tech companiesSoftware development teams, IT firms, tech companies
Industry UsageAI applications, machine learning projectsWeb applications, enterprise software, mobile apps
Common Search/ComparisonYesNo

Java Llm focuses on integrating Java with machine learning models, often requiring knowledge of AI frameworks. Java Developers primarily build software applications using Java programming skills. While both roles involve Java, Java Llm emphasizes AI/ML integration, whereas Java Developers focus on software development across various domains.

What other helpful pages are available for Java Llm?

Other pages related to Java Llm:

Infographic showing various Java Llm job openings in the United States as of September 2026, with employment types broken down into 100% Contract. Highlights an 50% In-person, and 50% Remote job distribution, with an average salary of $117,931 per year, or $56.7 per hour.

Forward Deployed Engineer - Core Java, LLM, Azure, SQL

Lake Mary, FL • On-site

Reliable Software Resources
1 - 5K employees
Learn more about Reliable Software Resourcesexternal

Other

This job post has expired 2 days ago. Applications are no longer accepted.

Job description

Position: Forward Deployed Engineer - Core Java, LLM, Azure, SQL

Location: Lake Mary, FL

Longterm Contract

Skills:

  • Strong hands-on experience in Core Java, Spring Boot, REST APIs, Microservices, Design Patterns, and SQL (Oracle preferred).
  • Experience designing scalable, high-performance, and multi-tenant applications.
  • Strong knowledge of Microsoft Azure and cloud-native architectures.
  • Hands-on experience with RAG, Agentic AI, Multi-Agent Systems, MCP, LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar AI orchestration frameworks.
  • Experience building AI-powered solutions using LLMs, AI Agents, Vector Databases, Prompt Engineering, and Intelligent Automation.
  • Ability to drive product and solution architecture, translate business requirements into technical designs, and deliver production-ready solutions.
  • Strong understanding of concurrency, thread pools, transaction management, caching, and performance optimization.
  • Excellent stakeholder management, communication, and problem-solving skills.

Apply