ZipRecruiter

Log In

1

Java Llm Jobs (NOW HIRING)

Programmers.io

Azure AI/ML Engineer

Bellevue, WA · On-site

$62 - $77/hr

NET 4.5,Java,LLM,Python,Vector,Semantic Kernel, AI Foundry ,LLMs (Azure OpenAI, OpenAI, Anthropic,MicroServices,Azure DevOps,Docker,Kubernetes Role Descriptions: 8 years of Strong proficiency in ...

Digital Links Inc

Java AI/LLM

Glen Lyn, VA · Remote

$52.25 - $67.50/hr

* 7+ years experience in designing and building Java Microservices, CICD skill to build and deploy on test and production environments * AI/LLM skill with * AI/LLM - hugging face model, OLAMA, LLAMA ...

Artech

Java + AI Engineer

Chicago, IL · On-site

$45 - $53/hr

Implement LLM orchestration, prompt engineering, vector search, and model fine-tuning . * Develop scalable APIs and microservices to integrate AI capabilities into enterprise applications.

First Soft Solutions

LLM Engineer

Dallas, TX · On-site

Design and develop full-stack applications using Java and React * Build and integrate LLM-powered solutions using APIs (OpenAI, Claude, Azure OpenAI, etc.) * Develop scalable microservices and REST ...

First Soft Solutions

LLM Engineer

Dallas, TX · On-site

Design and develop full-stack applications using Java and React * Build and integrate LLM-powered solutions using APIs (OpenAI, Claude, Azure OpenAI, etc.) * Develop scalable microservices and REST ...

Artech

Java Developer

Hopkins, MN · Hybrid

$52 - $67.25/hr

Experience with OpenAI or similar LLM platforms * Knowledge of vector databases (PGVector, ChromaDB ... Develop backend services using Java Spring Boot for integration, APIs, and enterprise workflows

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ... The role is hands-on Java + Spring Boot with meaningful GenAI integration work not a research role ...

Select Jarvis.com

Java Developer (GenAI)

Charlotte, NC · On-site

$49.75 - $64.50/hr

The ideal candidate should have strong expertise in Java-based application development, REST APIs, microservices architecture, and experience integrating AI/LLM solutions into enterprise applications.

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$56.25 - $72.75/hr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$56.25 - $72.75/hr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$100K - $125K/yr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

VBeyond

Senior Java Developer - Payments

Seattle, WA · On-site

$65.25 - $83/hr

Senior Java Developer - Payments Location - Vancouver, Canada or Seattle, WA - Onsite Type ... This includes microservices for transaction processing and AI/ML-powered capabilities such as LLM ...

Yantran LLC

Java -Agentic AI

Pittsburgh, PA · On-site

$47.75 - $61.75/hr

The role includes building LLM-powered applications, implementing agentic workflows, integrating ... Design and develop Java-based services for GenAI/LLM applications. * Build agentic workflows that ...

Diverse Lynx

Java/Springboot/MongoDB Developer

Austin, TX · On-site

$50.50 - $65.50/hr

... LLM / GenAI APIs into applications Familiarity with Docker and Kubernetes Strong analytical and problem-solving skills Subcon Staffing end date: 10 April 2027 Niche Category (Niche/ Super Niche ...

Saviance

Senior Software Engineer - AI / Java

Boston, MA · Hybrid

$135K - $178K/yr

Role Overview We are looking for a Senior Software Engineer - AI / Java with exceptionally strong development fundamentals and deep LLM/GenAI experience to join the Leading Healthcare Technology ...

next page

Showing results 1-20

People also search for

All JobsJava Llm Jobs

Java Llm information

See salary details

$15

$56

$77

How much do java llm jobs pay per hour?

As of Jun 4, 2026, the average hourly pay for java llm in the United States is $56.70, according to ZipRecruiter salary data. Most workers in this role earn between $49.04 and $63.46 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Java LLM (Large Language Model) Engineer, and why are they important?

To thrive as a Java LLM Engineer, you need strong proficiency in Java programming, understanding of machine learning fundamentals, and a degree in computer science or related fields. Familiarity with ML frameworks (like TensorFlow, PyTorch), cloud platforms (such as AWS or GCP), and version control systems (like Git) is typically required, along with relevant certifications. Excellent problem-solving, collaboration, and communication skills help you work efficiently on interdisciplinary teams and explain complex technical concepts. These competencies ensure you can build, deploy, and maintain scalable LLM solutions that meet business and user needs.

What are some common challenges faced by Java developers working on large language model (LLM) integration projects?

Java developers working on LLM integration often face challenges such as managing resource-intensive computations, ensuring seamless interoperability between Java and Python-based AI frameworks, and handling large volumes of data securely and efficiently. Collaboration with data scientists and machine learning engineers is crucial, as these projects typically require cross-functional teamwork. Staying updated with the latest AI libraries and optimizing Java code for performance are key to overcoming these challenges and delivering robust LLM-powered applications.

What is a Java LLM?

A Java LLM typically refers to a large language model (LLM) that is integrated with or used alongside Java applications. These models, such as those developed by OpenAI or similar organizations, can process and generate natural language, enabling capabilities like chatbots, code suggestions, and automated documentation within Java environments. Java developers often use APIs or SDKs to connect their applications to LLMs for various AI-powered functionalities. The integration can enhance productivity and automate complex natural language processing tasks.

What is the difference between Java Llm vs Java Developer?

AspectJava LlmJava Developer
Required CredentialsBachelor's in Computer Science, knowledge of machine learningBachelor's in Computer Science or related field, programming skills
Work EnvironmentAI/ML teams, research labs, tech companiesSoftware development teams, IT firms, tech companies
Industry UsageAI applications, machine learning projectsWeb applications, enterprise software, mobile apps
Common Search/ComparisonYesNo

Java Llm focuses on integrating Java with machine learning models, often requiring knowledge of AI frameworks. Java Developers primarily build software applications using Java programming skills. While both roles involve Java, Java Llm emphasizes AI/ML integration, whereas Java Developers focus on software development across various domains.

Infographic showing various Java Llm job openings in the United States as of May 2026, with employment types broken down into 89% Full Time, 4% Part Time, and 7% Contract. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $117,931 per year, or $56.7 per hour.
Azure AI/ML Engineer

Azure AI/ML Engineer

Programmers.io

Bellevue, WA • On-site

$62 - $77/hr

Contractor

Posted 22 days ago

Job description

AI,C#,ASP.NET 4.5,Java,LLM,Python,Vector,Semantic Kernel, AI Foundry ,LLMs (Azure OpenAI, OpenAI, Anthropic,MicroServices,Azure DevOps,Docker,Kubernetes
Role Descriptions: 8 years of Strong proficiency in Python| C| or Java Hands-on experience in building RAG-based systems and implement RAG pipelines using embeddings| vector search| and LLMsSolid experience with Vector Databases and embedding-based search e.g. Azure AI SearchPractical experience with Semantic Kernel| AI Foundry| Lang Chain| LlamaIndex| or similar frameworks| Azure ServicesExperience working with LLMs (Azure OpenAI| OpenAI| Anthropic| or equivalent)Strong understanding of REST APIs| microservices| and cloud-native architecturesExperience in developing secure| scalable APIs and services to support AI-driven applicationsEnsure best practices around security| data privacy| observability| and cost optimizationExperience in building multi-agent and tool-using workflows using Semantic Kernel| AI Foundry| or similar orchestration frameworksCollaborate with product| data science| and platform teams to translate business requirements into AI solutionsExperience deploying applications on cloud platforms (Azure preferred)Familiarity with CICD| containerization (Docker)| and orchestration (Kubernetes is a plus)
Essential Skills: AI C ASP.NET 4.5 Java LLM Python Vector Semantic Kernel AI FoundryLLMs (Azure OpenAI OpenAI Anthropic MicroServices Azure DevOps Docker Kubernetes
Desirable Skills:
Keyword:
Skills: Digital : Python~Digital : Docker~Core Java~ASP.NET 4.5
Experience Required: 8-10