ZipRecruiter

Log In

1

Java Llm Jobs (NOW HIRING)

Ninth Wave, Inc.

AI Java Developer

Manhattan, NY · On-site

$56.25 - $72.75/hr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

New York, NY · On-site

$55.75 - $72.25/hr

Ninth Wave AI Java Developer Full Time Opportunity Job Summary We are hiring an AI Java Developer ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$56.25 - $72.75/hr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$56.25 - $72.75/hr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

Ninth Wave

AI Java Developer

Manhattan, NY · On-site

$100K - $125K/yr

Ninth Wave AI Java Developer Full Time Opportunity New York City, NY Job Summary We are hiring an ... integrate LLM-driven assistance (Bedrock Knowledge Bases + Agents, RAG over our internal corpus ...

1 point system

Java Developer

Charlotte, NC · On-site

$49.75 - $64.50/hr

GenAI/LLM (created agents) * OCP (Cloud Foundry underlying OS), some type of cloud deployment * Kafka * Familiarity with working in cloud environments

Up2date Technologies

AI Java Architect

Louisiana, MO · On-site

$55.75 - $75.25/hr

AI Java Architect Location: St Louis, MO Duration: 6+months Key Responsibilities: · Design and ... LLM integration via Anthropic Claude API, OpenAI, or AWS Bedrock · RAG architecture, vector ...

1 point system

Backend Java Developer

Pasadena, CA · On-site

$55 - $71.50/hr

Java * Spring Boot * Graph QL * AWS * Kafka * Any AI Development Tool Java Developer Top Must-Haves ... LLM-powered tools are part of the everyday engineering workflow. Familiarity with AWS cloud ...

Btisolutions

Java/Python Full Stack Developer

Plano, TX

$50.25 - $64.75/hr

... LLM), and Agentic AI technologies. The ideal candidate will have strong Java/Spring application development and operational experience, with the ability to expand into AI application development ...

BTI Solutions

Java/Python Full Stack Developer

Plano, TX · On-site

$50.25 - $64.75/hr

... LLM), and Agentic AI technologies. The ideal candidate will have strong Java/Spring application development and operational experience, with the ability to expand into AI application development ...

JPMorgan Chase & Co.

$44.25 - $60.50/hr

Software Engineer III - Java / Transformative AI/LLMJob Information * Job Identification 210751624 ... Experience with Transformative AI or LLM driven solutions. Preferred Qualifications, Capabilities ...

previous pagenext page

Showing results 21-40

All JobsTechnology JobsJava Llm Jobs

Java Llm information

See salary details

$15

$56

$77

How much do java llm jobs pay per hour?

As of Sep 11, 2026, the average hourly pay for java llm in the United States is $56.70, according to ZipRecruiter salary data. Most workers in this role earn between $49.04 and $63.46 per hour, depending on experience, location, and employer.

What is a Java LLM?

A Java LLM typically refers to a large language model (LLM) that is integrated with or used alongside Java applications. These models, such as those developed by OpenAI or similar organizations, can process and generate natural language, enabling capabilities like chatbots, code suggestions, and automated documentation within Java environments. Java developers often use APIs or SDKs to connect their applications to LLMs for various AI-powered functionalities. The integration can enhance productivity and automate complex natural language processing tasks.

What are the key skills and qualifications needed to thrive as a Java LLM engineer?

To thrive as a Java LLM Engineer, you need strong proficiency in Java programming, understanding of machine learning fundamentals, and a degree in computer science or related fields. Familiarity with ML frameworks (like TensorFlow, PyTorch), cloud platforms (such as AWS or GCP), and version control systems (like Git) is typically required, along with relevant certifications. Excellent problem-solving, collaboration, and communication skills help you work efficiently on interdisciplinary teams and explain complex technical concepts. These competencies ensure you can build, deploy, and maintain scalable LLM solutions that meet business and user needs.

What are some common challenges faced by Java developers working on large language model integration projects?

Java developers working on LLM integration often face challenges such as managing resource-intensive computations, ensuring seamless interoperability between Java and Python-based AI frameworks, and handling large volumes of data securely and efficiently. Collaboration with data scientists and machine learning engineers is crucial, as these projects typically require cross-functional teamwork. Staying updated with the latest AI libraries and optimizing Java code for performance are key to overcoming these challenges and delivering robust LLM-powered applications.

What is the difference between Java Llm vs Java Developer?

AspectJava LlmJava Developer
Required CredentialsBachelor's in Computer Science, knowledge of machine learningBachelor's in Computer Science or related field, programming skills
Work EnvironmentAI/ML teams, research labs, tech companiesSoftware development teams, IT firms, tech companies
Industry UsageAI applications, machine learning projectsWeb applications, enterprise software, mobile apps
Common Search/ComparisonYesNo

Java Llm focuses on integrating Java with machine learning models, often requiring knowledge of AI frameworks. Java Developers primarily build software applications using Java programming skills. While both roles involve Java, Java Llm emphasizes AI/ML integration, whereas Java Developers focus on software development across various domains.

What other helpful pages are available for Java Llm?

Other pages related to Java Llm:

Infographic showing various Java Llm job openings in the United States as of September 2026, with employment types broken down into 100% Contract. Highlights an 50% In-person, and 50% Remote job distribution, with an average salary of $117,931 per year, or $56.7 per hour.

AI/ML Java Solutions Architect

New York, NY • On-site

Vkore Solutions
See more jobs at Vkore Solutionsexternal

Contractor

Re-posted 25 days ago

Job description

Role- Solution Architect in the space of Microservice and AI, ML with strong experience in LLM, Agentic AI                                           

About the Role:

We are seeking a highly skilled Solution Architect with a strong foundation in Java/Spring Boot and microservices architecture, who can also bridge the gap between traditional backend systems and modern AI/ML platforms. The ideal candidate will have experience or a strong interest in LLM-based frameworks (e.g., LangChain, Agentic AI), and be capable of designing scalable, intelligent solutions that integrate with major AI platforms.

Key Responsibilities:

  • Architect and design scalable, secure, and high-performance microservices using Java and Spring Boot.
  • Collaborate with AI/ML teams to integrate LLM-based tools and frameworks into enterprise applications.
  • Understand and work with MCP (Model Control Plane), A2A (Agent-to-Agent) communication, and LLM orchestration frameworks like LangChain and Agentic AI.
  • Evaluate and recommend AI platforms and tools for enterprise use cases.
  • Translate business requirements into technical solutions that leverage both traditional and AI-driven components.
  • Lead technical discussions with stakeholders, including product managers, data scientists, and platform teams.
  • Ensure architectural alignment with enterprise standards and best practices.

Required Skills & Experience:

  • 8+ years of experience in backend development with Java/Spring Boot.
  • Proven experience designing and deploying microservices architectures.
  • Familiarity with AI/ML concepts, especially LLMs, prompt engineering, and AI agents.
  • Understanding of LangChain, Agentic AI, or similar LLM orchestration frameworks.
  • Experience integrating with AI platforms (e.g., OpenAI, Azure OpenAI, Anthropic, Hugging Face).
  • Strong understanding of API design, event-driven systems, and cloud-native architectures.
  • Excellent communication and stakeholder management skills.

Preferred Qualifications:

  • Hands-on experience with LLM-based applications or AI agent frameworks.
  • Exposure to MCP, A2A, or similar AI infrastructure concepts.
  • Experience with containerization (Docker, Kubernetes) and CI/CD pipelines.
  • Knowledge of data pipelines and AI model lifecycle management.