1

Java Llm Jobs (NOW HIRING)

Java -Agentic AI

Homestead, PA · On-site

$47 - $64.50/hr

The role includes building LLM-powered applications, implementing agentic workflows, integrating ... Design and develop Java-based services for GenAI/LLM applications. Build agentic workflows that can ...

New

java developer

Gainesville, FL

$46.25 - $59.75/hr

Java 17/21 * Spring Boot * Microservices Architecture * REST API Development * Spring Security ... AI/LLM API integration exposure * React or Angular knowledge * Agile/Scrum experience ...

Java/Springboot/MongoDB/AI Engineer

Austin, TX · Hybrid

$51.25 - $70.25/hr

Java/Springboot/MongoDB/AI Engineer Location: Austin, TX (3 days hybrid) Duration: 6 Months plus ... Experience integrating LLM / GenAI APIs into applications * Familiarity with Docker and Kubernetes

Java Developer

Charlotte, NC · On-site

$49.75 - $64.50/hr

Java Developer || Fulltime || Charlotte , NC Must Have Technical/Functional Skills Primary Skill ... LLM concepts, and prompt engineering. • Experience with automated testing frameworks such as ...

java developer

Miami, FL · On-site

$48.75 - $63/hr

Currently, We are looking for entry-level software programmers, Java full-stack developers, Python ... AI, LLM, Python, Computer Vision, data visualization tools Excellent written and verbal ...

Gen AI Java Developer

Atlanta, GA · On-site

$61K - $104K/yr

Integrate LLM services (Azure OpenAI, OpenAI, Anthropic, etc.) into Java-based microservices using secure, scalable patterns LLM Orchestration & Workflow Engineering * Build and orchestrate multi ...

Java Production Engineer

New York, NY · On-site

$56.50 - $77.75/hr

Java Production Engineer Location: New York, NY(Onsite) Job Type: Full Time Must Have Technical ... LLM, Agentic AI and AI enabled development tools like copilot. • Agile/Scrum methodology ...

next page

Showing results 1-20

Java Llm information

See salary details

$15

$56

$77

How much do java llm jobs pay per hour?

As of Jun 4, 2026, the average hourly pay for java llm in the United States is $56.70, according to ZipRecruiter salary data. Most workers in this role earn between $49.04 and $63.46 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Java LLM (Large Language Model) Engineer, and why are they important?

To thrive as a Java LLM Engineer, you need strong proficiency in Java programming, understanding of machine learning fundamentals, and a degree in computer science or related fields. Familiarity with ML frameworks (like TensorFlow, PyTorch), cloud platforms (such as AWS or GCP), and version control systems (like Git) is typically required, along with relevant certifications. Excellent problem-solving, collaboration, and communication skills help you work efficiently on interdisciplinary teams and explain complex technical concepts. These competencies ensure you can build, deploy, and maintain scalable LLM solutions that meet business and user needs.

What are some common challenges faced by Java developers working on large language model (LLM) integration projects?

Java developers working on LLM integration often face challenges such as managing resource-intensive computations, ensuring seamless interoperability between Java and Python-based AI frameworks, and handling large volumes of data securely and efficiently. Collaboration with data scientists and machine learning engineers is crucial, as these projects typically require cross-functional teamwork. Staying updated with the latest AI libraries and optimizing Java code for performance are key to overcoming these challenges and delivering robust LLM-powered applications.

What is a Java LLM?

A Java LLM typically refers to a large language model (LLM) that is integrated with or used alongside Java applications. These models, such as those developed by OpenAI or similar organizations, can process and generate natural language, enabling capabilities like chatbots, code suggestions, and automated documentation within Java environments. Java developers often use APIs or SDKs to connect their applications to LLMs for various AI-powered functionalities. The integration can enhance productivity and automate complex natural language processing tasks.

What is the difference between Java Llm vs Java Developer?

AspectJava LlmJava Developer
Required CredentialsBachelor's in Computer Science, knowledge of machine learningBachelor's in Computer Science or related field, programming skills
Work EnvironmentAI/ML teams, research labs, tech companiesSoftware development teams, IT firms, tech companies
Industry UsageAI applications, machine learning projectsWeb applications, enterprise software, mobile apps
Common Search/ComparisonYesNo

Java Llm focuses on integrating Java with machine learning models, often requiring knowledge of AI frameworks. Java Developers primarily build software applications using Java programming skills. While both roles involve Java, Java Llm emphasizes AI/ML integration, whereas Java Developers focus on software development across various domains.

Infographic showing various Java Llm job openings in the United States as of May 2026, with employment types broken down into 89% Full Time, 4% Part Time, and 7% Contract. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $117,931 per year, or $56.7 per hour.

Java -Agentic AI

Yantran LLC

Homestead, PA • On-site

$47 - $64.50/hr

Other

Medical, Dental, Vision, Life, PTO

This job post has expired today. Applications are no longer accepted.


Job description

Job Title:
Agentic AI / GenAI Engineer (Java)
Location:
Pittsburgh,PA Onsite
Experience Required:
Minimum 5 years overall experience with strong Java backend background.
Job Summary:
We are looking for an Agentic AI / GenAI Engineer with a strong Java backend foundation to design, build, and deploy GenAI solutions and AI agents for enterprise use cases. The role includes building LLM-powered applications, implementing agentic workflows, integrating with enterprise systems and data sources, and ensuring responsible and secure AI usage.
Key Responsibilities:
Design and develop Java-based services for GenAI/LLM applications.
Build agentic workflows that can plan, execute multi-step tasks, and use tools/APIs as needed.
Implement Retrieval-Augmented Generation (RAG) patterns: document ingestion, embeddings, vector search, and response generation.
Integrate GenAI solutions with enterprise applications, data sources, and workflows.
Develop prompt strategies, templates, evaluation tests, and guardrails to improve quality and safety.
Optimize performance, cost, and latency of LLM calls; implement caching and monitoring.
Ensure security, compliance, and responsible usage practices for GenAI solutions.
Troubleshoot issues, perform root cause analysis, and support production deployments.
Required Skills:
Strong proficiency in Java and backend development.
Hands-on experience building GenAI/LLM applications.
Experience with agentic AI concepts (planning, tool use, orchestration).
Experience with RAG: embeddings, vector databases/search, and document pipelines.
API integration experience (REST), authentication/authorization basics.
Familiarity with CI/CD, testing, and code quality practices.
Good to Have:
Experience with Azure cloud services and Azure OpenAI.
Familiarity with agent frameworks (e.g., LangGraph-style orchestration concepts).
Experience with observability/monitoring and production support.
Education:
Bachelor's degree in Computer Science or equivalent practical experience.
About us.
At *** (*** | Connected World, Connected Experiences), we live the philosophy of connected world and connected experiences. We thrive on change that is powered by the intelligent symphony of technology and humans designing meaningful and sustainable experiences. Consumer 'experiences' are driving and disrupting industries like never before. Businesses must build seamless yet simple enterprises that collaborate, synergize, and drive the change. Change that connects us all and empowers us to deliver experiences that span across the digital, the physical, the convergent, and everything in between. That's when truly connected experiences manifest. Extraordinary is when experiences come together - a continuous convergence of digital technologies, touchpoints, and most importantly people. It's time to reimagine, reinvent, and revolutionize business models
operations as well as to transform enterprises into living, breathing, and connected businesses. We are the Digital Change makers who strive to change the way the world, communities, businesses, and humans interact digitally. We are harnessing the power of change, brought in by technologies, that makes it the most exciting time to be alive in the human history. Our universe, as we build it, disrupt it, and redesign it, is powering the digital change. *** represents the connected world, offering innovative and customer-centric information technology experiences, enabling Enterprises, Associates, and the Society to Rise. It has 150,000+ professionals working for 1000+ Global Customers (including Fortune 500 companies) in 90 Countries. We're part of the esteemed Mahindra group, headquartered in India. Under a new CEO, *** is committed to a transformative journey with 'Scale @ Speed' as our guiding principle.
The pay range for this role is
***- ***
per annum including any bonuses or variable pay. *** also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.
"*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin, or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ***."