ZipRecruiter

Log In

1

Professional Llm Developer Jobs (NOW HIRING)

Rialto Capital

IT - Lead AI and Data Engineer

Miami, FL · Hybrid

$109.50K - $131.50K/yr

Technical & Professional Skills * AI & LLM Engineering : Deep hands-on experience integrating LLM APIs (Azure OpenAI, OpenAI, Anthropic Claude), with strong command of RAG architecture, embeddings ...

Infosys Limited Digital

LLM Development: Prompt engineering, RAG, function calling. * Agent Frameworks: LangChain, Bedrock ... Mentor junior team members, fostering a culture of continuous learning and professional growth.

CBTS

Architect - Network Automation

Cincinnati, OH · On-site +1

Leverage AI/LLM developer tooling responsibly to improve productivity and code quality. Developer ... Required Qualifications Software Engineering (Primary) * 7+ years of professional software ...

Virtusa Corporation

Python Developer

Irving, TX · On-site

$48.25 - $66.50/hr

A minimum of 6 to 10 years of professional experience in Python software development is required ... LLM Frameworks: Direct, hands-on experience with Large Language Model (LLM) tools and frameworks (e ...

INSPYR Solutions

Sr AI Engineer - AI Solutions

Dallas, TX · On-site

$54.75 - $70.50/hr

... modern LLM frameworks. This role is highly hands-on and focused on production AI systems ... Our solutions are tailored to each client and include a wide variety of professional services ...

LiteLLM AI Gateway

Developer Evangelist

San Francisco, CA · On-site

$150K - $200K/yr

... give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens ... Ability to work and travel independently with professionalism and high productivity. * Previous ...

Kake

Senior Software Engineer - LLM Trainer

$125.40K - $165.30K/yr

Required : • 5+ years of professional software engineering experience in a backend, fullstack, or ... LLM evaluation projects • Excellent written and verbal communication skills in English • ...

CTI

Junior AI Developer

Memphis, TN · On-site +1

$60.10K - $78K/yr

Training and Experience: 0-2 years of professional experience in software development, data ... Experience deploying and debugging LLM systems, including containerization (Docker), API-based LLM ...

next page

Showing results 1-20

People also search for

All JobsProfessional Llm Developer Jobs

Professional Llm Developer information

See salary details

$25

$50

$79

How much do professional llm developer jobs pay per hour?

As of May 30, 2026, the average hourly pay for professional llm developer in the United States is $50.17, according to ZipRecruiter salary data. Most workers in this role earn between $39.42 and $60.82 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Professional LLM Developer, and why are they important?

To thrive as a Professional LLM Developer, you need expertise in machine learning, natural language processing, and strong programming skills in languages like Python, often supported by a degree in computer science or related fields. Familiarity with deep learning frameworks (such as PyTorch or TensorFlow), experience with large language model architectures, and knowledge of cloud platforms are typically required, along with certifications like TensorFlow Developer or AWS Certified Machine Learning. Strong problem-solving abilities, teamwork, and effective communication distinguish top performers in this role. These skills ensure the development, fine-tuning, and deployment of robust LLM solutions that meet business and technical needs.

What are some common challenges faced by Professional LLM Developers when deploying large language models in production environments?

Professional LLM Developers often encounter challenges such as optimizing model performance to balance accuracy with computational efficiency, managing latency for real-time applications, and ensuring data privacy and security. Additionally, integrating LLMs with existing systems and maintaining model versioning can be complex. Collaboration with cross-functional teams, such as data engineers and product managers, is essential to address these challenges and ensure the successful deployment and ongoing maintenance of LLM-driven solutions.

What are Professional LLM Developers?

Professional LLM Developers are software engineers or specialists who design, build, and optimize applications and systems that leverage large language models (LLMs) like GPT-4, Claude, or similar AI models. Their work often involves integrating LLMs into products, fine-tuning models for specific tasks, ensuring safe and ethical AI use, and improving performance. They may also create tools and frameworks that facilitate the deployment and scaling of LLM-powered applications. Their expertise combines software development, machine learning, and natural language processing.

What is the difference between Professional Llm Developer vs Machine Learning Engineer?

AspectProfessional Llm DeveloperMachine Learning Engineer
CredentialsTypically requires advanced degrees in AI, NLP, or related fields; certifications in AI/MLOften holds degrees in computer science, data science, or engineering; certifications in ML frameworks
Work EnvironmentFocuses on developing and fine-tuning large language models, often in research or specialized AI teamsDesigns, builds, and deploys ML models across various applications, in industry or tech companies
Industry UsagePrimarily in AI research, NLP, and companies developing LLM-based productsUsed across tech, finance, healthcare, and other sectors for predictive modeling and automation

While both roles involve AI and machine learning, a Professional Llm Developer specializes in large language models and NLP, whereas a Machine Learning Engineer works on a broader range of ML applications and models across industries.

More about Professional Llm Developer jobs
What cities are hiring for Professional Llm Developer jobs? Cities with the most Professional Llm Developer job openings:
What are the most commonly searched types of Llm Developer jobs? The most popular types of Llm Developer jobs are:
What states have the most Professional Llm Developer jobs? States with the most job openings for Professional Llm Developer jobs include:
What job categories do people searching Professional Llm Developer jobs look for? The top searched job categories for Professional Llm Developer jobs are:
Professional Llm Developer jobs near you
Infographic showing various Professional Llm Developer job openings in the United States as of May 2026, with employment types broken down into 100% Full Time. Highlights an 99% Physical, and 1% Remote job distribution, with an average salary of $104,344 per year, or $50.2 per hour.
AI Engineer - Insurance Domain - HYBRID

AI Engineer - Insurance Domain - HYBRID

NTT DATA Services

Warren, NJ • On-site

$87.12K - $181.50K/yr

Full-time

Posted 9 days ago

NTT Data rating

7.3

Company rating: 7.3 out of 10

Based on 89 frontline employees who took The Breakroom Quiz

105th of 203 rated it services

Job description

Req ID: 368907
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a AI Engineer - Insurance Domain - HYBRID to join our team in Warren, New Jersey (US-NJ), United States (US).
Day to Day Responsibilities:
Generative AI & LLM Engineering
  • Design, fine-tune, and deploy Large Language Models (LLMs) for insurance-specific use cases including document intelligence, claims summarization, policy interpretation, and underwriting Q&A.
  • Build Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., Azure AI Search, Pinecone, ChromaDB) to ground LLM outputs in enterprise knowledge bases.
  • Develop prompt engineering frameworks and systematic evaluation pipelines to ensure LLM output quality, consistency, and safety in regulated insurance contexts.
  • Integrate LLM capabilities with internal data platforms via LangChain, LlamaIndex, or Semantic Kernel.
  • Evaluate and benchmark foundational models (OpenAI GPT-4o, Azure OpenAI, Claude, Mistral, Llama) against insurance-specific tasks to guide platform selection.

AI Agents & Automation
  • Architect and implement autonomous AI agents capable of multi-step reasoning, tool use, and decision-making for workflows such as FNOL triage, claims routing, policy lookup, and compliance checks.
  • Build agentic frameworks using patterns such as ReAct, Chain-of-Thought, and Tool-Augmented Agents to handle complex, multi-turn insurance workflows.
  • Design human-in-the-loop (HITL) checkpoints and escalation logic to ensure AI agents operate within defined risk and compliance boundaries.
  • Integrate agents with internal APIs, data platforms, and enterprise systems using orchestration tools such as Azure Logic Apps, Apache Airflow, or Databricks Workflows.
  • Develop guardrails, monitoring, and audit logging for all deployed agents to meet regulatory and governance standards.

MLOps & Model Deployment
  • Build and maintain end-to-end MLOps pipelines covering model training, versioning, validation, deployment, and monitoring using MLflow, Azure ML, and Databricks.
  • Implement CI/CD pipelines for ML models using Azure DevOps or GitHub Actions, enabling reliable, repeatable model releases.
  • Deploy models as REST APIs or batch inference services on Azure Kubernetes Service (AKS) or Azure Container Apps, ensuring scalability and low-latency response.
  • Establish model monitoring frameworks to detect data drift, model degradation, and prediction anomalies in production.
  • Manage the model registry and lineage tracking to maintain governance and auditability of all AI assets.
  • Collaborate with data engineering teams to ensure feature pipelines are production-grade, versioned, and integrated with the Feature Store on Databricks or Azure ML.

Collaboration & Delivery
  • Work closely with business analysts, actuaries, underwriters, and claims professionals to translate domain requirements into AI solution designs.
  • Participate in Agile/Scrum ceremonies including sprint planning, standups, and retrospectives as an active delivery contributor.
  • Produce clear, well-structured technical documentation including solution designs, API specs, model cards, and deployment runbooks.
  • Mentor junior engineers and contribute to internal AI engineering best practices and standards.

Education
  • Bachelor's degree in Computer Science, Data Science, Machine Learning, Software Engineering, or a related quantitative field. Master's degree is a plus.

Minimum Requirements
  • 3+ years of professional experience in AI/ML engineering, with demonstrated delivery of production-grade AI systems.
  • 3+ years hands-on experience building and deploying LLM-powered applications using frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
  • 3+ years proven experience implementing MLOps pipelines in cloud environments (Azure preferred).
  • 3+ years experience developing AI agents or automation workflows using agentic frameworks.
  • 2+ years experience in financial services, insurance, or regulated industries is strongly preferred.

Preferred Qualifications
  • Experience with P&C insurance workflows such as FNOL processing, claims triage, underwriting decisioning, or actuarial modeling.
  • Familiarity with insurance regulatory requirements including NAIC guidelines and data privacy standards (CCPA, GDPR).
  • Experience implementing responsible AI principles - fairness, explainability, and bias mitigation - in regulated environments.
  • Microsoft certifications: Azure AI Engineer Associate (AI-102) or Azure Data Scientist Associate (DP-100) preferred.
  • Exposure to Data Mesh patterns and publishing AI model outputs as domain data products.

#LI-NorthAmerica
Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting pay range for this remote role is $87,120 - $181,500. This range reflects the minimum and maximum target compensation for the position across all US locations. Actual compensation will depend on a number of factors, including the candidate's actual work location, relevant experience, technical skills, and other qualifications.
About NTT DATA
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.
Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client's needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us.
NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.

What NTT Data employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

NTT DATA logo

About NTT DATA

Sourced by ZipRecruiter

NTT DATA Services is a global business and IT services provider specializing in digital, cloud and automation across a comprehensive portfolio of consulting, applications, infrastructure and business process services. We are part of the NTT family of companies, a partner to 85 % of the Fortune 100.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Plano, TX, US

Year founded

1967

View All NTT DATA Jobs

Apply