1

Llm Prompt Review Jobs in Indiana (NOW HIRING)

Principal AI Engineer

Carmel, IN · On-site

$168K - $193K/yr

Developing and operationalizing LLM-powered solutions (RAG, prompt engineering, agent workflows) to ... For further information, please review the Know Your Rights notice from the Department of Labor.

... reviews, and testing* Collaborate with product managers, architects, and business stakeholders as ... Experience with prompt engineering, conversational AI, or building LLM-based applications is a ...

AI Solutions Engineer

Carmel, IN · On-site

$110 - $160/hr

Strong proficiency with generative AI and large language models, including prompt engineering for ... review checkpoints. * Requirements‑discovery and facilitation skills--able to embed with a ...

Strong proficiency with generative AI and large language models, including prompt engineering for ... review checkpoints. * Requirements-discovery and facilitation skills - able to embed with a ...

Strong proficiency with generative AI and large language models, including prompt engineering for ... review checkpoints. * Requirements-discovery and facilitation skills - able to embed with a ...

Use the review of work as an opportunity to deepen the expertise of team members. Address conflicts ... in prompt engineering for LLM optimization - Implementing data integration solutions using AWS ...

Showing results 21-36

Llm Prompt Review information

What is an LLM prompt reviewer?

An LLM Prompt Reviewer is a professional responsible for evaluating, refining, and optimizing prompts used with large language models (LLMs) like GPT-4. Their main goal is to ensure that prompts elicit accurate, useful, and safe responses from the AI. This role involves understanding both the technical and linguistic aspects of prompts, testing various phrasings, and documenting best practices. LLM Prompt Reviewers often collaborate with data scientists, AI trainers, and product teams to improve prompt quality and user experience.

What are the key skills and qualifications needed to thrive as an LLM prompt reviewer, and why are they important?

To thrive as an LLM Prompt Reviewer, you need a strong background in linguistics, critical thinking, and AI language model behavior, often supported by experience in content moderation or NLP. Familiarity with prompt engineering tools, annotation platforms, and basic understanding of large language model systems is typically required. Attention to detail, analytical skills, and clear written communication make someone stand out in this position. These skills ensure the creation and evaluation of high-quality prompts that drive accurate, safe, and useful AI model outputs.

What are some common challenges faced by professionals in LLM prompt review roles, and how can they be managed?

Professionals in LLM Prompt Review roles often encounter challenges such as ensuring prompt clarity, mitigating bias, and maintaining consistency across large volumes of prompts. Balancing creativity with precision is essential, as even small changes can significantly impact model outputs. To manage these challenges, reviewers typically rely on established guidelines, peer collaboration, regular calibration sessions, and continuous feedback from model performance metrics. Staying updated on best practices and working closely with data scientists and prompt engineers also helps maintain high-quality outputs.

What is the difference between Llm Prompt Review vs Data Annotator?

AspectLlm Prompt ReviewData Annotator
CredentialsBasic understanding of AI and NLP conceptsTypically high school diploma or equivalent, sometimes specialized training
Work EnvironmentRemote or office-based, focused on AI projectsRemote or on-site, working with datasets and labeling tools
Industry UsageUsed in AI development, NLP, and machine learning projectsUsed across various industries for data preparation and labeling
Search & Comparison IntentUnderstanding roles related to AI prompt evaluationComparing data labeling and annotation roles

While both roles involve working with data and AI, Llm Prompt Review focuses on evaluating and refining AI prompts, whereas Data Annotator involves labeling data for machine learning models. The roles differ mainly in their specific tasks and required skills, but both are essential in AI development workflows.

What are popular job titles related to Llm Prompt Review jobs in Indiana?

For Llm Prompt Review jobs in Indiana, the most frequently searched job titles are:

What job categories do people searching Llm Prompt Review jobs in Indiana look for?

The top searched job categories for Llm Prompt Review jobs in Indiana are:

What cities in Indiana are hiring for Llm Prompt Review jobs?

Cities in Indiana with the most Llm Prompt Review job openings:

AI Machine Learning Scientist

The Elevance Health Companies, Inc.

Indianapolis, IN • On-site

$120 - $170/hr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted yesterday

New


Elevance Health rating

7.6

Company rating: 7.6 out of 10

Based on 352 frontline employees who took The Breakroom Quiz

212th of 311 rated insurance


Job description

Anticipated End Date: 2026-08-21 Position Title: AI Machine Learning Scientist Job Description: AI Machine Learning Scientist Location: This role requires associates to be in-office 1 day per week, fostering collaboration and connectivity, while providing flexibility to support productivity and work-life balance. This approach combines structured office engagement with the autonomy of virtual work, promoting a dynamic and adaptable workplace. Ideal candidates will be able to report to one of our Pulse Point locations in Indianapolis, IN, Atlanta, GA or Tampa, FL. Alternate locations may be considered if candidates reside within a commuting distance from an office. Please note that per our policy on hybrid/virtual work, candidates not within a reasonable commuting distance from the posting location(s) will not be considered for employment, unless an accommodation is granted as required by law.

The AI Machine Learning Scientist is responsible for Artificial Intelligence (AI) scientific and statistical methods to assist with product creation, development and improvement. Plays a critical role in enabling the responsible and scalable adoption of AI across the enterprise. This role is responsible for designing, developing, evaluating, and operationalizing AI and machine learning solutions, including Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agent-based systems. Help build reusable AI capabilities, evaluation frameworks, and governance processes that ensure AI systems are reliable, measurable, compliant, and aligned with Responsible AI principles. Will work closely with engineering, product, data science, and business teams to translate complex business challenges into production-ready AI solutions.

How you will make an impact
  • Design, develop, and deploy AI/ML and Generative AI solutions that address business and operational challenges at enterprise scale.
  • Build and maintain infrastructure, pipelines, and services that connect structured and unstructured data sources for AI-driven applications.
  • Develop reusable AI capabilities including RAG pipelines, vector search, semantic retrieval, prompt orchestration, and agentic workflows.
  • Implement evaluation frameworks and automated testing strategies to measure model quality, accuracy, bias, safety, and performance.
  • Establish monitoring, observability, and governance processes to ensure AI systems remain reliable and compliant in production.
  • Collaborate with engineering and product teams to integrate AI capabilities into enterprise platforms and applications.
  • Drive adoption of Responsible AI practices by implementing evaluation standards, audit-ready documentation, and model governance controls.
  • Optimize AI systems for scalability, latency, reliability, and cost efficiency.
  • Support experimentation, benchmarking, and model comparison activities to improve decision-making and accelerate AI innovation.
  • Partner with cross-functional stakeholders to translate business requirements into production-ready AI capabilities and services.
  • Contribute to technical standards, architecture decisions, and best practices for enterprise AI engineering.
  • Develop experimental and analytic plans for machine learning algorithms and data modeling processes, use of strong baselines, and ability to accurately determine cause and effect relations.
Minimum Requirements
  • Requires a Bachelor’s degree in a highly quantitative field (Computer Science, Machine Learning, Operational Research, Statistics, Mathematics, etc.) or equivalent degree and 4 or more years of experience; or any combination of education and experience in configuration management, which would provide an equivalent background.
Preferred Skills, Capabilities and Experiences
  • Experience building and deploying LLM- or SLM-based applications in production environments highly preferred.
  • Experience developing Retrieval-Augmented Generation (RAG) systems, semantic search, vector databases, embeddings, and prompt engineering techniques highly preferred.
  • Experience designing and implementing AI agents, tool-calling workflows, or agentic architectures highly preferred.
  • Experience evaluating AI systems using automated evaluation frameworks, benchmarking approaches, and human-in-the-loop review processes highly preferred.
  • Experience building scalable AI/ML pipelines and services using cloud-native architectures highly preferred.
  • Experience with MLOps practices including CI/CD, model deployment, monitoring, observability, drift detection, and lifecycle management highly preferred.
  • Experience with Python and modern AI/ML frameworks and libraries (e.g., PyTorch, TensorFlow, LangChain, LangGraph, LlamaIndex, Hugging Face, or equivalent) highly preferred.
  • Familiarity with Responsible AI principles, model governance, bias testing, explainability, and auditability requirements highly preferred.
  • Experience integrating AI solutions with APIs, enterprise platforms, and distributed systems preferred.
  • Experience reviewing, testing, validating, and hardening AI-generated code and AI-assisted development workflows preferred.
  • Experience supporting production AI systems, troubleshooting issues, and driving continuous improvement preferred.
  • Strong communication and collaboration skills with the ability to influence technical and non-technical stakeholders preferred.
  • Healthcare, regulated industry, or enterprise-scale AI experience preferred.

Job Level: Non-Management Exempt

Workshift: Job Family: IFT > Artificial Intelligence

Elevance Health is a health company dedicated to improving lives and communities – and making healthcare simpler. We are a Fortune 25 company with a longstanding history in the healthcare industry, looking for leaders at all levels of the organization who are passionate about making an impact on our members and the communities we serve.

How We Work

At Elevance Health, we are creating a culture that is designed to advance our strategy but will also lead to personal and professional growth for our associates. Our values and behaviors are the root of our culture. They are how we achieve our strategy, power our business outcomes and drive our shared success - for our consumers, our associates, our communities and our business.

Benefits
  • Merit increases
  • Paid holidays
  • Paid Time Off
  • Incentive bonus programs (unless covered by a collective bargaining agreement)
  • Medical, dental, vision, short and long term disability benefits
  • 401(k) +match
  • Stock purchase plan
  • Life insurance
  • Wellness programs
  • Financial education resources

Elevance Health operates in a Hybrid Workforce Strategy. Unless specified as primarily virtual by the hiring manager, associates are required to work at an Elevance Health location at least once per week, and potentially several times per week. Specific requirements and expectations for time onsite will be discussed as part of the hiring process.

We require all new candidates in certain patient/member-facing roles to become vaccinated against COVID-19 and Influenza. If you are not vaccinated, your offer will be rescinded unless you provide an acceptable explanation. Elevance Health will also follow all relevant federal, state and local laws.

Elevance Health is an Equal Employment Opportunity employer, and all qualified applicants will receive consideration for employment without regard to age, citizenship status, color, creed, disability, ethnicity, genetic information, gender (including gender identity and gender expression), marital status, national origin, race, religion, sex, sexual orientation, veteran status or any other status or condition protected by applicable federal, state, or local laws.

Applicants who require accommodation to participate in the job application process should submit the following form: Accessibility Accommodation Request Form and a member of the team will be in contact.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws, including, but not limited to, the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act.

Prospective employees required to be screened under Florida law should review the education and awareness resources at HB531 | Florida Agency for Health Care Administration.

Elevance Health is an Equal Opportunity Employer/Disability/Veterans.

#J-18808-Ljbffr

What Elevance Health employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Elevance Health logo

About Elevance Health

Sourced by ZipRecruiter

Elevance Health is a health company dedicated to improving lives and communities - and making healthcare simpler. A Fortune 20 company with a longstanding history in the healthcare industry, we are looking for leaders at all levels of the organization who are passionate about making an impact on our members and the communities we serve. You will thrive in a complex and collaborative environment where you take action and ownership to solve problems and lead change. Do you want to be part of a larger purpose and an evolving, high-performance culture that empowers you to make an impact?

Industry

Health care and social assistance

Company size

10,000+ Employees

Headquarters location

Indianapolis, IN, US

Year founded

2004

Social media