ZipRecruiter

Log In

1

Llm Analyst Jobs (NOW HIRING)

Lemora Global

AI Quality Analyst

Palo Alto, CA · Remote

$30/hr

LLM - AI Quality Analyst (Personalization) - English Location: Remote (USA Approved States Only) Eligible States: Approved U.S. States only (Excluding Texas and Illinois) Contract: Short-Term (4 ...

WisEngineering

AI Data Analyst (LLM) - US Army Support ID: 92616 Location: Picatinny Arsenal, NJ More about this job > Description WisEngineering, LLC is currently interviewing candidates for an immediate or near ...

PenFed Credit Union

LLM Specialist

Mclean, VA · On-site

$16.50 - $21.75/hr

The LLM Specialist serves as PenFed's subject matter expert for Large Language Models (LLMs ... Analyze and communicate technical tradeoffs among commercial, open source, hosted, and enterprise ...

eSimplicity

LLM Specialist

Columbia, MD · On-site

$104K - $145K/yr

The LLM Specialist will drive the design, development, and operationalization of advanced large-language-model capabilities across a cloud-based analytics ecosystem. This role leads innovation ...

eSimplicity

LLM Specialist

Columbia, MD · On-site

$104K - $145K/yr

The LLM Specialist will drive the design, development, and operationalization of advanced large-language-model capabilities across a cloud-based analytics ecosystem. This role leads innovation ...

eSimplicity

LLM Specialist

Columbia, MD · On-site +1

$104K - $145K/yr

The LLM Specialist will drive the design, development, and operationalization of advanced large-language-model capabilities across a cloud-based analytics ecosystem. This role leads innovation ...

PROLIM Global Corporation

Linguist (LLM)

Deliver analytics, statistics, and model performance results on datasets. Requisition Details ... Create and perfect LLM Quality grading queues and LLM related component quality error attribution ...

Uncountable

LLM Applications Engineer

New York, NY · On-site

$130K - $175K/yr

Build intuitive, AI-driven UI components that allow scientists to query, analyze, and visualize complex experimental datasets. * Integration: Connect LLM capabilities with our core SQL databases and ...

Siemens Healthineers

AI LLM Engineer

Atlanta, GA · On-site +1

AI / LLM Engineering & Agentic Systems * Design, build, and deploy LLM powered applications using ... Work across business, analytics, and engineering teams to identify high impact AI use cases

Bright Vision Technologies

LLM Prompt Specialist

$100K - $150K/yr

LLM Prompt Specialist - Remote Bright Vision Technologies is a technology consulting and software ... Exposure to product domains such as customer support, coding assistants, or analytics agents.

next page

Showing results 1-20

All JobsBusiness JobsMarketing JobsLlm Analyst Jobs

Llm Analyst information

See salary details

$31K

$73.3K

$130K

How much do llm analyst jobs pay per year?

As of Sep 14, 2026, the average yearly pay for llm analyst in the United States is $73,261.00, according to ZipRecruiter salary data. Most workers in this role earn between $52,500.00 and $87,000.00 per year, depending on experience, location, and employer.

What is an LLM analyst?

An LLM Analyst is a professional who specializes in working with large language models (LLMs), such as GPT or similar AI systems. Their role typically involves evaluating, fine-tuning, and analyzing the performance of these models for specific business or research applications. LLM Analysts may also handle tasks like prompt engineering, data annotation, and quality assurance to ensure that the language model meets designated objectives and safety standards. This position requires a strong understanding of machine learning concepts, natural language processing (NLP), and data analysis.

What are the key skills and qualifications needed to thrive as an LLM analyst, and why are they important?

To thrive as an LLM Analyst, you need a solid background in data science, natural language processing (NLP), and machine learning, often supported by a relevant degree in computer science or a related field. Familiarity with tools and frameworks like Python, TensorFlow, PyTorch, and experience using large language models (LLMs) are typically required. Strong analytical thinking, attention to detail, and effective communication skills help in interpreting results and collaborating with cross-functional teams. These skills are crucial for developing, evaluating, and optimizing LLM applications to deliver accurate and impactful AI solutions.

What are some common challenges faced by LLM analysts when working with large language models in a production environment?

LLM Analysts often encounter challenges such as optimizing model performance while balancing computational costs, ensuring data privacy and compliance, and troubleshooting unexpected model outputs. Collaborating closely with data engineers and machine learning researchers is essential to address issues like data pipeline bottlenecks and model drift. Additionally, LLM Analysts must continuously monitor and retrain models to maintain accuracy, which requires strong analytical and problem-solving skills in a fast-paced, collaborative environment.

What is the difference between Llm Analyst vs Data Scientist?

AspectLlm AnalystData Scientist
Required CredentialsBachelor's in Computer Science, Data Science, or related field; knowledge of machine learning and NLPBachelor's or Master's in Data Science, Statistics, or related; strong programming and statistical skills
Work EnvironmentTech companies, AI firms, research labs focusing on language modelsVarious industries including tech, finance, healthcare; data-driven roles
Employer & Industry UsagePrimarily in AI and NLP-focused companiesBroadly across industries with data analysis needs

While both roles involve working with data and machine learning, an Llm Analyst specializes in language models and NLP applications, whereas a Data Scientist has a broader focus on data analysis, modeling, and insights across various domains.

What jobs can I do with a Llm analyst?

A LLM analyst typically works in roles related to analyzing large language models, such as AI research scientist, machine learning engineer, data scientist, or NLP specialist. These positions involve developing, evaluating, and improving language models, often requiring skills in programming, data analysis, and understanding of AI frameworks. Opportunities are available in tech companies, research institutions, and AI-focused organizations.
More about Llm Analyst jobs

What cities are hiring for Llm Analyst jobs?

Cities with the most Llm Analyst job openings:

What states have the most Llm Analyst jobs?

States with the most job openings for Llm Analyst jobs include:

What are popular job titles related to Llm Analyst jobs?

For Llm Analyst jobs, the most frequently searched job titles are:

Llm Analyst jobs near you
Infographic showing various Llm Analyst job openings in the United States as of September 2026, with employment types broken down into 1% Internship, 89% Full Time, 6% Part Time, and 4% Contract. Highlights an 79% Physical, 7% Hybrid, and 14% Remote job distribution, with an average salary of $73,261 per year, or $35.2 per hour.

AI Quality Analyst

Palo Alto, CA • Remote

Lemora Global
See more jobs at Lemora Globalexternal

$30/hr

Full-time

Posted 5 days ago

Job description

LLM - AI Quality Analyst (Personalization) - English

Location: Remote (USA Approved States Only)

Eligible States: Approved U.S. States only (Excluding Texas and Illinois)

Contract: Short-Term (4 Months)

Openings: 350

Start Date: Immediate

Rate: $30/hour USD

Experience: 1+ Year## About Turing

Turing, based in San Francisco, California, is a leading research accelerator for frontier AI labs and a trusted partner for enterprises deploying advanced AI systems.

Turing accelerates AI research through high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents. Turing also helps enterprises transform AI from proof of concept into reliable systems that deliver measurable business impact.

Role Overview

As an AI Quality Analyst, you will evaluate a new personalization feature for Gemini. You will assess how effectively the model uses information from past Gemini conversations, Gmail, Google Search, and YouTube activity to generate relevant and helpful responses.

This role combines creativity and analytical thinking. You will create prompts based on your personal experiences and evaluate responses across:

  • Grounding
  • Integration
  • Helpfulness
Key Qualifications
  • Ability to read and write English with a high degree of comprehension.
  • Willingness to use your primary personal Google account (not a testing account) and enable personal data sources.
  • Full-time availability in your local time zone.
  • Ability to work within a global 24-hour operations team.
  • Exceptional analytical thinking and evaluation skills.
  • Experience designing creative multi-turn prompts based on personal context.
  • Understanding of personalization concepts, including incorrect personalization, poor inferences, and forced connections.
  • Strong attention to detail when reviewing Side-by-Side (SxS) model responses.
  • Excellent written communication skills with the ability to write clear, structured rationales.
  • Ability to provide detailed annotations and constructive feedback.
  • Strong communication and collaboration skills.
  • Self-motivated and able to work independently in a remote environment.
  • Desktop or laptop with a reliable internet connection.
Responsibilities
  • Design and execute multi-turn conversational prompts (typically 1-5 turns) requiring AI to use personal information and experiences.
  • Evaluate personalized model responses against the original prompt intent.
  • Review responses for Grounding issues, flawed inferences, and hallucinations.
  • Assess Integration quality to ensure natural use of personal information without overnarrating.
  • Compare and stack-rank Side-by-Side (SxS) model responses.
  • Write clear, defensible rationales referencing specific conversation turns.
  • Extract and verify Debug Info to confirm the proper use of chat summaries and data sources.
  • Maintain strict data hygiene by deleting evaluation conversations to prevent impact on future chat history.
Education & Experience

Required

  • BS/BA degree or equivalent experience in:- Policy
    • Law
    • Ethics
    • Linguistics
    • Journalism
    • Computer Science
    • Related analytical fields

Preferred

  • Experience in:- Data Annotation
    • AI Quality Evaluation
    • Content Moderation
    • Related roles
Availability
  • Minimum 4 hours per day
  • Minimum 30 hours per week
  • 4 hours overlap with PST

Commitment Options:

  • 30 Hours/Week
  • 40 Hours/Week
Vetting Process

All 3 steps are required:

  1. Screener
  2. 1 of 3 Assessments (Mandatory)
  3. Language Vetting
Evaluation Process
  1. Shortlisted candidates receive a Job Interest Form.
  2. After profile review, an assessment will be shared and must be completed within 24 hours.
  3. Successful candidates will be contacted regarding pre-onboarding requirements.

You should be proficient in:

  • AI Content Evaluation
  • AI Evaluator
  • AI Quality Analyst
  • AI Quality Evaluation
  • Analytical Thinking
  • Annotations
  • Content Moderation
  • Data Annotation
  • English Proficiency
  • Gemini
  • Generative AI
  • Grounding
  • Integration
  • Large Language Models
  • LLM Analyst
  • LLM Evaluation
  • Personalization
  • Prompt Design
  • Prompt Engineering
  • Quality Assurance
  • Remote Contractor
  • Response Ranking
  • Side-by-Side Evaluation
  • SxS Review
  • Google Account
ID:qnkTyx