ZipRecruiter

Log In

1

Llm Analyst Jobs (NOW HIRING)

Yakamconsulting

As a Senior NLP and LLM Data Scientist, you will be a key player in designing, implementing, and optimizing solutions that analyze and understand human language at scale. Your work will involve ...

Braintrust

Director, Product Engineering

San Francisco, CA · On-site

$274K - $287K/yr

From prompt experimentation and versioning to multiplayer review and large-scale LLM analysis, you'll lead the engineering behind some of our hardest product problems. Ideal candidate credentials * A ...

Diablo Convoy

LLM Engineer

Houston, TX · On-site

$120K - $130K/yr

We are seeking a detail-oriented LLM Automation Engineer to support AI-driven data analysis, document processing, automation workflows, and reporting initiatives. This role focuses on using ...

Agoda

Technical Product Manager, LLM/ML Domain

Seattle, WA · On-site

$190K - $219K/yr

... post-launch analysis • Partner closely with engineering to balance platform scalability ... LLM systems • Drive adoption through documentation, training, and internal evangelism • ...

Noblis

Army VANTAGE LLM Engineer

Bismarck, ND · On-site

$115K - $180K/yr

LLM integration/fine-tuning (GPT, LLaMA, Mistral); prompt engineering; RAG architecture; Python ML ... Support the migration and enhancement of an existing, proven analytics application from a ...

New

Agoda

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

... post-launch analysis • Partner closely with engineering to balance platform scalability ... LLM systems • Drive adoption through documentation, training, and internal evangelism • ...

Agoda

Technical Product Manager, LLM/ML Domain

Manhattan, NY · On-site

$183K - $212K/yr

... post-launch analysis • Partner closely with engineering to balance platform scalability ... LLM systems • Drive adoption through documentation, training, and internal evangelism • ...

Polar IT Services

Data Analyst

Charlotte, NC · On-site +1

Data Analyst Location: Charlotte, NC Mode Of Work: Hybrid It's a W2 role * Develop analytics ... Use LLM's to build AI products * Address user queries on data pulls or report generation * Write ...

previous pagenext page

Showing results 21-40

All JobsBusiness JobsMarketing JobsLlm Analyst Jobs

Llm Analyst information

See salary details

$31K

$73.3K

$130K

How much do llm analyst jobs pay per year?

As of Sep 14, 2026, the average yearly pay for llm analyst in the United States is $73,261.00, according to ZipRecruiter salary data. Most workers in this role earn between $52,500.00 and $87,000.00 per year, depending on experience, location, and employer.

What is an LLM analyst?

An LLM Analyst is a professional who specializes in working with large language models (LLMs), such as GPT or similar AI systems. Their role typically involves evaluating, fine-tuning, and analyzing the performance of these models for specific business or research applications. LLM Analysts may also handle tasks like prompt engineering, data annotation, and quality assurance to ensure that the language model meets designated objectives and safety standards. This position requires a strong understanding of machine learning concepts, natural language processing (NLP), and data analysis.

What are the key skills and qualifications needed to thrive as an LLM analyst, and why are they important?

To thrive as an LLM Analyst, you need a solid background in data science, natural language processing (NLP), and machine learning, often supported by a relevant degree in computer science or a related field. Familiarity with tools and frameworks like Python, TensorFlow, PyTorch, and experience using large language models (LLMs) are typically required. Strong analytical thinking, attention to detail, and effective communication skills help in interpreting results and collaborating with cross-functional teams. These skills are crucial for developing, evaluating, and optimizing LLM applications to deliver accurate and impactful AI solutions.

What are some common challenges faced by LLM analysts when working with large language models in a production environment?

LLM Analysts often encounter challenges such as optimizing model performance while balancing computational costs, ensuring data privacy and compliance, and troubleshooting unexpected model outputs. Collaborating closely with data engineers and machine learning researchers is essential to address issues like data pipeline bottlenecks and model drift. Additionally, LLM Analysts must continuously monitor and retrain models to maintain accuracy, which requires strong analytical and problem-solving skills in a fast-paced, collaborative environment.

What is the difference between Llm Analyst vs Data Scientist?

AspectLlm AnalystData Scientist
Required CredentialsBachelor's in Computer Science, Data Science, or related field; knowledge of machine learning and NLPBachelor's or Master's in Data Science, Statistics, or related; strong programming and statistical skills
Work EnvironmentTech companies, AI firms, research labs focusing on language modelsVarious industries including tech, finance, healthcare; data-driven roles
Employer & Industry UsagePrimarily in AI and NLP-focused companiesBroadly across industries with data analysis needs

While both roles involve working with data and machine learning, an Llm Analyst specializes in language models and NLP applications, whereas a Data Scientist has a broader focus on data analysis, modeling, and insights across various domains.

What jobs can I do with a Llm analyst?

A LLM analyst typically works in roles related to analyzing large language models, such as AI research scientist, machine learning engineer, data scientist, or NLP specialist. These positions involve developing, evaluating, and improving language models, often requiring skills in programming, data analysis, and understanding of AI frameworks. Opportunities are available in tech companies, research institutions, and AI-focused organizations.
More about Llm Analyst jobs

What cities are hiring for Llm Analyst jobs?

Cities with the most Llm Analyst job openings:

What states have the most Llm Analyst jobs?

States with the most job openings for Llm Analyst jobs include:

What are popular job titles related to Llm Analyst jobs?

For Llm Analyst jobs, the most frequently searched job titles are:

Llm Analyst jobs near you
Infographic showing various Llm Analyst job openings in the United States as of September 2026, with employment types broken down into 1% Internship, 89% Full Time, 6% Part Time, and 4% Contract. Highlights an 79% Physical, 7% Hybrid, and 14% Remote job distribution, with an average salary of $73,261 per year, or $35.2 per hour.

ML Engineer - LLM Evaluation & Automation

Remote

Grid Dynamics Holdings
IT Services • 1 - 5K employees
Learn more about Grid Dynamics Holdingsexternal

Full-time

Medical, Dental, Vision

Re-posted 7 days ago

Job description

We are seeking a highly skilled Machine Learning Engineer who specializes in leveraging Large Language Models (LLMs) for automated evaluation and quality assessment. In this role, you will design and build systems that automatically measure and improve the accuracy, relevance, and consistency of model outputs. You will lead initiatives to create evaluation pipelines, develop metrics, and deliver actionable insights for continuous improvements. This position requires strong technical expertise, analytical problem-solving abilities, and the capacity to manage projects across multiple cross-functional teams.
Essential functions
  • Design and implement automated systems and pipelines for evaluating LLM outputs.
  • Develop metrics and KPIs to measure output quality, accuracy, and consistency using LLM-based evaluations
  • Collaborate with Engineering teams to create automated logic checks and validation tools.
  • Partner with Data Scientists to analyze evaluation results and optimize prompt and task structures.
  • Provide feedback loops to ensure evaluation guidelines align with LLM-based assessments.
  • Investigate how LLM-derived evaluations can enhance product reliability and user experience.
  • Recommend refinements to prompt engineering, evaluation strategies, and automation tools.
  • Stay informed on emerging trends in LLM evaluation, automated quality assessment, and AI toolchains.
  • Continuously improve and expand automated evaluation processes based on industry best practices.

Qualifications
  • 5+ years of experience in ML engineering, NLP, or AI/ML automation.
  • Hands-on experience in prompt engineering and designing LLM-based evaluation systems is preferred
  • Strong understanding of machine learning principles with focus on NLP and advanced LLM capabilities (e.g., Chain-of-Thought, agentic workflows)
  • Expertise in building automated evaluation or QA pipelines.
  • Excellent analytical and problem-solving skills with experience in root cause and error pattern analysis.
  • Proven project management and cross-functional collaboration experience.
  • Excellent communication skills to convey complex insights to technical and non-technical audiences.
  • Detail-oriented mindset with a focus on evaluation metrics, prompt design, and automation.
  • Ability to quickly adapt to new business rules and evaluation guidelines across diverse product domains.
  • Strong programming skills in Python and SQL.
  • Experience with big data technologies like PySpark for data aggregation and sampling is a strong plus
  • Bachelor's/Master's degree in Computer Science/ Engineering or a related field.

We offer
  • Opportunity to work on cutting-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, vision, dental, etc.
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI , supported by profound expertise and ongoing investment in data , analytics , cloud & DevOps , application modernization and customer experience . Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Apply