1

Llm Prompt Evaluation Jobs in Decatur, GA (NOW HIRING)

Alpharetta F2F is a must Prompt Engineer / AI Specialist / Tech Analyst - LLM & AI Platforms (8-10 ... evaluation, feature engineering, experimentation). • Full stack exposure with Angular, HTML, CSS ...

New

Lead GenAI Engineer (LLM)

Dunwoody, GA · Hybrid

$101K - $133K/yr

Familiarity with prompt engineering, model evaluation, and AI safety/guardrails * Experience ... Hands-on experience building LLM-powered applications, RAG pipelines, or agentic systems * Strong ...

... evaluation -- running prompt injection and adversarial tests as part of ongoing eval work ... LLM-powered systems -- RAG pipelines, agent workflows, or fine-tuning -- in a production or ...

AI Engineer

Atlanta, GA · On-site

$69K - $89K/yr

Prompt engineering and prompt optimization * LLM testing and AI quality assurance * RAG, vector databases, semantic search, and embeddings * AI evaluation and observability * Python and SQL * REST ...

Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...

Data Scientist

Atlanta, GA · On-site

$110 - $170/hr

Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...

... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation

... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation

... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...

Machine Learning Engineer

Atlanta, GA · On-site

$120 - $165/hr

Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...

... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...

Senior AI Engineer

Atlanta, GA · On-site

$100K - $138K/yr

Own the full lifecycle: prototyping evaluation production deployment iteration * Ensure solutions ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...

next page

Showing results 1-20

Llm Prompt Evaluation information

See Decatur, GA salary details

$7

$20

$40

How much do llm prompt evaluation jobs pay per hour?

As of Aug 17, 2026, the average hourly pay for llm prompt evaluation in Decatur, GA is $20.39, according to ZipRecruiter salary data. Most workers in this role earn between $14.09 and $26.97 per hour, depending on experience, location, and employer.

What is an LLM prompt evaluation?

An LLM Prompt Evaluation job involves assessing and optimizing prompts used in large language models (LLMs) to ensure they generate accurate, relevant, and high-quality responses. Evaluators test different prompts, analyze model outputs, and refine phrasing to improve performance. This role requires a strong understanding of AI behavior, critical thinking, and sometimes domain-specific expertise to create effective instructions for the model.

What does an LLM prompt evaluation do?

Professionals in LLM Prompt Evaluation spend their days reviewing, analyzing, and scoring the outputs of large language models based on specific prompts. This involves identifying inaccuracies, biases, or other issues in AI-generated responses, and providing detailed, constructive feedback that informs further model development. Collaboration with data scientists, machine learning engineers, and product teams is common to align evaluation efforts with organizational goals. The role also includes documenting findings, participating in regular team meetings, and staying updated on best practices in prompt design and AI ethics.

What are the key skills and qualifications needed to thrive in the LLM prompt evaluation position?

To thrive in LLM Prompt Evaluation, you need a solid understanding of natural language processing, critical thinking, and analytical skills, often supported by a background in linguistics, computer science, or related disciplines. Familiarity with annotation tools, large language model (LLM) platforms, and prompt engineering frameworks is important. Attention to detail, strong written communication, and the ability to provide objective, structured feedback are key soft skills. These qualifications ensure accurate assessments of AI-generated responses and support the continuous improvement of language models.

What are popular job titles related to Llm Prompt Evaluation jobs in Decatur, GA?

For Llm Prompt Evaluation jobs in Decatur, GA, the most frequently searched job titles are:

What job categories do people searching Llm Prompt Evaluation jobs in Decatur, GA look for?

The top searched job categories for Llm Prompt Evaluation jobs in Decatur, GA are:

What cities near Decatur, GA are hiring for Llm Prompt Evaluation jobs?

Cities near Decatur, GA with the most Llm Prompt Evaluation job openings:

Prompt Engineer / AI Specialist / Tech Analyst - LLM & AI Platforms

Georgia IT, Inc.

Alpharetta, GA • On-site

Full-time

Re-posted 2 days ago


Job description

Job Summary:
Georgia IT, Inc. is seeking a Senior Prompt Engineer / AI Specialist / Technical Analyst to support enterprise scale Generative AI and LLM based solutions. This role focuses on prompt engineering, model integration, AI workflow design, and full stack enablement across multiple AI models and platforms.
Responsibilities:
• Support enterprise scale Generative AI and LLM based solutions, including Service Assist AI and Agent Desktop aligned initiatives.
• Focus on prompt engineering, model integration, AI workflow design, and full stack enablement.
• Work across multiple AI models and platforms including OpenAI and other enterprise LLM providers.
Qualifications:
Required:
• 15 years of experience across AI, data science, machine learning, or full stack engineering roles.
• Strong hands on experience with LLMs and prompt engineering.
• Experience integrating OpenAI and other AI/LLM platforms via APIs.
• Strong proficiency in Python for AI workflows, services, and data processing.
• Solid understanding of data science and ML fundamentals (model evaluation, feature engineering, experimentation).
• Full stack exposure with Angular, HTML, CSS, and TypeScript.
• Core Banking or Financial/Wealth management domain working experience required
Company:
Georgia IT, Inc. provides IT Consulting for a wide range of IT services and custom build turn-key enterprise solutions. Founded in 2007, the company is headquartered in Alpharetta, USA, with a team of 51-200 employees. The company is currently Growth Stage.

Georgia IT logo

About Georgia IT

Sourced by ZipRecruiter

A PROFESSIONAL SERVICES ORGANIZATION WITH A VISION OF DELIVERING SIMPLE AFFORDABLE, SUSTAINABLE SOLUTIONS FOR COMPLEX PROBLEMS WITH INTEGRITY. OUR GOAL IS TO ACHIEVE ALL THIS IN A COLLABRATIVE APPROACH WITH ALL PARTIES INVOLVED IN DELIVERING SOLUTIONS/PRODUCTS.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Alpharetta, GA, US

Year founded

2007

Social media