... Prompt Engineer AI Specialist Technical Analyst to support enterprise scale Generative AI and LLM ... Solid understanding of data science and ML fundamentals model evaluation feature engineering ...
Quick apply
... Prompt Engineer AI Specialist Technical Analyst to support enterprise scale Generative AI and LLM ... Solid understanding of data science and ML fundamentals model evaluation feature engineering ...
Work with OpenAI SDK and other LLM providers (Anthropic, Azure OpenAI, Cohere, etc.). * Manage prompt engineering, prompt routing, safety guardrails, and evaluation metrics. Data & Vector Search ...
Quick apply
Work with OpenAI SDK and other LLM providers (Anthropic, Azure OpenAI, Cohere, etc.). * Manage prompt engineering, prompt routing, safety guardrails, and evaluation metrics. Data & Vector Search ...
Senior Agentic (AI) Engineer
Atlanta, GA · On-site +1
$100K - $138K/yr
Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes ... Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
Senior Agentic (AI) Engineer
Atlanta, GA · On-site +1
$100K - $138K/yr
Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes ... Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
Senior Agentic (AI) Engineer
Atlanta, GA · Remote
$107K - $146K/yr
Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes ... Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
Quick apply
Senior Agentic (AI) Engineer
Atlanta, GA · Remote
$107K - $146K/yr
Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes ... Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
Machine Learning Engineer
Atlanta, GA · On-site
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Machine Learning Engineer
Atlanta, GA · On-site
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Responsibilities : • Architect and deliver end-to-end LLM-powered applications and agentic ... Establish evaluation, reliability, and performance strategies (accuracy, latency, cost ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Responsibilities : • Architect and deliver end-to-end LLM-powered applications and agentic ... Establish evaluation, reliability, and performance strategies (accuracy, latency, cost ...
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Quick apply
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Founding AI Agent Engineer
Atlanta, GA · On-site
... LLM-powered applications or agentic product workflows • Strong understanding of prompt design, tool use, retrieval, orchestration, and evaluation techniques • Ability to move quickly from ...
Founding AI Agent Engineer
Atlanta, GA · On-site
... LLM-powered applications or agentic product workflows • Strong understanding of prompt design, tool use, retrieval, orchestration, and evaluation techniques • Ability to move quickly from ...
Machine Learning Engineer
Atlanta, GA · On-site
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Machine Learning Engineer
Atlanta, GA · On-site
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Senior AI Engineer
Atlanta, GA · On-site
$120 - $160/hr
Own the full lifecycle: prototyping → evaluation → production deployment → iteration * Ensure ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
Senior AI Engineer
Atlanta, GA · On-site
$120 - $160/hr
Own the full lifecycle: prototyping → evaluation → production deployment → iteration * Ensure ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Own the full lifecycle: prototyping → evaluation → production deployment → iteration * Ensure ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Own the full lifecycle: prototyping → evaluation → production deployment → iteration * Ensure ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
... LLM-as-judge, regression suites) using AgentCore Evaluations, and wire them into CI * Implement guardrails around tool execution: auth scoping, input/output validation, PII and prompt-injection ...
... LLM-as-judge, regression suites) using AgentCore Evaluations, and wire them into CI * Implement guardrails around tool execution: auth scoping, input/output validation, PII and prompt-injection ...
Palantir GenAI Engineer (Insurance / Financial Services) !!! Jersey City, NJ & Atlanta, GA (Onsite)
Atlanta, GA · On-site
Palantir Foundry (data, ontology, pipelines, apps) Palantir AIP (LLM agents, Logic, RAG/OAG ... prompt design, orchestration, grounding). Solid understanding of AI/ML fundamentals (evaluation ...
New
Palantir GenAI Engineer (Insurance / Financial Services) !!! Jersey City, NJ & Atlanta, GA (Onsite)
Atlanta, GA · On-site
Palantir Foundry (data, ontology, pipelines, apps) Palantir AIP (LLM agents, Logic, RAG/OAG ... prompt design, orchestration, grounding). Solid understanding of AI/ML fundamentals (evaluation ...
New
LLM-driven content generation in consumer experiences, including prompt engineering, evaluation harnesses, and guardrails * Reduction-to-practice work with research scientists * Labs-to-flagship ...
LLM-driven content generation in consumer experiences, including prompt engineering, evaluation harnesses, and guardrails * Reduction-to-practice work with research scientists * Labs-to-flagship ...
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · On-site
$61 - $83.75/hr
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · On-site
$61 - $83.75/hr
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
LLM-driven content generation in consumer experiences, including prompt engineering, evaluation harnesses, and guardrails * Reduction-to-practice work with research scientists * Labs-to-flagship ...
LLM-driven content generation in consumer experiences, including prompt engineering, evaluation harnesses, and guardrails * Reduction-to-practice work with research scientists * Labs-to-flagship ...
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · Remote
$65 - $89/hr
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
Quick apply
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · Remote
$65 - $89/hr
Experience with LLM application development, embeddings, model evaluation, prompt optimization, and production AI/ML implementation patterns. * Strong understanding of Google Cloud AI and data ...
Senior Backend Engineer (AI Agent)
Atlanta, GA · On-site +1
$116K - $195K/yr
Experience with LLM evaluation: building datasets, defining scorers/metrics, and using eval results to drive iteration * Strong understanding of prompt engineering, tool/function calling, and agent ...
Senior Backend Engineer (AI Agent)
Atlanta, GA · On-site +1
$116K - $195K/yr
Experience with LLM evaluation: building datasets, defining scorers/metrics, and using eval results to drive iteration * Strong understanding of prompt engineering, tool/function calling, and agent ...
Sr. QA Test Engineer
Alpharetta, GA · On-site
$40.25 - $55/hr
Title: QA Test Engineer Location: Alpharetta, GA Duration: 7 months Position type: W2 contract. Face to Face interview is needed for this position. PS:
Quick apply
Sr. QA Test Engineer
Alpharetta, GA · On-site
$40.25 - $55/hr
Title: QA Test Engineer Location: Alpharetta, GA Duration: 7 months Position type: W2 contract. Face to Face interview is needed for this position. PS:
Llm Prompt Evaluation information
See Decatur, GA salary details
$7.28 - $10.28
18% of jobs
$10.28 - $13.29
2% of jobs
$13.75 is the 25th percentile. Wages below this are outliers.
$13.29 - $16.30
30% of jobs
$16.30 - $19.31
15% of jobs
$19.31 - $22.32
9% of jobs
$22.77 is the 75th percentile. Wages above this are outliers.
$22.32 - $25.33
5% of jobs
$25.33 - $28.33
3% of jobs
$28.33 - $31.34
5% of jobs
$31.34 - $34.35
4% of jobs
$34.35 - $37.36
4% of jobs
$37.36 - $40.37
3% of jobs
$7
$20
$40
How much do llm prompt evaluation jobs pay per hour?
As of Aug 17, 2026, the average hourly pay for llm prompt evaluation in Decatur, GA is $20.39, according to ZipRecruiter salary data. Most workers in this role earn between $14.09 and $26.97 per hour, depending on experience, location, and employer.
What is an LLM prompt evaluation?
An LLM Prompt Evaluation job involves assessing and optimizing prompts used in large language models (LLMs) to ensure they generate accurate, relevant, and high-quality responses. Evaluators test different prompts, analyze model outputs, and refine phrasing to improve performance. This role requires a strong understanding of AI behavior, critical thinking, and sometimes domain-specific expertise to create effective instructions for the model.
What does an LLM prompt evaluation do?
Professionals in LLM Prompt Evaluation spend their days reviewing, analyzing, and scoring the outputs of large language models based on specific prompts. This involves identifying inaccuracies, biases, or other issues in AI-generated responses, and providing detailed, constructive feedback that informs further model development. Collaboration with data scientists, machine learning engineers, and product teams is common to align evaluation efforts with organizational goals. The role also includes documenting findings, participating in regular team meetings, and staying updated on best practices in prompt design and AI ethics.
What are the key skills and qualifications needed to thrive in the LLM prompt evaluation position?
To thrive in LLM Prompt Evaluation, you need a solid understanding of natural language processing, critical thinking, and analytical skills, often supported by a background in linguistics, computer science, or related disciplines. Familiarity with annotation tools, large language model (LLM) platforms, and prompt engineering frameworks is important. Attention to detail, strong written communication, and the ability to provide objective, structured feedback are key soft skills. These qualifications ensure accurate assessments of AI-generated responses and support the continuous improvement of language models.
What are popular job titles related to Llm Prompt Evaluation jobs in Decatur, GA?
For Llm Prompt Evaluation jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Llm Prompt Evaluation jobs in Decatur, GA look for?
The top searched job categories for Llm Prompt Evaluation jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Llm Prompt Evaluation jobs?
Cities near Decatur, GA with the most Llm Prompt Evaluation job openings:
Job description
Job Description:
- We are seeking a Senior Prompt Engineer AI Specialist Technical Analyst to support enterprise scale Generative AI and LLM based solutions including Service Assist AI and Agent Desktop aligned initiatives.
- This role focuses on prompt engineering model integration AI workflow design and full stack enablement working across multiple AI models and platforms including OpenAI and other enterprise LLM providers.
- The ideal candidate must have data science and machine learning foundations with strong Python and full stack engineering skills with Angular and can translate business problems into effective secure and scalable AI powered solutions.
- 8 to 10 years of experience across AI data science machine learning or full stack engineering roles.
- Strong hands on experience with LLMs and prompt engineering.
- Experience integrating OpenAI and other AILLM platforms via APIs.
- Strong proficiency in Python for AI workflows services and data processing.
- Solid understanding of data science and ML fundamentals model evaluation feature engineering experimentation.
- Full stack exposure with Angular HTML CSS and TypeScript.
- Core Banking or FinancialWealth management domain working experience required.
- Experience with Service Assist AI conversational AI or agent assist platforms.
- Exposure to embeddings vector databases or RAG architectures.
- Familiarity with AI governance responsible AI frameworks and risk controls.
- Cloud or AI platform certifications.
Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading staffing and recruiting powerhouse. Proudly recognized as a nationally and locally certified diversity firm, Cynet delivers agile, scalable talent solutions across industries. With an active footprint in all 50 U.S. states and Canada, we support thousands of consultants through our expansive, high-performing recruitment engine operating across North America and Asia—ensuring speed, quality, and consistency in every hire.
About Cynet Systems
Sourced by ZipRecruiter
Cynet Systems Inc is a staffing and recruiting corporation nestled in Ashburn, VA, USA. Established in 2010, the company operates within the Information Technology and Services sector, specializing in providing effective workforce solutions to different business needs, including IT consulting, direct hire, and contract staffing services. Through the years, Cynet Systems has built an impressive portfolio, going beyond borders and expanding its operations internationally in Canada and India. Rooted in its core values of teamwork, leadership, and commitment, Cynet Systems helps businesses unlock their full potential by providing versatile and competent professionals that perfectly align with their needs. Fueled by their unwavering mission to deliver top-tier talent to businesses worldwide, Cynet Systems garnered various recognitions including SIA's fastest-growing staffing firms and Best Place to Work in Virginia for 2019.
Industry
It services
Company size
501 - 1,000 Employees
Headquarters location
Sterling, VA, US
Year founded
2010