... and LLM based solutions. This role focuses on prompt engineering, model integration, AI workflow ... evaluation, feature engineering, experimentation). • Full stack exposure with Angular, HTML, CSS ...
... and LLM based solutions. This role focuses on prompt engineering, model integration, AI workflow ... evaluation, feature engineering, experimentation). • Full stack exposure with Angular, HTML, CSS ...
Prompt Engineer
Milton, GA · On-site
Alpharetta F2F is a must Prompt Engineer / AI Specialist / Tech Analyst - LLM & AI Platforms (8-10 ... evaluation, feature engineering, experimentation). • Full stack exposure with Angular, HTML, CSS ...
New
Prompt Engineer
Milton, GA · On-site
Alpharetta F2F is a must Prompt Engineer / AI Specialist / Tech Analyst - LLM & AI Platforms (8-10 ... evaluation, feature engineering, experimentation). • Full stack exposure with Angular, HTML, CSS ...
New
LLM Engineer (GCP Preferred)
Atlanta, GA · Hybrid
$58 - $60/hr
LLM Engineer (GCP Preferred) Work Time Zone: EST Rate: $60/hour on 1099/C2C Location: Atlanta, GA ... evaluation, and inference using GCP services and open-source tools. * Prompt Engineering & RAG ...
Quick apply
LLM Engineer (GCP Preferred)
Atlanta, GA · Hybrid
$58 - $60/hr
LLM Engineer (GCP Preferred) Work Time Zone: EST Rate: $60/hour on 1099/C2C Location: Atlanta, GA ... evaluation, and inference using GCP services and open-source tools. * Prompt Engineering & RAG ...
You will design and build LLM-powered applications on enterprise data: document ingestion and ... Strong knowledge of embeddings, prompt engineering, chunking strategies, and model evaluation ...
You will design and build LLM-powered applications on enterprise data: document ingestion and ... Strong knowledge of embeddings, prompt engineering, chunking strategies, and model evaluation ...
... Establish evaluation, reliability, and performance strategies (accuracy, latency, cost ... including prompt engineering and orchestration • Proven experience with RAG architectures ...
... Establish evaluation, reliability, and performance strategies (accuracy, latency, cost ... including prompt engineering and orchestration • Proven experience with RAG architectures ...
Lead GenAI Engineer (LLM)
Dunwoody, GA · Hybrid
$101K - $133K/yr
Familiarity with prompt engineering, model evaluation, and AI safety/guardrails * Experience ... Hands-on experience building LLM-powered applications, RAG pipelines, or agentic systems * Strong ...
Lead GenAI Engineer (LLM)
Dunwoody, GA · Hybrid
$101K - $133K/yr
Familiarity with prompt engineering, model evaluation, and AI safety/guardrails * Experience ... Hands-on experience building LLM-powered applications, RAG pipelines, or agentic systems * Strong ...
Strong understanding of prompt engineering, context engineering, embeddings, and model evaluation ... Agentic AI,LangGraph,LangChain,Python,RAG,Multi-Agent Systems,LLM Integration,Vector Databases ...
Strong understanding of prompt engineering, context engineering, embeddings, and model evaluation ... Agentic AI,LangGraph,LangChain,Python,RAG,Multi-Agent Systems,LLM Integration,Vector Databases ...
AI Engineer
Atlanta, GA · On-site +1
... evaluation -- running prompt injection and adversarial tests as part of ongoing eval work ... LLM-powered systems -- RAG pipelines, agent workflows, or fine-tuning -- in a production or ...
AI Engineer
Atlanta, GA · On-site +1
... evaluation -- running prompt injection and adversarial tests as part of ongoing eval work ... LLM-powered systems -- RAG pipelines, agent workflows, or fine-tuning -- in a production or ...
AI Engineer
Atlanta, GA · On-site
$69K - $89K/yr
Prompt engineering and prompt optimization * LLM testing and AI quality assurance * RAG, vector databases, semantic search, and embeddings * AI evaluation and observability * Python and SQL * REST ...
AI Engineer
Atlanta, GA · On-site
$69K - $89K/yr
Prompt engineering and prompt optimization * LLM testing and AI quality assurance * RAG, vector databases, semantic search, and embeddings * AI evaluation and observability * Python and SQL * REST ...
Data Scientist
Atlanta, GA · On-site
Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...
Quick apply
Data Scientist
Atlanta, GA · On-site
Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...
Data Scientist
Atlanta, GA · On-site
$110 - $170/hr
Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...
Data Scientist
Atlanta, GA · On-site
$110 - $170/hr
Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns. * Solid grasp of classical ...
AI Engineer (LLMs + C#)
Alpharetta, GA · On-site
... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation
AI Engineer (LLMs + C#)
Alpharetta, GA · On-site
... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation
AI Engineer (LLMs + C#)
Alpharetta, GA · On-site
... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation
AI Engineer (LLMs + C#)
Alpharetta, GA · On-site
... of LLM concepts such as: * Prompt engineering * Tokens and context windows * Embeddings * Vector search * RAG * Fine-tuning concepts * Function/tool calling * AI agents * Model evaluation
... evaluation. * Manage context windows and model inputs: decide what information a model actually ... Prompt-engineer and evaluate LLM workflows, treating prompts and retrieval as things you measure ...
... evaluation. * Manage context windows and model inputs: decide what information a model actually ... Prompt-engineer and evaluate LLM workflows, treating prompts and retrieval as things you measure ...
AI Engineer Consultant
Atlanta, GA · On-site
... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...
AI Engineer Consultant
Atlanta, GA · On-site
... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...
Machine Learning Engineer
Atlanta, GA · On-site
$120 - $165/hr
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
Machine Learning Engineer
Atlanta, GA · On-site
$120 - $165/hr
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions ... Participate in design reviews, architecture discussions, and model evaluations. * Document ...
AI Engineer Consultant
Atlanta, GA · Hybrid
... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...
AI Engineer Consultant
Atlanta, GA · Hybrid
... prompt/context patterns. * Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry. * Deliver governed ...
Generative AI & LLM Applications * Design and implement Generative AI solutions leveraging large ... Develop and optimize prompt engineering strategies, evaluation frameworks, and guardrails to ensure ...
Generative AI & LLM Applications * Design and implement Generative AI solutions leveraging large ... Develop and optimize prompt engineering strategies, evaluation frameworks, and guardrails to ensure ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Own the full lifecycle: prototyping evaluation production deployment iteration * Ensure solutions ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Own the full lifecycle: prototyping evaluation production deployment iteration * Ensure solutions ... Strong understanding of LLM capabilities and limitations * Experience with prompt engineering and ...
Generative AI & LLM Applications * Design and implement Generative AI solutions leveraging large ... Develop and optimize prompt engineering strategies, evaluation frameworks, and guardrails to ensure ...
Generative AI & LLM Applications * Design and implement Generative AI solutions leveraging large ... Develop and optimize prompt engineering strategies, evaluation frameworks, and guardrails to ensure ...
Llm Prompt Evaluation information
See Decatur, GA salary details
$7.28 - $10.28
18% of jobs
$10.28 - $13.29
2% of jobs
$13.75 is the 25th percentile. Wages below this are outliers.
$13.29 - $16.30
30% of jobs
$16.30 - $19.31
15% of jobs
$19.31 - $22.32
9% of jobs
$22.77 is the 75th percentile. Wages above this are outliers.
$22.32 - $25.33
5% of jobs
$25.33 - $28.33
3% of jobs
$28.33 - $31.34
5% of jobs
$31.34 - $34.35
4% of jobs
$34.35 - $37.36
4% of jobs
$37.36 - $40.37
3% of jobs
$7
$20
$40
How much do llm prompt evaluation jobs pay per hour?
What is an LLM prompt evaluation?
An LLM Prompt Evaluation job involves assessing and optimizing prompts used in large language models (LLMs) to ensure they generate accurate, relevant, and high-quality responses. Evaluators test different prompts, analyze model outputs, and refine phrasing to improve performance. This role requires a strong understanding of AI behavior, critical thinking, and sometimes domain-specific expertise to create effective instructions for the model.
What does an LLM prompt evaluation do?
Professionals in LLM Prompt Evaluation spend their days reviewing, analyzing, and scoring the outputs of large language models based on specific prompts. This involves identifying inaccuracies, biases, or other issues in AI-generated responses, and providing detailed, constructive feedback that informs further model development. Collaboration with data scientists, machine learning engineers, and product teams is common to align evaluation efforts with organizational goals. The role also includes documenting findings, participating in regular team meetings, and staying updated on best practices in prompt design and AI ethics.
What are the key skills and qualifications needed to thrive in the LLM prompt evaluation position?
To thrive in LLM Prompt Evaluation, you need a solid understanding of natural language processing, critical thinking, and analytical skills, often supported by a background in linguistics, computer science, or related disciplines. Familiarity with annotation tools, large language model (LLM) platforms, and prompt engineering frameworks is important. Attention to detail, strong written communication, and the ability to provide objective, structured feedback are key soft skills. These qualifications ensure accurate assessments of AI-generated responses and support the continuous improvement of language models.
What are popular job titles related to Llm Prompt Evaluation jobs in Decatur, GA?
For Llm Prompt Evaluation jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Llm Prompt Evaluation jobs in Decatur, GA look for?
The top searched job categories for Llm Prompt Evaluation jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Llm Prompt Evaluation jobs?
Cities near Decatur, GA with the most Llm Prompt Evaluation job openings:
Prompt Engineer / AI Specialist / Tech Analyst - LLM & AI Platforms
Alpharetta, GA • On-site
Full-time
Re-posted 2 days ago
Job description
Georgia IT, Inc. is seeking a Senior Prompt Engineer / AI Specialist / Technical Analyst to support enterprise scale Generative AI and LLM based solutions. This role focuses on prompt engineering, model integration, AI workflow design, and full stack enablement across multiple AI models and platforms.
Responsibilities:
• Support enterprise scale Generative AI and LLM based solutions, including Service Assist AI and Agent Desktop aligned initiatives.
• Focus on prompt engineering, model integration, AI workflow design, and full stack enablement.
• Work across multiple AI models and platforms including OpenAI and other enterprise LLM providers.
Qualifications:
Required:
• 15 years of experience across AI, data science, machine learning, or full stack engineering roles.
• Strong hands on experience with LLMs and prompt engineering.
• Experience integrating OpenAI and other AI/LLM platforms via APIs.
• Strong proficiency in Python for AI workflows, services, and data processing.
• Solid understanding of data science and ML fundamentals (model evaluation, feature engineering, experimentation).
• Full stack exposure with Angular, HTML, CSS, and TypeScript.
• Core Banking or Financial/Wealth management domain working experience required
Company:
Georgia IT, Inc. provides IT Consulting for a wide range of IT services and custom build turn-key enterprise solutions. Founded in 2007, the company is headquartered in Alpharetta, USA, with a team of 51-200 employees. The company is currently Growth Stage.
About Georgia IT
Sourced by ZipRecruiter
A PROFESSIONAL SERVICES ORGANIZATION WITH A VISION OF DELIVERING SIMPLE AFFORDABLE, SUSTAINABLE SOLUTIONS FOR COMPLEX PROBLEMS WITH INTEGRITY. OUR GOAL IS TO ACHIEVE ALL THIS IN A COLLABRATIVE APPROACH WITH ALL PARTIES INVOLVED IN DELIVERING SOLUTIONS/PRODUCTS.
Industry
It services
Company size
51 - 200 Employees
Headquarters location
Alpharetta, GA, US
Year founded
2007