1

Evaluation Engineer Jobs in Georgia (NOW HIRING)

Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore ... Partner with data engineers on Snowflake backed retrieval patterns (Cortex Analyst and Cortex ...

Prepare and execute evaluations of prototype vehicles, components, or systems utilizing existing testing protocols. * Develop evaluations based on understanding, guidance from engineer peers, or ...

... guiding evaluations • Help customers deploy and operate agent-based applications such as ... Required : • 3+ years in a relevant technical role (software engineering, customer engineering ...

... guiding evaluations • Help customers deploy and operate agent-based applications such as ... Required : • 3+ years in a relevant technical role (software engineering, customer engineering ...

Showing results 41-60

Evaluation Engineer information

See Georgia salary details

$46.9K

$108.5K

$140.2K

How much do evaluation engineer jobs pay per year?

As of Sep 2, 2026, the average yearly pay for evaluation engineer in Georgia is $108,461.00, according to ZipRecruiter salary data. Most workers in this role earn between $100,100.00 and $126,700.00 per year, depending on experience, location, and employer.

What is an evaluation engineer?

An Evaluation Engineer is a professional who assesses products, systems, or processes to ensure they meet specified standards and performance criteria. They are responsible for designing and conducting tests, analyzing results, and recommending improvements or changes. Evaluation Engineers work in various industries, including manufacturing, electronics, software, and automotive, to support product development and quality assurance. Their work helps companies deliver reliable and effective products to the market.

What are the key skills and qualifications needed to thrive as an evaluation engineer, and why are they important?

To thrive as an Evaluation Engineer, you need a solid background in engineering principles, analytical problem-solving, and experience with product testing, often supported by a degree in engineering or a related field. Familiarity with testing equipment, data analysis tools (such as MATLAB or LabVIEW), and industry-specific standards or certifications is typically required. Strong attention to detail, effective communication, and collaboration skills help Evaluation Engineers accurately assess products and share findings with cross-functional teams. These skills are crucial for ensuring product quality, safety, and compliance with regulatory and customer requirements.

What are some common challenges faced by evaluation engineers when assessing new products or systems?

Evaluation Engineers often encounter challenges such as tight project deadlines, rapidly evolving technology, and the need to balance thorough testing with efficiency. They may also face difficulties in obtaining comprehensive data or replicating real-world scenarios during evaluations. Collaborating closely with cross-functional teams—like design, manufacturing, and quality assurance—is essential to address these challenges and ensure accurate, actionable results.

What is the difference between Evaluation Engineer vs Test Engineer?

AspectEvaluation EngineerTest Engineer
Required CredentialsBachelor's in Engineering, certifications in testing or evaluation methodsBachelor's in Engineering, certifications in testing or quality assurance
Work EnvironmentResearch labs, product development, quality assessmentManufacturing plants, testing labs, product validation
Industry UsageUsed in electronics, aerospace, automotive for evaluating performanceUsed across industries for testing products and systems

Evaluation Engineers focus on assessing product performance, reliability, and compliance through detailed analysis, often in research or development settings. Test Engineers primarily execute testing procedures to identify defects and ensure quality during manufacturing or pre-release stages. While both roles require technical skills and certifications, Evaluation Engineers emphasize evaluation and analysis, whereas Test Engineers concentrate on testing execution and defect detection.

What does an evaluation engineer do?

An evaluation engineer assesses the performance, reliability, and safety of products, systems, or processes through testing, analysis, and data collection. They often use specialized tools and techniques to ensure standards are met and may prepare reports or recommendations based on their findings.

What job categories do people searching Evaluation Engineer jobs in Georgia look for?

The top searched job categories for Evaluation Engineer jobs in Georgia are:

What cities in Georgia are hiring for Evaluation Engineer jobs?

Cities in Georgia with the most Evaluation Engineer job openings:

Infographic showing various Evaluation Engineer job openings in Georgia as of August 2026, with employment types broken down into 2% As Needed, 81% Full Time, 15% Part Time, and 2% Contract. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution, with an average salary of $108,461 per year, or $52.1 per hour.

Full-time

Re-posted 23 days ago


Job description

Join a National Top Workplace 
 
Named a Top Workplace in the USA and Top Remote Workplace, Kobie is where the best minds in loyalty come together, driven by passion and innovation. We're always looking for talented individuals who are ready to join a collaborative, growth-focused culture. As a partner to some of the world's most recognized brands, we are leaders in loyalty, helping brands build lasting emotional connections with their consumers. 
 
Join Us from Anywhere 
While our headquarters are nestled in sunny St. Petersburg, Florida, Kobie embraces a flexible work environment, offering teammates the freedom to work remotely. We understand the importance of work-life balance and support our team with: 
 
         Flexible Time Off to recharge when needed 
         Nine Company-Wide Holidays 
         A diverse suite of benefits prioritizing your growth, development, and personal well-being 
 
Discover more about our perks and benefits here. 
 
Kobie is a values-led organization where we believe that everyone is a leader, regardless of their position or role. 
 
Travel Requirements:
As a remote-first organization headquartered in St. Petersburg, Florida, Kobie values meaningful in-person connection and collaboration that strengthens our teams, supports our clients, and enhances our culture. While travel requirements vary by role, periodic travel may be required to support business objectives, team collaboration, customer engagements, training, and company events. Candidates should be able and willing to travel as needed to fulfill the responsibilities of the role. 
 

About the team and what we'll build together

Kobie runs some of the largest loyalty programs in the world. We're building an internal agent platform on Amazon AgentCore that automates analyst workflows, surfaces insights from program data in Snowflake, and gives our teams and clients an LLM-native way to work with complex loyalty logic.

We're looking for a hands-on AI Engineer to ship on that platform: building agent harnesses, writing the tools those agents call, and owning the reliability and evaluation of what goes to production. This is not a research role. You'll prototype, ship, monitor, and iterate on features used by real teams

Our team tends to be people who reason carefully, ship working code,and pick up new tools without a lot of handholding. There's no single path into this role. We value the impact of what you've built and your track record of building things that hold up.

How you will make an impact

Agent Development

  • Build agent harnesses in Python using LangChain and LangGraph, including tool-calling, structured outputs (Pydantic/JSON schema), retries, streaming, and memory
  • Package agent harnesses for the AgentCore Runtime with appropriate context, tools, skills, and subagents that fit cleanly into production flows and scenarios
  • Write the tools and skills agents use  API integrations, SQL queries against Snowflake, Snowflake backed knowledge retrieval with clear contracts and Pydantic validation

Evaluation and Reliability

  • Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore Evaluations, and wire them into CI
  • Implement guardrails around tool execution: auth scoping, input/output validation, PII and prompt-injection protections, and hallucination mitigation
  • You own what you ship: prototype, deploy through Amazon AgentCore, monitor traces, and fix it when it breaks

Collaboration

  • Partner with data engineers on Snowflake backed retrieval patterns (Cortex Analyst and Cortex Search Services)
  • Contribute to refining our internal engineering patterns as the stack evolves

What you need to be successful

Required

  • 3+ years of professional Python, with production experience building and operating services
  • 1+ years of hands-on work with LLMs in production: prompt/context engineering, tool/function calling, structured outputs, RAG
  • Working knowledge of LangChain/LangGraph or a comparable framework like AgentCore Strands, CrewAI, or Semantic Kernel
  • Experience with LLM observability tools: Amazon CloudWatch, LangSmith, Langfuse, MLflow, or OpenTelemetry
  • Experience designing evaluation frameworks (MLFlow, DeepEval, LLM-as-judge, multi-turn regression)
  • Fluency with Git, Docker, and modern API frameworks
  • Clear written communication and the judgment to know when something is ready to ship

A bachelor's degree is not required. Equivalent practical experience: including bootcamps, self-taught work, career changes, or non-CS technical degrees counts.

Strongly Preferred

  • Hands-on experience with Amazon Bedrock and/or AgentCore as a developer: runtime, gateways, memory, policy, guardrails, observability, awscli, evaluations
  • Experience with Snowflake, Snowpark, or Snowflake Cortex
  • Fluency in writing and reading SQL, as well as understanding semantic models.
  • Familiarity with multi-agent patterns: supervisor/router, subagent/handoff, reflection, human-in-the-loop
  • A considered view on where agents should and shouldn't act and comfort pushing back when "let's add an agent" isn't the right answer
  • Experience in Loyalty, MarTech, AdTech, or a comparable data rich B2B domain
Who we are  As a trusted partner, Kobie delivers market-leading, end-to-end loyalty solutions designed to enable customer experiences for the world's most successful brands. We do this with a strategy-led technology approach that uncovers the truth behind what drives consumers on an emotional level. We believe that our team's passion and expertise are the driving forces behind our success and are proud to be named a Top Workplaces in the USA, where the best and brightest in loyalty drive our mission of growing enterprise value through loyalty. 
 
A place for all We celebrate and embrace diversity at Kobie! 
Employment at Kobie is based solely on an individual's merit and qualifications, which are directly related to professional competence. We do not discriminate against any teammate or applicant because of race,color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy, or any other characteristic protected by applicable law. 
 
We are fiercely committed to fostering a workplace where teammates can bring their authentic selves to work every day. Our DEI initiatives, including various committees, ensure that principles of equity, diversity, and inclusion are deeply ingrained throughout Kobie. While our leadership team fully supports our policy of nondiscrimination and equal opportunity, it is the responsibility of all teammates to uphold these values. 
 
Ready to join us? If you're ready to make an impact and grow in a supportive, innovative environment, we'd love to hear from you. Apply today and join the best and brightest in loyalty! 
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
apply for this job