1

Ai Test Engineer Jobs in Georgia (NOW HIRING)

... Engineering Test Laboratory (AIDETL) in Augusta, Georgia. This role will be pivotal in developing the next generation of government AI Test & Evaluation professionals for the Department of War. The ...

DevSecOps Engineer Senior

Augusta, GA · On-site

$100 - $130/hr

This role will be pivotal in developing the next generation of government AI Test & Evaluation professionals for the Department of War. The DevSecOps Engineer serves as the authoritative voice on all ...

As the Principal SDET, you will play a crucial role in shaping and leading our software testing ... Prior exposure to AI/ML systems and how to use them in testing thus making test pipeline more ...

... AI, computer vision, sensor fusion, and networking technology to the military in months, not years ... About the Job As a Software Engineer in the Manufacturing Test organization, you will join a ...

AI Engineer

Atlanta, GA · On-site

$69K - $89K/yr

Test automation frameworks * Azure DevOps, Git, and Azure OpenAI * Arize AI or similar observability tools Responsibilities * Design and execute test plans for GenAI and LLM applications * Test ...

Showing results 41-60

Ai Test Engineer information

See Georgia salary details

$15

$37

$63

How much do ai test engineer jobs pay per hour?

As of Sep 5, 2026, the average hourly pay for ai test engineer in Georgia is $37.36, according to ZipRecruiter salary data. Most workers in this role earn between $28.22 and $44.23 per hour, depending on experience, location, and employer.

What is an AI test engineer?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are the key skills and qualifications needed to thrive as an AI test engineer?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.

What are some common challenges AI test engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

How do I become an AI Test Engineer?

To become an AI Test Engineer, candidates typically need a strong background in computer science, software testing, or related fields, along with knowledge of AI and machine learning concepts. Skills in programming languages such as Python or Java, experience with testing tools, and understanding of AI model evaluation are essential. Earning relevant certifications and gaining experience in software development and testing environments can also improve job prospects.

What job categories do people searching Ai Test Engineer jobs in Georgia look for?

The top searched job categories for Ai Test Engineer jobs in Georgia are:

What cities in Georgia are hiring for Ai Test Engineer jobs?

Cities in Georgia with the most Ai Test Engineer job openings:

Infographic showing various Ai Test Engineer job openings in Georgia as of August 2026, with employment types broken down into 1% As Needed, 78% Full Time, 11% Part Time, 7% Contract, and 3% Nights. Highlights an 93% Physical, 1% Hybrid, and 6% Remote job distribution, with an average salary of $77,706 per year, or $37.4 per hour.

Senior DevOps Automation Engineer (Remote Opportunity)

VetsEZ

Atlanta, GA • On-site, Remote

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 25 days ago


Job description

VetsEZ is currently looking for a Senior Test Engineer for a 100% remote position supporting a large federal government healthcare modernization project. In this role, you will support the development, validation, and automation of an AI-powered Patient Health Data Summarization capability within the Joint Longitudinal Viewer (JLV) Clinical Decision Support (CDS) platform. The ideal candidate will have strong healthcare interoperability experience, knowledge of C-CDA standards, experience testing complex healthcare applications, and hands-on experience with test automation and AI-enabled quality engineering.
The candidate must reside within the continental US.
Responsibilities
  • Develop comprehensive test plans, test cases, and acceptance criteria for AI-powered patient summarization capabilities.
  • Create traceability between business requirements, clinical data standards, and test scenarios.
  • Design test coverage across clinical document types, including Continuity of Care Documents (CCD), Discharge Summaries, Progress Notes, and History & Physical documents.
  • Develop positive, negative, boundary, and edge-case testing scenarios for AI-enabled clinical applications.
  • Analyze and validate C-CDA XML documents, including headers, sections, templates, and clinical entries.
  • Verify accurate extraction and summarization of clinical information, including medications, allergies, laboratory results, procedures, care plans, and diagnoses.
  • Ensure AI-generated summaries accurately reflect source clinical documentation and maintain traceability to original clinical sources.
  • Perform functional, integration, system, regression, performance, and user acceptance testing.
  • Develop and maintain automated test suites for document ingestion, AI summarization, APIs, and user interfaces.
  • Test CDS workflows and patient-context-driven launch scenarios across multiple data sources and patient encounters.
  • Support CI/CD pipelines through automated quality gates and continuous testing.
  • Build automated validation frameworks for AI-generated summaries.
  • Evaluate AI-generated content for clinical completeness, consistency, usability, accuracy, and reliability.
  • Identify omissions, inaccuracies, hallucinations, and other AI-generated defects that could impact clinical workflows.
  • Validate AI guardrails, monitoring capabilities, auditability, and quality controls.
  • Participate in defect triage, root-cause analysis, and release-readiness activities.
  • Create test documentation, defect reports, traceability matrices, and quality assessments.
  • Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders.
  • Leverage AI-assisted tools to accelerate test development, test automation, regression testing, defect analysis, and quality assurance activities.
  • Take on additional tasks and responsibilities as needed to support team objectives and ensure the success of the project.

Requirements
  • Bachelor's degree in Computer Science, Information Technology, Health Informatics, Engineering, or a related technical discipline, or equivalent experience.
  • Minimum of 5 years of experience testing healthcare software applications.
  • Strong knowledge of Consolidated Clinical Document Architecture (C-CDA) standards, including clinical document structure, sections, templates, and entries.
  • Hands-on experience reading, validating, and troubleshooting XML-based healthcare data.
  • Experience with healthcare interoperability standards and clinical data exchange.
  • Experience testing Clinical Decision Support (CDS) applications and workflows.
  • Familiarity with SMART on FHIR, CDS Hooks, REST APIs, and related interoperability technologies.
  • Experience with test automation frameworks, API testing tools, and defect management platforms.
  • Experience developing and maintaining automated testing solutions within Agile and DevSecOps environments.
  • Experience with AI-assisted testing tools and techniques for test case generation, automation development, regression testing, defect analysis, and quality assurance.
  • Familiarity with Generative AI and Large Language Models (LLMs), including using AI to create and maintain automated test scripts, validation frameworks, and test data.
  • Experience validating AI-generated outputs and establishing quality controls for accuracy, consistency, repeatability, and reliability.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent written and verbal communication skills.

Additional Qualifications
  • Experience supporting Department of Veterans Affairs (VA) healthcare systems, including JLV or similar clinical viewer applications.
  • Knowledge of USCDI and healthcare interoperability requirements.
  • Familiarity with healthcare terminologies such as SNOMED CT, LOINC, RxNorm, and ICD.
  • Experience validating AI/ML-enabled healthcare solutions.
  • Experience with AI-powered testing platforms such as GitHub Copilot, Microsoft Copilot, Testim, Functionize, Mabl, or similar tools.
  • Experience creating autonomous or semi-autonomous AI testing workflows, including test-case generation, coverage analysis, synthetic test data, and automated defect triage.
  • Understanding of prompt engineering and AI evaluation methodologies for software quality assurance.
  • Knowledge of accessibility and usability testing within healthcare environments.
  • Experience working within Agile, DevSecOps, and cloud-native development environments.
  • Exposure to healthcare data analytics and modernization initiatives within federal healthcare agencies.

Security Clearance Requirements
U.S. Citizenship is required.
All selected candidates must successfully complete a background check.
Ability to obtain and maintain a Government/Public Trust clearance, including required fingerprinting, when required for the position.
Benefits
  • Medical/Dental/Vision.
  • 401k with Employer Match.
  • PTO + Federal Holidays.
  • Corporate Laptop.
  • Training Opportunities.
  • Remote Opportunity.

VetsEZ is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status.
Sorry, we are unable to offer sponsorship at this time.