1

Ai Test Engineer Jobs in Raleigh, NC (NOW HIRING)

AI Engineer I

Durham, NC · On-site

$80 - $100/hr

As an AI Engineer I, you will build, test, and ship AI agents and workflows on Microsoft Copilot Studio and Azure AI Foundry, working from specifications and architecture set by senior engineers.

As an AI Engineer I, you will build, test, and ship AI agents and workflows on Microsoft Copilot Studio and Azure AI Foundry, working from specifications and architecture set by senior engineers.

SDET / C

Cary, NC · On-site

$46.75 - $60.25/hr

Software Development Engineer in Test / C - Hybrid, Cary, North Carolina We're a leader in data and AI. Through our software and services, we inspire customers around the world to transform data into ...

SDET / C

Cary, NC · On-site

$46.75 - $60.25/hr

Software Development Engineer in Test / C - Hybrid, Cary, North Carolina We're a leader in data and AI. Through our software and services, we inspire customers around the world to transform data into ...

SDET (Emerging Careers)

Cary, NC · On-site

$46.75 - $60.25/hr

Software Development Engineer in Test (Emerging Careers) - Hybrid, Cary, North Carolina We're a leader in data and AI. Through our software and services, we inspire customers around the world to ...

SDET (Emerging Careers)

Cary, NC · On-site

$46.75 - $60.25/hr

Software Development Engineer in Test (Emerging Careers) - Hybrid, Cary, North Carolina We're a leader in data and AI. Through our software and services, we inspire customers around the world to ...

AI Operations Engineer

Durham, NC · Hybrid

$67K - $90K/yr

Test and evaluate AI agents, prompts, and workflows across multiple use cases * Create, maintain ... Work with engineering teams to validate MCP connectors and integrations * Analyze model failures ...

Test Automation Architect

Raleigh, NC · On-site

$150 - $200/hr

Design, implement & deploy an AI-assisted test automation framework that incorporates testing of ... Support junior Engineers to accelerate test automation by training, guiding, and solving technical ...

Position Summary The Quality Architect / AI Automation Architect will lead the design and ... Support junior Engineers to accelerate test automation by training, guiding, and solving technical ...

Position Summary The Quality Architect / AI Automation Architect will lead the design and ... Support junior Engineers to accelerate test automation by training, guiding, and solving technical ...

Showing results 21-40

Ai Test Engineer information

See Raleigh, NC salary details

$17

$43

$72

How much do ai test engineer jobs pay per hour?

As of Sep 8, 2026, the average hourly pay for ai test engineer in Raleigh, NC is $43.01, according to ZipRecruiter salary data. Most workers in this role earn between $32.50 and $50.96 per hour, depending on experience, location, and employer.

What is an AI test engineer?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are the key skills and qualifications needed to thrive as an AI test engineer?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.

What are some common challenges AI test engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

How do I become an AI Test Engineer?

To become an AI Test Engineer, candidates typically need a strong background in computer science, software testing, or related fields, along with knowledge of AI and machine learning concepts. Skills in programming languages such as Python or Java, experience with testing tools, and understanding of AI model evaluation are essential. Earning relevant certifications and gaining experience in software development and testing environments can also improve job prospects.

What job categories do people searching Ai Test Engineer jobs in Raleigh, NC look for?

The top searched job categories for Ai Test Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Ai Test Engineer jobs?

Cities near Raleigh, NC with the most Ai Test Engineer job openings:

Infographic showing various Ai Test Engineer job openings in Raleigh, NC as of September 2026, with employment types broken down into 1% As Needed, 79% Full Time, 16% Part Time, 3% Contract, and 1% Nights. Highlights an 90% Physical, 1% Hybrid, and 9% Remote job distribution, with an average salary of $89,453 per year, or $43 per hour.

AI Engineer I

Durham, NC • On-site

$80 - $100/hr

Other

Medical, Dental, Vision, Retirement

Posted 11 days ago


Key responsibilities

  • Build, test, and deploy AI agents and workflows on Copilot Studio and Azure AI Foundry following architecture standards.

  • Wire integrations between AI agents and business systems using connectors, APIs, and tool integrations.

  • Own and monitor a scoped AI agent after launch, including troubleshooting, small fixes, and documenting processes.


Job description

LOCATION: Durham (Hybrid)ABOUT USVictra is Verizon’s largest premium retailer in the United States. We thrive on collaboration, innovation, and performance. Our mission is to “Connect technology to life in a trustworthy, fun, and profitable way”. We work closely with Verizon and our brand partners to deliver exceptional product offerings, promotions, and campaigns that drive in-store traffic and revenue.DESCRIPTIONVictra is building its AI engineering capability in-house, and this role is where that starts. As an AI Engineer I, you will build, test, and ship AI agents and workflows on Microsoft Copilot Studio and Azure AI Foundry, working from specifications and architecture set by senior engineers. This is a deliberately early-career role: we are hiring for aptitude, curiosity, and builder instincts, not years of AI experience. No generative AI experience is required. If you are an early-career software developer, an automation or Power Platform builder ready to move into pro-code, a systems administrator, or an engineer excited to learn agent development on a funded, structured path, this role was written for you. You will have a named mentor, a certification budget, and real ownership of what you ship. Our center of gravity is Azure AI Foundry, but the fundamentals you will learn here (APIs, prompting, orchestration, evaluation) are platform-agnostic, and you will occasionally support builds beyond the core platforms, including open-source frameworks and AI coding tools.KEY RESPONSIBILITIESBuild, test, and deploy AI agents and workflows on Copilot Studio and Azure AI Foundry, following the architecture standards and patterns set by senior engineersWire integrations between agents and business systems: connectors, APIs, and tool integrationsValidate AI outputs against acceptance criteria; write and run tests, including basic evaluation checks, before anything shipsTroubleshoot edge cases and production issues with senior backup, and document root causesOwn one scoped agent after launch: monitoring, small fixes, and user feedback, with a named senior reviewerDocument every build to team standard so knowledge lives in the team, not one person's headSupport builds beyond the core platforms when directed, including open-source agent frameworks and AI coding tools, applying the same testing, documentation, and registration standardsRegister everything you ship in the agent registry so nothing goes ungovernedComplete the structured learning path (Microsoft Learn agent development curriculum plus funded certifications) on the agreed timelineWHAT WE ARE LOOKING FORREQUIREDBachelor's degree in computer science, information systems, or a related field, demonstrating technical dedication, the ability to commit long term, and a strong critical-thinking foundationDemonstrated coding aptitude in a general-purpose programming language such as Python, C#, or Java; scripting experience (PowerShell, JavaScript, or Power Fx) also countsWorking knowledge of APIs and data basics (calling a service, reading JSON, moving data between systems)Defensive, edge-case thinking: you instinctively ask "what happens when this input is wrong"Clear written communication and documentation habitsEvidence of self-driven learning: side projects, experiments, or a tool you taught yourself, including attempts that failed and what you did nextComfortable using AI tools daily (Claude, GitHub Copilot, or similar) as part of how you workNo generative AI experience required; we will teach the AIPREFERREDA background that shows real building: software or application development, scripting, or automation engineering; Power Platform, RPA, ServiceNow, or systems administration experience is welcome as a starting pointInterest in pro-code building on Azure: writing and consuming REST APIs, Azure Functions (function apps), API Management (APIM), and retrieval-augmented generation (RAG) work such as indexing and grounding strategies in Azure AI FoundryFamiliarity with a modern code workflow: Git version control, branch management, and CI/CD pipelines for pushing code into productionExposure to open-source agent frameworks or LLM observability tooling (LangChain, Langfuse, or similar)Microsoft certifications a plus, not a requirement: AI-901 or AB-900 (fundamentals), AB-620 AI Agent Builder Associate, or AI-103 Azure AI Apps and Agents Developer Associate; we fund certification for hires who do not have themRetail or field operations exposureGROWTH PATHA published ladder from AI Engineer I toward senior agent development, backed by funded certifications, a learning budget, and increasing ownership. First supervised production agent expected around month six; scoped independence grows from there.WHY JOIN US?Paid training and career development opportunities.Comprehensive health, dental, and vision insurance.401k retirement plan.Tuition reimbursement.Employee discounts on Verizon services.Referral bonuses.Career pathing opportunities.EQUAL OPPORTUNITY EMPLOYERWe're proud to be an equal opportunity employer - and celebrate our employees' differences, regardless of race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or Veteran status. Different makes us better. #J-18808-Ljbffr