1

Generative Ai Testing Jobs in Minnesota (NOW HIRING)

AI Engineer

Minneapolis, MN · Hybrid

$85K - $128K/yr

... testing, and deploying AI solutions that enhance decision-making, automate workflows, and unlock ... Experience with LLMs, multimodal models, or generative AI (eg. Azure AI Foundry, Google Vertex)

... testing AI agents and custom AI systems * Contribute to prompt engineering agent workflows, and ... vision, and generative AI * Document learning and contribute to internal knowledge sharing

AI Intern

Minneapolis, MN · On-site

$18/hr

... testing AI agents and custom AI systems * Contribute to prompt engineering agent workflows, and ... vision, and generative AI * Document learning and contribute to internal knowledge sharing

Establish and drive engineering best practices for model evaluation, validation, testing ... Experience building and supporting enterprise-scale generative AI solutions. * Experience with ...

AI Engineer

Minneapolis, MN · On-site

$50K - $112K/yr

... Applying generative AI techniques, including prompt engineering, LLM evaluation, and fine-tuning ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Showing results 41-60

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in Minnesota?

For Generative Ai Testing jobs in Minnesota, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Minnesota look for?

The top searched job categories for Generative Ai Testing jobs in Minnesota are:

What cities in Minnesota are hiring for Generative Ai Testing jobs?

Cities in Minnesota with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Minnesota as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 11% Part Time, 3% Contract, and 2% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

AI Engineer

Mortenson

Minneapolis, MN • Hybrid

$85K - $128K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 5 days ago


Mortenson rating

8.4

Company rating: 8.4 out of 10

Based on 19 frontline employees who took The Breakroom Quiz


Job description

SUMMARY 

Mortenson is currently seeking an AI Engineer that will play a key role in developing, testing, and deploying AI solutions that enhance decision-making, automate workflows, and unlock new value across the enterprise and with project teams. This role will integrate models and AI solutions into enterprise systems and field applications, working closely with cross-functional teams, to ensure alignment between business needs and data architecture, defining data models for specific focus areas.

RESPONSIBILITIES

  • Test and evaluate AI solutions and functionalities within and beyond enterprise solutions
  • Translate business requirements into business-ready AI solutions
  • Collaborate with business partners, presenting goals, objective and findings to non-technical audiences to promote innovation aligned with R&D efforts of the organization
  • Work with structured and unstructured data from construction platforms (eg. Procore, Autodesk)
  • Partner with Data Solutions to apply reusable components and pipelines to support and implement scalable AI solutions for team members, supporting domain experts across ITS and operations
  • Ensure AI solutions meet Mortenson's standards for security, privacy, and responsible use
  • Effectively work and build relationships with those of diverse backgrounds and organizational levels 
  • (If applicable) All other duties as assigned

QUALIFICATIONS

  • Bachelor's or Master's in Computer Science, Data Science, Engineering or related field. 
  • 2+ years in experience in AI/ML engineering or applied data science
  • Prior work in construction, architecture, engineering, or real estate development, preferred
  • Experience with LLMs, multimodal models, or generative AI (eg. Azure AI Foundry, Google Vertex)
  • Familiarity with agent frameworks, agentic workflows, and knowledge graph, preferred
  • Strong proficiency in Python, ML frameworks, PowerBI, and data tools
  • Exposure to enterprise construction platforms or solutions (eg. Procore, Autodesk, Oracle)
  • Active listening skills and effective communication including an openness to diverse input and feedback
  • Ability to travel up to 15%
  • Driver's license required

A few benefits offered include: 

(for Non-Craft & Non-Union Craft working 25+ hours / week)

  • Medical and prescription drug plans that includes no additional cost vision coverage 
  • Dental plan 
  • 401k retirement plan with a generous Mortenson match
  • Paid time off, holidays, and other paid leaves 
  • Employer paid Life, AD&D, and disability insurance 
  • No-Cost mental health tool and concierge with extensive work-life resources
  • Tuition reimbursement 
  • Adoption Assistance  
  • Gym Membership Discount Program  

The base pay range for this role is $85,300 - $128,000. (Actual range is higher for the following office locations: Denver, CO and Chicago, IL - 5%, Seattle, WA, and Portland, OR - 10%, Washington, D.C. - 12.5%). If applicable: This position is eligible for Mortenson's incentive plan.

Base pay is positioned within the range based on several factors including an individual's knowledge, skills, and experience, with consideration given to internal equity. 

#LI-GC1 LI-hybrid 

Please make note: 

  • Visa sponsorship is not offered for this position.
  • Our postings are typically open a minimum of 5 days and an average of 44 days. 

ABOUT MORTENSON

As a top builder, developer, and EPC (Engineering, Procurement, and Construction), our expertise spans markets like sports, renewable energy, data centers, healthcare, and more. We are builders at heart, working to ensure the built environment has a lasting positive impact. 

Let's Redefine Possible 

Equal Employment Opportunity

Your uniqueness brings new and creative perspectives to the team. Mortenson is committed to providing equal opportunities of employment (EOE) to all individuals, regardless of your race, religion, gender, national origin, age, veteran status, disability, marital status or any other legally protected category.

Other Items to Note

  • Mortenson reserves the right to hire any individual without legal or financial obligation on unwanted solicitations. No agency emails, calls, or solicitations are accepted without a valid agreement.
  • Must be currently legally authorized to work in the U.S. without sponsorship for employment visa status (e.g., H1B status, 0-1, TN, CPT, OPT, etc.). We are unable to sponsor or take over sponsorship of an employment Visa at this time.

What Mortenson employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


M. A. Mortenson logo

About M. A. Mortenson

Sourced by ZipRecruiter

M. A. Mortenson is a prominent name in the construction industry, based out of Minneapolis, MN, US. Established in 1954 by M.A. Mortenson Sr., the company has over six decades of experience offering construction services that have contributed to building lasting infrastructures across various sectors, including healthcare, energy, corporate, and sports. Mortenson has proven its exceptional expertise through a range of complex building and facility projects across the US fulfilling the customer's specifications and exceeding their expectations. Moreover, the company's core values are outlined as ‘Do the Right Thing’, ‘We Before I’, ‘Inspire What’s Possible’, and ‘In it for the long haul’.

Industry

Manufacturing and construction

Company size

1,001 - 5,000 Employees

Headquarters location

Minneapolis, MN, US

Social media