1

Generative Ai Testing Jobs in Minnesota (NOW HIRING)

Principal AI Engineer

Minneapolis, MN · On-site

  • Medical

  • Life

  • Retirement

  • PTO

Architect and build scalable, interoperable, responsible AI solutions, including generative AI, RAG ... testing in CI/CD, to operational monitoring and drift detection, to issue and incident response, to ...

AI-ML Engineer - Finance-Hybrid

Rochester, MN · Hybrid

  • Medical

  • Dental

  • Vision

  • Retirement

... Generative AI Solutions tailored for finance applications, not clinical. AI/ML Engineers at Mayo ... Expertise in user-centered design, human factors engineering, usability testing methodologies, and ...

AI/ML Engineer

Minneapolis, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... Generative AI (GenAI) and Agentic AI solutions to address domain specific needs, improve user ... Establish and use frameworks for automated LLM testing * Create regression test suites to detect ...

AI & Agent Enablement * Support the development and testing of AI agents, including: * Prepare and ... Generative AI Applications * Agentic Workflow Design * Data Management & Architecture * Unity ...

AI-ML Engineer - Finance-Hybrid

Rochester, MN · Hybrid

  • Medical

  • Dental

  • Vision

  • Retirement

... Generative AI Solutions tailored for finance applications, not clinical. AI/ML Engineers at Mayo ... testing, and maintenance of tools and associated CI/CD pipelines. Working on component design ...

AI-ML Engineer - Finance-Hybrid

Rochester, MN · Hybrid

  • Medical

  • Dental

  • Vision

  • Retirement

... Generative AI Solutions tailored for finance applications, not clinical. AI/ML Engineers at Mayo ... testing, and maintenance of tools and associated CI/CD pipelines. Working on component design ...

Lead Software Engineer, AI

Eagan, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Lead Software Engineer, AI

Eagan, MN · Hybrid

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Architect - Agentic AI

Maplewood, MN · On-site

$188K - $230K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...

New

Architect - Agentic AI

Maplewood, MN · On-site

$188K - $230K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...

Architect - Agentic AI

Maplewood, MN · On-site

$188K - $230K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...

Lead Software Engineer AI (Staff Engineer)

Eagan, MN · On-site

$104K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI agents, complex workflows and document-centric experiences. * Build and evolve AI ... Opinions and experience around automated testing, reliability, and release practices for systems ...

US Tech - AI Engineering Senior Associate

Minneapolis, MN

$55K - $187K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... and validate Generative AI agents and data pipelines, promoting reliability, scalability, and ... Responsibilities - Apply automated testing and governance controls effectively - Analyze complex ...

Lead Software Engineer AI (Staff Engineer)

Eagan, MN · On-site

$127.40 - $236.60/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI agents, complex workflows and document‐centric experiences.* Build and evolve AI ... Opinions and experience around automated testing, reliability, and release practices for systems ...

Lead Data Scientist

Minneapolis, MN

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Build and evaluate LLM-augmented workflows - combining classical ML signals with generative AI ... Familiarity with A/B testing and causal inference for evaluating model interventions in production.

Showing results 41-60

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are popular job titles related to Generative Ai Testing jobs in Minnesota?

For Generative Ai Testing jobs in Minnesota, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Minnesota look for?

The top searched job categories for Generative Ai Testing jobs in Minnesota are:

What cities in Minnesota are hiring for Generative Ai Testing jobs?

Cities in Minnesota with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Minnesota as of August 2026, with employment types broken down into 1% As Needed, 88% Full Time, 7% Part Time, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

Self-Service & AI Implementation Senior Principal Consultant

Genesys

Virginia, MN • On-site

$136 - $239/hr

Other

Medical, Dental, Vision, Retirement

Posted 10 days ago


Job description

## Self-Service & AI Implementation Senior Principal ConsultantApplylocations: Massachusetts, USA: Virginia, USA: California, USA: Texas, USAtime type: Full timeposted on: Posted Todayjob requisition id: JR111945**Be the one building AI-powered experiences where they matter most.**At Genesys, we help organizations create better customer experiences through AI-powered experience orchestration. Our platform connects people, systems, data and AI to help organizations deliver more personalized service, improve operational efficiency and build stronger customer relationships.Help build, support and operate technology used by more than 8,000 organizations in over 100 countries – moving AI from possibility to production in real-world enterprise environments every day. **Summary:**The SS&AI (Self Service and Artificial Intelligence) Team is a Professional Services team responsible for the design, development and testing of highly customized Self-service digital and AI driven Bot applications (Virtual Agents), generative AI bots and Agentic Virtual Agents across all Genesys platforms. In this role, candidate will get exciting opportunities to work on latest AI technologies to provide top class CX using in house Genesys bots as well as – Google, Amazon, and others. Services provided by the candidate will include software development and Architecture design, Integration consulting, Agile leadership, customer training, team education and owning end to end delivery.**Key Responsibilities:**In this role, the primary responsibilities will include (but are not limited to):* Responsible for managing project initiatives of strategic importance to the organization.* Participate in customer workshops and design digital bot flows using our products using design best practices and awareness of product nuances.* Work Independently, and with Genesys technical teams and business partners, to design, develop and maintain routing applications for Digital Virtual Agents and Digital Agentic Virtual Agents.* Create accurate development effort estimates in collaboration with the team manager, Professional Services project managers or regional managers.* Works on significant and unique issues where analysis of situations or data requires an evaluation of broadly defined variables. Requires conceptual thinking to understand advanced issues and implications. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results. Accountable for results, which may impact their entire function or geography.* Work with Product owner, Scrum master to drive user story creation and ownership for SS&AI owned epics for IVR, Routing and bots. Lead the SS&AI team delivery.* Present and demonstrate proposed digital bot solutions as required. Perform knowledge transfer of the delivered solutions at the conclusion of the engagement as necessary.* Create and execute test scripts for call flow and other logic and leverage existing Genesys tools (logs, reporting) to provide UAT and QA support.* Communicate within the global community respecting cultural, language and time zone variations.* Demonstrate flexibility to adjust working hours to match customer and team interactions.* Work as a team player to the organization. Providing feedback to the product organization about issues found in API’s, product, documentation or architectures.* Work independently to provide customer technical consulting services to help drive the determination of key deliverables, outcomes, code best practices, and deployments.**Minimum Requirements:*** BS/MS/BA or equivalent in Computer Science, Engineering or related field preferred.* 10 + Years of experience with commercial Digital CCaaS applications, Routing, Bots and development experience in appropriate development tools, Advanced Speech Recognition engines. Additional computer languages such as PHP, Java or C# is a plus.* 6+ Years of experience working with digital (and/or voice) bots on platforms like Google Dialogflow and Amazon Lex. Must include webhook/fulfillment experience and development skills.* Must be able to work US hours.* Demonstrated Understanding of and experience with the effective use of generative and agentic AI tools.* Demonstrated experience in a customer facing role and handled difficult customer situations and being a thought leader for effective client consulting.* Understanding of the IVR application architecture including web components, telephony, caching, prompt servers, ASR and operational diagnostics.* Ability to work independently on routine duties or projects with general instructions on new assignments. Ability to take initiative and help define and create new product features.* Demonstrate solid analytical programming and problem-solving skills. Quick learner on new technologies and product features.* Excellent verbal, writing skills and the ability to effectively interact with clients (business and technical audiences) in the English language is a must. Having similar capabilities in other languages is a plus.* Must demonstrate ability to effectively understand and consult with clients and partners (vendors and internal teams) in a high paced environment and flexible schedules. May assist with resolving escalated customer issues that originated with customers or partners.* Willingness to travel.**Desirable Skills:*** Demonstrated experience designing, developing, and supporting agentic AI bots, including autonomous decision-making, tool integration, workflow orchestration, memory management, prompt engineering, and LLM-based conversational AI.* Practical experience developing and deploying Genesys solutions with Genesys tools such as Genesys Cloud, Architect, Dialog Engine, Composer, Designer and Intelligent Automation. Experience with Google Dialog flow and Amazon Lex.* Genesys GCP or AWS certification.* Bot and intent tuning.**Compensation:**This role has a market-competitive salary with an anticipated base compensation range listed below. Actual salaries will vary depending on a candidate’s experience, qualifications, skills, and location. This role might also be eligible for a commission or performance-based bonus opportunities. $135,600.00 - $238,600.00**Benefits:*** Medical, Dental, and Vision Insurance.* Telehealth coverage* Flexible work schedules and work from home opportunities* Development and career growth opportunities* Open Time Off in addition to 10 paid holidays* 401(k) matching program* Adoption Assistance* Fertility treatmentsClick here to view a summary overview of our Benefits. **Working at Genesys*** **AI at enterprise scale** – Build, support and operate AI-powered technology used by more than 8,000 organizations worldwide. 150+ new AI features were released in the last fiscal year.* **A flexible-first culture** – Join a global team of nearly 7,000 employees with flexible ways of working designed to help people do their best work.* **Growth in the AI era** – Build future-ready skills through mentorship, learning programs, leadership development and education support.* **Time to recharge and give back** – Benefits include paid volunteer time, August Free Fridays, well-being resources and regionally tailored programs for employees and their families.* **Recognized globally** – Genesys is Great Place to Work certified in 17 countries and 94% of employees are proud to tell others they work at Genesys.Learn more about our culture, AI innovation and sustainability commitments through our Careers site and Sustainability Report. **What Happens After You Apply**After you apply, here's what you can typically expect:* Our Talent Acquisition team reviews your application with the hiring team.* A Talent Acquisition Partner will review your application and, if your background is aligned, schedule a Zoom interview.* Next, you'll meet the hiring manager and other members of the interview team.* We aim to keep the process focused and respectful of your time, with no more than five interviews in most cases.* After interviews are complete, our team will follow up with the final steps.Every application is reviewed by a person. Response times may vary by role and location, but our team will keep you informed throughout the process. **Stay Connected**Stay connected to learn more about how we're applying AI to customer and employee experience challenges and get notified when relevant opportunities become available.Get notified about relevant opportunities. # **Be the one building what's next - where AI, experience and impact come together.** **Employee Referral**If a Genesys employee referred you, please apply using the link they shared so we can connect your application to their referral. **About Genesys:**Genesys empowers more than 8,000 organizations worldwide to create the best customer and employee experiences. With agentic AI at its core, Genesys CloudTM is the AI-Powered Experience Orchestration platform that connects people, systems, data and AI across the enterprise. As a result, organizations can drive customer loyalty, growth and retention while increasing operational efficiency and teamwork across human and AI workforces. To learn more, visit www.genesys.com. **Reasonable Accommodations:**If you require a reasonable accommodation to complete any part of the application process, or are limited in your ability to access or use this online application and need an alternative method for applying, you or someone you know may contact us at reasonable.accommodations@genesys.com. You can expect a response within 24–48 hours. To help us provide the best support, click the email link above to open a pre-filled message and complete the requested information before sending. If you have any questions, please include them in your email. This email is intended to support job seekers requesting accommodations. Messages unrelated to accommodation—such as application follow-ups or resume submissions—may not receive a response. **Genesys is an equal opportunity employer committed to fairness in the workplace. We evaluate qualified applicants without regard to race, color, age, religion, sex, sexual orientation, gender identity or expression, marital status, domestic partner status, national origin, genetics, disability, military and veteran status, and other protected characteristics.** #J-18808-Ljbffr