1

Generative Ai Testing Jobs in Minnesota (NOW HIRING)

... Generative AI, with proficiency in tools like Python, TensorFlow, PyTorch, sci-kit-learn, Keras ... Expertise in user-centered design, human factors engineering, and usability testing methodologies

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...

Architect - Agentic AI

Maplewood, MN · On-site

$188K - $230K/yr

... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...

next page

Showing results 1-20

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How much do AI testers get paid?

AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.

Is AI testing a good career?

AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and programming. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development and quality assurance.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is a $900,000 AI job?

A $900,000 AI job typically refers to high-level roles in artificial intelligence, such as senior machine learning engineers, AI research directors, or executive positions, often requiring advanced skills, extensive experience, and sometimes specialized certifications. These roles usually involve leading AI development projects, strategic planning, and overseeing AI teams in large organizations or tech companies.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI development tools and testing frameworks, along with attention to detail, is essential for identifying issues in AI systems.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in Minnesota? For Generative Ai Testing jobs in Minnesota, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Minnesota look for? The top searched job categories for Generative Ai Testing jobs in Minnesota are:
What cities in Minnesota are hiring for Generative Ai Testing jobs? Cities in Minnesota with the most Generative Ai Testing job openings:
Emerging Technology Risk Manager - Consumer & Business Banking

Emerging Technology Risk Manager - Consumer & Business Banking

US Bank

Minneapolis, MN • On-site

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 10 days ago


U.S. Bank rating

8.2

Company rating: 8.2 out of 10

Based on 345 frontline employees who took The Breakroom Quiz

38th of 141 rated banks


Job description

At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at-all from Day One.

Job Description

SUMMARY

The Emerging Technologies Risk Manager is a First Line of Defense (1FLOD) leadership role within Consumer & Business Banking (CBB), responsible for owning and executing risk management, oversight and governance for Artificial Intelligence (AI) use cases and other emerging technologies deployed by the business. This role ensures emerging technology is designed, implemented, and operated in alignment with enterprise risk appetite, regulatory expectations, and internal policies, while enabling responsible innovation.

The role partners closely with Second Line of Defense (2LOD) teams (Enterprise Risk Management, Emerging Technology Risk, Model Risk Management, Compliance, Legal, and Technology Risk) to ensure emerging technology risks are properly identified, assessed, documented, monitored, escalated, and remediated. While 2LOD provides independent oversight and challenge, this role retains business line accountability for execution, evidence, and remediation.

RESPONSIBILITIES

Emerging Technology Risk Governance & Execution:

- Own and oversee emerging technology risk management practices for CBB-owned AI use cases including generative, agentic, autonomous, embedded, and third-party AI.

- Ensure AI use cases are appropriately identified, risk-tiered, approved, registered, and monitored throughout their lifecycle.

- Drive execution of AI policy and procedural requirements, ensuring required artifacts are produced and maintained (e.g., registry records, monitoring plans, testing evidence).

- Lead identification, documentation, and remediation of emerging-technology-related risks, control gaps, issues, and action plans within CBB.

- Apply deep knowledge of CBB's AI enablement strategy to align AI risk governance with CBB business priorities, strategic initiatives, and growth objectives.

Risk Assessment, Monitoring & Issue Management:

- Oversee AI testing, monitoring, and metrics execution aligned to AI risk tier and business use.

Ensure appropriate Human-in-the-Loop or compensating controls are implemented where required.

- Monitor AI performance, anomalies, data risks, and control effectiveness; escalate emerging risks in accordance with established escalation pathways.

- Provide subject matter expertise and support for AI-related issues, risk acceptances, and remediation efforts, including coordination with CBB, Technology and 2LOD partners.

REQUIRED

- Bachelor's degree, or equivalent work experience.

- Typically 10+ years of applicable experience in risk management, compliance, audit, technology risk, or operational risk.

PREFERRED

- Demonstrated experience operating in a First Line of Defense risk role with accountability for execution and outcomes.

Strong understanding of enterprise risk management concepts and the Three Lines of Defense model.

- Experience overseeing or supporting AI, emerging technology, or advanced analytics risk within financial services.

- Working knowledge of emerging technology governance concepts, including risk tiering and materiality.

- Human-in-the-Loop controls.

- Monitoring, testing, and metrics.

- Transparency and explainability.

- Experience partnering closely with 2LOD risk functions while retaining 1FLOD ownership.

- Strong issue management, remediation, and escalation experience.

- Proven ability to lead complex, ambiguous risk topics and influence senior stakeholders.

- Experience with risk tooling and workflows (e.g., ServiceNow or similar platforms).

- Applicable professional certifications a plus (e.g., CRCM, CRISC, CISA, PMP).

- Strong analytical, problem-solving, and judgment skills in complex risk scenarios.

- Clear, executive-ready written and verbal communication.

- Ability to translate technical emerging technology concepts into actionable business risk decisions.

- Proven leadership of teams, processes, and cross-functional initiatives.

- Strong collaboration skills.

- Highly self-directed with the ability to build subject-matter expertise rapidly in emerging risk areas.

If there's anything we can do to accommodate a disability during any portion of the application or hiring process, please refer to ourdisability accommodations for applicants.

Benefits:

Our approach to benefits and total rewards considers our team members' whole selves and what may be needed to thrive in and outside work. That's why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following:

  • Healthcare (medical, dental, vision)

  • Basic term and optional term life insurance

  • Short-term and long-term disability

  • Pregnancy disability and parental leave

  • 401(k) and employer-funded retirement plan

  • Paid vacation (from two to five weeks depending on salary grade and tenure)

  • Up to 11 paid holiday opportunities

  • Adoption assistance

  • Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law

Review our full benefits available by employment status here.

U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, and other factors protected under applicable law.

E-Verify

U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about theE-Verify program.

The salary range reflects figures based on the primary location, which is listed first. The actual range for the role may differ based on the location of the role. In addition to salary, U.S. Bank offers a comprehensive benefits package, including incentive and recognition programs, equity stock purchase 401(k) contribution and pension (all benefits are subject to eligibility requirements). Pay Range: $133,365.00 - $156,900.00

U.S. Bank will consider qualified applicants with arrest or conviction records for employment. U.S. Bank conducts background checks consistent with applicable local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act as well as the San Francisco Fair Chance Ordinance. U.S. Bank is subject to, and conducts background checks consistent with the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA). In addition, certain positions may also be subject to the requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.

Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct and related workplace conduct and safety policies.

Posting may be closed earlier due to high volume of applicants.


What U.S. Bank employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


U.S. Bank logo

About U.S. Bank

Sourced by ZipRecruiter

U.S. Bank is a reputable and established financial institution that plays a significant role in the banking sector. With a history spanning over 150 years, U.S. Bank has built a strong foundation of trust and reliability. As a comprehensive bank, they offer a wide array of financial products and services to cater to the diverse needs of their customers, including individuals, businesses, and communities. Customer satisfaction is of utmost importance to U.S. Bank. They prioritize delivering exceptional service and fostering long-term relationships with their clients. Through their extensive network of branches and advanced digital banking platforms, U.S. Bank ensures convenient access to their services, empowering customers to manage their finances efficiently and securely.

Industry

Banking and credit intermediation

Company size

10,000+ Employees

Headquarters location

Minneapolis, MN, US

Year founded

1863

Social media