... generative, agentic, autonomous, embedded, and third-party AI. - Ensure AI use cases are ... Risk Assessment, Monitoring & Issue Management: - Oversee AI testing, monitoring, and metrics ...
... generative, agentic, autonomous, embedded, and third-party AI. - Ensure AI use cases are ... Risk Assessment, Monitoring & Issue Management: - Oversee AI testing, monitoring, and metrics ...
AI/ML Engineer - Remote
Rochester, MN · Remote
... Generative AI, with proficiency in tools like Python, TensorFlow, PyTorch, sci-kit-learn, Keras ... Expertise in user-centered design, human factors engineering, and usability testing methodologies
AI/ML Engineer - Remote
Rochester, MN · Remote
... Generative AI, with proficiency in tools like Python, TensorFlow, PyTorch, sci-kit-learn, Keras ... Expertise in user-centered design, human factors engineering, and usability testing methodologies
Agentic AI, AI & Data Senior Consultant
Minneapolis, MN · On-site
$110K - $150K/yr
... testing, training, defining support procedures. Your background in technology will provide the ... 1 year focused on Generative AI, Agentic AI or multi-agent systems * 2+ years of hands-on ...
Agentic AI, AI & Data Senior Consultant
Minneapolis, MN · On-site
$110K - $150K/yr
... testing, training, defining support procedures. Your background in technology will provide the ... 1 year focused on Generative AI, Agentic AI or multi-agent systems * 2+ years of hands-on ...
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
You'll architect and implement complete features that deliver generative AI capabilities, alongside ... Establish and maintain high engineering standards for code quality, testing, and architecture
Lead Software Engineer, AI
Eagan, MN · Hybrid
Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...
Lead Software Engineer, AI
Eagan, MN · Hybrid
Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...
Lead Software Engineer, AI
Eagan, MN · On-site
Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...
Lead Software Engineer, AI
Eagan, MN · On-site
Ensure quality, security, and operational excellence - Design and implement testing, monitoring ... Generative AI or RAG or LLMs - including solution discovery, architecture, agentic tools ...
Principal Data Scientist - Remote
Eden Prairie, MN · On-site +1
Develop Generative AI and LLM-powered solutions including retrieval-augmented generation (RAG ... safety testing, hallucination mitigation, and drift detection * Drive responsible AI practices ...
Principal Data Scientist - Remote
Eden Prairie, MN · On-site +1
Develop Generative AI and LLM-powered solutions including retrieval-augmented generation (RAG ... safety testing, hallucination mitigation, and drift detection * Drive responsible AI practices ...
Principal Data Scientist - Remote
Eden Prairie, MN · On-site +1
Develop Generative AI and LLM-powered solutions including retrieval-augmented generation (RAG ... safety testing, hallucination mitigation, and drift detection * Drive responsible AI practices ...
Principal Data Scientist - Remote
Eden Prairie, MN · On-site +1
Develop Generative AI and LLM-powered solutions including retrieval-augmented generation (RAG ... safety testing, hallucination mitigation, and drift detection * Drive responsible AI practices ...
Contribute to the design, development, and testing of AIenabled software solutions under the ... Introductory exposure to AI / Machine Learning or Generative AI concepts is strongly preferred ...
New
Contribute to the design, development, and testing of AIenabled software solutions under the ... Introductory exposure to AI / Machine Learning or Generative AI concepts is strongly preferred ...
New
Senior Software Consultant II
Minneapolis, MN · On-site +1
$57 - $75.25/hr
... design patterns, testing, and CI/CD awareness. * You have experience with web/app server ... You have experience or interest in Generative AI, AI/ML, or LLM-supported solution patterns * You ...
Senior Software Consultant II
Minneapolis, MN · On-site +1
$57 - $75.25/hr
... design patterns, testing, and CI/CD awareness. * You have experience with web/app server ... You have experience or interest in Generative AI, AI/ML, or LLM-supported solution patterns * You ...
Senior Software Consultant II
Minneapolis, MN · On-site
$57 - $75.25/hr
... design patterns, testing, and CI/CD awareness. * You have experience with web/app server ... You have experience or interest in Generative AI, AI/ML, or LLM-supported solution patterns * You ...
Quick apply
Senior Software Consultant II
Minneapolis, MN · On-site
$57 - $75.25/hr
... design patterns, testing, and CI/CD awareness. * You have experience with web/app server ... You have experience or interest in Generative AI, AI/ML, or LLM-supported solution patterns * You ...
Architect - Agentic AI
Maplewood, MN · On-site
$188K - $230K/yr
... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...
Architect - Agentic AI
Maplewood, MN · On-site
$188K - $230K/yr
... CI/CD, automated testing, rollback, and human-in-the-loop controls. * Establish and enforce ... Five (5) years of experience in AI engineering, with at least Two (2) years in a Generative AI, AI ...
... testing * Experience in pre-sales or sales engineering, including discovery, solution ... supporting generative AI infrastructure patterns, including multi-node distributed training
... testing * Experience in pre-sales or sales engineering, including discovery, solution ... supporting generative AI infrastructure patterns, including multi-node distributed training
AI Systems & Automation Manager, Marketing
Minneapolis, MN · Remote
$140K - $185K/yr
... generative AI use cases (prompt engineering, chaining, evaluation, and optimization) * Own end-to-end implementation of AI solutions, from concept through production, including testing, deployment ...
AI Systems & Automation Manager, Marketing
Minneapolis, MN · Remote
$140K - $185K/yr
... generative AI use cases (prompt engineering, chaining, evaluation, and optimization) * Own end-to-end implementation of AI solutions, from concept through production, including testing, deployment ...
Senior Software Engineer - Legal & Compliance (AI)
$139K - $230K/yr
Familiarity with prompt versioning, evaluation frameworks, and A/B testing strategies specific to generative AI systems * Experience integrating AI capabilities into existing enterprise platforms and ...
Senior Software Engineer - Legal & Compliance (AI)
$139K - $230K/yr
Familiarity with prompt versioning, evaluation frameworks, and A/B testing strategies specific to generative AI systems * Experience integrating AI capabilities into existing enterprise platforms and ...
Senior Software Engineer - Legal & Compliance (AI)
$139K - $230K/yr
Familiarity with prompt versioning, evaluation frameworks, and A/B testing strategies specific to generative AI systems * Experience integrating AI capabilities into existing enterprise platforms and ...
Senior Software Engineer - Legal & Compliance (AI)
$139K - $230K/yr
Familiarity with prompt versioning, evaluation frameworks, and A/B testing strategies specific to generative AI systems * Experience integrating AI capabilities into existing enterprise platforms and ...
Architect generative and agentic AI solutions across infrastructure, model, and application layers ... Contribute to client workshops, solution demos, testing, deployment activities, and stakeholder ...
Architect generative and agentic AI solutions across infrastructure, model, and application layers ... Contribute to client workshops, solution demos, testing, deployment activities, and stakeholder ...
Senior AI/ML Engineer Voice Bots - Remote
Eden Prairie, MN · Remote
$91K - $163K/yr
Leverage AI assisted tools for design, implementation, code reviews, and testing * Ensure the ... Generative AI projects * 2 years of experience with Deploying and manage ML models on cloud ...
Senior AI/ML Engineer Voice Bots - Remote
Eden Prairie, MN · Remote
$91K - $163K/yr
Leverage AI assisted tools for design, implementation, code reviews, and testing * Ensure the ... Generative AI projects * 2 years of experience with Deploying and manage ML models on cloud ...
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How much do AI testers get paid?
Is AI testing a good career?
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What is a $900,000 AI job?
How do I become an AI tester?
What is Generative AI Testing?
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 10 days ago
U.S. Bank rating
8.2
Based on 345 frontline employees who took The Breakroom Quiz
38th of 141 rated banks
Job description
At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at-all from Day One.
Job DescriptionSUMMARY
The Emerging Technologies Risk Manager is a First Line of Defense (1FLOD) leadership role within Consumer & Business Banking (CBB), responsible for owning and executing risk management, oversight and governance for Artificial Intelligence (AI) use cases and other emerging technologies deployed by the business. This role ensures emerging technology is designed, implemented, and operated in alignment with enterprise risk appetite, regulatory expectations, and internal policies, while enabling responsible innovation.
The role partners closely with Second Line of Defense (2LOD) teams (Enterprise Risk Management, Emerging Technology Risk, Model Risk Management, Compliance, Legal, and Technology Risk) to ensure emerging technology risks are properly identified, assessed, documented, monitored, escalated, and remediated. While 2LOD provides independent oversight and challenge, this role retains business line accountability for execution, evidence, and remediation.
RESPONSIBILITIES
Emerging Technology Risk Governance & Execution:
- Own and oversee emerging technology risk management practices for CBB-owned AI use cases including generative, agentic, autonomous, embedded, and third-party AI.
- Ensure AI use cases are appropriately identified, risk-tiered, approved, registered, and monitored throughout their lifecycle.
- Drive execution of AI policy and procedural requirements, ensuring required artifacts are produced and maintained (e.g., registry records, monitoring plans, testing evidence).
- Lead identification, documentation, and remediation of emerging-technology-related risks, control gaps, issues, and action plans within CBB.
- Apply deep knowledge of CBB's AI enablement strategy to align AI risk governance with CBB business priorities, strategic initiatives, and growth objectives.
Risk Assessment, Monitoring & Issue Management:
- Oversee AI testing, monitoring, and metrics execution aligned to AI risk tier and business use.
Ensure appropriate Human-in-the-Loop or compensating controls are implemented where required.
- Monitor AI performance, anomalies, data risks, and control effectiveness; escalate emerging risks in accordance with established escalation pathways.
- Provide subject matter expertise and support for AI-related issues, risk acceptances, and remediation efforts, including coordination with CBB, Technology and 2LOD partners.
REQUIRED
- Bachelor's degree, or equivalent work experience.
- Typically 10+ years of applicable experience in risk management, compliance, audit, technology risk, or operational risk.
PREFERRED
- Demonstrated experience operating in a First Line of Defense risk role with accountability for execution and outcomes.
Strong understanding of enterprise risk management concepts and the Three Lines of Defense model.
- Experience overseeing or supporting AI, emerging technology, or advanced analytics risk within financial services.
- Working knowledge of emerging technology governance concepts, including risk tiering and materiality.
- Human-in-the-Loop controls.
- Monitoring, testing, and metrics.
- Transparency and explainability.
- Experience partnering closely with 2LOD risk functions while retaining 1FLOD ownership.
- Strong issue management, remediation, and escalation experience.
- Proven ability to lead complex, ambiguous risk topics and influence senior stakeholders.
- Experience with risk tooling and workflows (e.g., ServiceNow or similar platforms).
- Applicable professional certifications a plus (e.g., CRCM, CRISC, CISA, PMP).
- Strong analytical, problem-solving, and judgment skills in complex risk scenarios.
- Clear, executive-ready written and verbal communication.
- Ability to translate technical emerging technology concepts into actionable business risk decisions.
- Proven leadership of teams, processes, and cross-functional initiatives.
- Strong collaboration skills.
- Highly self-directed with the ability to build subject-matter expertise rapidly in emerging risk areas.
If there's anything we can do to accommodate a disability during any portion of the application or hiring process, please refer to ourdisability accommodations for applicants.
Benefits:
Our approach to benefits and total rewards considers our team members' whole selves and what may be needed to thrive in and outside work. That's why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following:
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
Review our full benefits available by employment status here.
U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, and other factors protected under applicable law.
E-Verify
U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about theE-Verify program.
The salary range reflects figures based on the primary location, which is listed first. The actual range for the role may differ based on the location of the role. In addition to salary, U.S. Bank offers a comprehensive benefits package, including incentive and recognition programs, equity stock purchase 401(k) contribution and pension (all benefits are subject to eligibility requirements). Pay Range: $133,365.00 - $156,900.00U.S. Bank will consider qualified applicants with arrest or conviction records for employment. U.S. Bank conducts background checks consistent with applicable local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act as well as the San Francisco Fair Chance Ordinance. U.S. Bank is subject to, and conducts background checks consistent with the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA). In addition, certain positions may also be subject to the requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.
Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct and related workplace conduct and safety policies.
Posting may be closed earlier due to high volume of applicants.
What U.S. Bank employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About U.S. Bank
Sourced by ZipRecruiter
U.S. Bank is a reputable and established financial institution that plays a significant role in the banking sector. With a history spanning over 150 years, U.S. Bank has built a strong foundation of trust and reliability. As a comprehensive bank, they offer a wide array of financial products and services to cater to the diverse needs of their customers, including individuals, businesses, and communities. Customer satisfaction is of utmost importance to U.S. Bank. They prioritize delivering exceptional service and fostering long-term relationships with their clients. Through their extensive network of branches and advanced digital banking platforms, U.S. Bank ensures convenient access to their services, empowering customers to manage their finances efficiently and securely.
Industry
Banking and credit intermediation
Company size
10,000+ Employees
Headquarters location
Minneapolis, MN, US
Year founded
1863