... intelligence, generative AI, and data-driven systems. This role designs tailored audit ... Manage the creation and execution of audit programs, including drafting testing plans and ...
... intelligence, generative AI, and data-driven systems. This role designs tailored audit ... Manage the creation and execution of audit programs, including drafting testing plans and ...
... generative AI, including GPTs and future agent-based solutions. * Support the design, development, testing, and ongoing improvement of GPTs, AI-powered workflows, and (over time) agent-based ...
... generative AI, including GPTs and future agent-based solutions. * Support the design, development, testing, and ongoing improvement of GPTs, AI-powered workflows, and (over time) agent-based ...
By embedding Generative AI and Agentic AI into commerce operations, we enable real-time ... Drift detection * Implement LLM evaluation metrics, structured testing frameworks, and ...
By embedding Generative AI and Agentic AI into commerce operations, we enable real-time ... Drift detection * Implement LLM evaluation metrics, structured testing frameworks, and ...
AI deployment engineer (Central)
Chicago, IL · On-site
$150 - $210/hr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
AI deployment engineer (Central)
Chicago, IL · On-site
$150 - $210/hr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
AI deployment engineer (Central)
Chicago, IL · On-site
$131K - $166K/yr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
AI deployment engineer (Central)
Chicago, IL · On-site
$131K - $166K/yr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
AI deployment engineer (Central)
Chicago, IL · On-site
$90 - $130/hr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Austin, Chicago ... Early‑detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
AI deployment engineer (Central)
Chicago, IL · On-site
$90 - $130/hr
... generative AI. Founded in 2020 with office hubs in San Francisco, New York City, Austin, Chicago ... Early‑detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
Exposure to cloud services, CI/CD delivery practices, automated testing, and modern DevOps ways of working. * Interest in and practical exposure to AI, machine learning, Generative AI, or data-driven ...
Exposure to cloud services, CI/CD delivery practices, automated testing, and modern DevOps ways of working. * Interest in and practical exposure to AI, machine learning, Generative AI, or data-driven ...
Software Engineer - AI Platform (Hybrid)
North Chicago, IL · On-site
$84K/yr
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
Software Engineer - AI Platform (Hybrid)
North Chicago, IL · On-site
$84K/yr
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
AI SYSTEM INTEGRATION ENGINEER
Chicago, IL · On-site
$80 - $100/hr
Working knowledge of: * Generative AI * Large Language Models (LLMs) * Retrieval-Augmented ... Integration Testing * Error Handling and Retry Mechanisms * Reusable Connector Development Cloud ...
AI SYSTEM INTEGRATION ENGINEER
Chicago, IL · On-site
$80 - $100/hr
Working knowledge of: * Generative AI * Large Language Models (LLMs) * Retrieval-Augmented ... Integration Testing * Error Handling and Retry Mechanisms * Reusable Connector Development Cloud ...
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
Quick apply
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
... unit testing, integration testing, user acceptance testing, defect resolution, and validation ... Interest in generative AI, LLMs, prompt engineering, retrieval-augmented generation, model ...
Agentic AI Engineer, Senior - Anthropic/Claude
$107K - $147K/yr
Design and build Generative AI and agentic solutions using Claude, including agent orchestration ... Manage and deliver components of client engagements spanning solution design, prototyping, testing ...
Agentic AI Engineer, Senior - Anthropic/Claude
$107K - $147K/yr
Design and build Generative AI and agentic solutions using Claude, including agent orchestration ... Manage and deliver components of client engagements spanning solution design, prototyping, testing ...
AI Design Facilitator and Forward-Deployed Engineer II
Chicago, IL · On-site
$132K - $159K/yr
Develop and deliver comprehensive training programs on generative AI technologies, including tools ... A real design background: user research, user testing, human-centered design, or a closely related ...
AI Design Facilitator and Forward-Deployed Engineer II
Chicago, IL · On-site
$132K - $159K/yr
Develop and deliver comprehensive training programs on generative AI technologies, including tools ... A real design background: user research, user testing, human-centered design, or a closely related ...
Senior Software Engineer-Tech Ex AI Assets Foundry Team
Chicago, IL · On-site
$126K - $166K/yr
Build and integrate Generative AI capabilities into software products, including APIs, prompt ... Jest, unit testing, integration testing, code review, static analysis, and defect triage ...
Senior Software Engineer-Tech Ex AI Assets Foundry Team
Chicago, IL · On-site
$126K - $166K/yr
Build and integrate Generative AI capabilities into software products, including APIs, prompt ... Jest, unit testing, integration testing, code review, static analysis, and defect triage ...
AI Solutions Analyst
Lake Forest, IL · On-site
$85K - $120K/yr
... generative AI and process automation. You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
AI Solutions Analyst
Lake Forest, IL · On-site
$85K - $120K/yr
... generative AI and process automation. You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
AI Solutions Analyst
Lake Forest, IL · On-site +1
... generative AI and process automation.You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
AI Solutions Analyst
Lake Forest, IL · On-site +1
... generative AI and process automation.You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
AI Solutions Analyst
Lake Forest, IL · On-site +1
$85K - $120K/yr
... generative AI and process automation. You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
AI Solutions Analyst
Lake Forest, IL · On-site +1
$85K - $120K/yr
... generative AI and process automation. You will play a key role in bridging business needs with ... Support User Acceptance Testing ensuring solutions meet business expectations. * Build dashboards ...
Senior AI Engineer
Chicago, IL · On-site
$180K - $220K/yr
... our generative AI document assistant, as well as document classification, extraction, and LLM ... testing built in * Applying modern engineering practices for production AI systems, including ...
Quick apply
Senior AI Engineer
Chicago, IL · On-site
$180K - $220K/yr
... our generative AI document assistant, as well as document classification, extraction, and LLM ... testing built in * Applying modern engineering practices for production AI systems, including ...
Experience with Generative AI development, including working with Large Language Models (LLMs), API ... From concept design and testing to data analysis and support, you will oversee the technical ...
Experience with Generative AI development, including working with Large Language Models (LLMs), API ... From concept design and testing to data analysis and support, you will oversee the technical ...
Senior AI Engineer
Chicago, IL · On-site
$180K - $220K/yr
... our generative AI document assistant, as well as document classification, extraction, and LLM ... testing built in * Applying modern engineering practices for production AI systems, including ...
Senior AI Engineer
Chicago, IL · On-site
$180K - $220K/yr
... our generative AI document assistant, as well as document classification, extraction, and LLM ... testing built in * Applying modern engineering practices for production AI systems, including ...
Generative Ai Testing information
What is generative AI testing?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How do I become a Generative AI Testing?
Is Generative AI Testing a good career?
What are popular job titles related to Generative Ai Testing jobs in Illinois?
For Generative Ai Testing jobs in Illinois, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Illinois look for?
The top searched job categories for Generative Ai Testing jobs in Illinois are:
What cities in Illinois are hiring for Generative Ai Testing jobs?
Cities in Illinois with the most Generative Ai Testing job openings:

Other
This job post has expired 2 days ago. Applications are no longer accepted.
Key responsibilities
Lead complex audits in high-risk or emerging technology domains, focusing on artificial intelligence, generative AI, and data-driven systems.
Manage the creation and execution of audit programs, including drafting testing plans, performing walkthroughs, and executing testing procedures for complex processes.
Apply data analytics and AI-assisted audit techniques to evaluate evidence, identify root causes, assess risk levels, and recommend control enhancements or process improvements.
Allstate Insurance rating
7.4
Based on 571 frontline employees who took The Breakroom Quiz
235th of 315 rated insurance
Job description
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
The Lead AI & Technology Risk Auditor is a senior-level audit professional and subject matter expert who leads complex audits in high-risk or emerging technology domains, with a particular focus on artificial intelligence, generative AI, and data-driven systems. This role designs tailored audit methodologies, engages with senior leaders to understand risk exposure, and drives innovation through the use of AI, data science, and automation.Specialists serve as key contributors to audit transformation, creating scalable frameworks for auditing new technologies such as cloud-native platforms, machine learning systems, generative AI and large language models, agentic AI, and AI-enabled decision-making platforms. They evaluate AI governance, responsible AI practices, and emerging AI risks to ensure Allstate's AI adoption is secure, ethical, and well-controlled. They influence audit strategy, develop team capabilities, and act as technical mentors, ensuring the audit function remains future-ready and delivers meaningful value to Allstate.
This role requires a strategic thinker who can develop internal and leverage external networks, apply sound judgment, and deliver high-quality audit results. The Lead AI & Technology Risk Auditor takes personal accountability to ensure audits are performed with proficiency and plays a vital role in developing future audit leaders by providing coaching, guidance, and effective delegation. How You'll Make an Impact / Key Responsibilities
- Independently lead complex, agile technology and business audits with objectivity, applying advanced project management skills to guide scrum teams, manage timelines, identify blockers, and ensure timely resolution of audit issues. Demonstrate excellence in agile sprint execution by managing test progress, updating documentation status, and flagging blockers.
- Manage the creation and execution of audit programs, including drafting testing plans and acceptance criteria, performing walkthroughs, identifying controls, and executing testing procedures for complex processes with limited guidance.
- Apply critical thinking data analytics, and AI-assisted audit techniques to evaluate evidence, identify root causes, assess risk levels, and recommend control enhancements or process improvements. Leverage tools such as Python, SQL, or visualization platforms to perform full-population testing, anomaly detection, and pattern analysis where appropriate.
- Communicate effectively with audit clients through (1) sprint reviews that communicate early observations, refine direction, and align with stakeholder priorities and (2) audit reports that clearly communicate findings, risks, and actions.
- Build and maintain strong, trust-based relationships with IT and business leaders, and actively support Internal Audit's relationship management efforts across the enterprise.
- Provide coaching and feedback to audit team members, supporting their development in areas such as control identification, test execution, documentation, AI literacy, data analytics adoption, and strategic thinking.
- Demonstrate strong business acumen by applying knowledge of Allstate's insurance and non-insurance operations, control environment, and interdepartmental dynamics to audit execution and insights.
- Assess controls over the development, deployment, and monitoring of generative AI and large language model (LLM)-based applications, including prompt engineering safeguards, output validation, hallucination risk, data privacy in training sets, and third-party AI service provider oversight.
- Support department initiatives (process improvement, change leadership, functional expertise) and advance AI, automation, and analytics (e.g., continuous monitoring, document review, predictive risk scoring) to improve audit quality, coverage, and efficiency.
- Stay current on evolving AI regulatory requirements, industry standards, and risk frameworks (e.g., NIST AI Risk Management Framework, IEEE AI ethics standards, and applicable state/federal AI legislation) and incorporate them into audit planning and testing.
- 5 or more years of experience
- 1 or more years of experience auditing, implementing, or assessing AI/ML systems, data governance frameworks, or advanced analytics platforms (Preferred)
- This job does not have supervisory duties.
- Core certifications (CPA, CA, CISA, CIA, or CFE) are required for all new Lead Consultant and above roles, and must be obtained within 18 months if not already held.
- AI or data-related certifications are a plus (e.g., ISACA Certificate in AI Fundamentals, ISACA Advanced in AI Audit [AAIA], AWS/Azure AI certifications, or relevant data science credentials).
- Familiarity with AI/ML concepts including supervised/unsupervised learning, neural networks, natural language processing, and generative AI architectures
- Working knowledge of Python, SQL, or similar tools for data extraction, analysis, and visualization
- Familiarity with or high interest in AI governance principles, including fairness, accountability, transparency, explainability, and data privacy
- Awareness of AI/ML platforms (e.g., Azure ML Studio, Azure AI Foundry, AWS Bedrock, AWS SageMaker, GCP BigQuery, GCP Vertex AI, Open AI and other LLM foundational models, M365 Copilot Studio)
- Minimal travel required (approximately 15%).
Skills
Advanced Analytics, Agentic AI, Analytics, Artificial Intelligence (AI), Audit Execution, Data AnalyticsCompensation
Compensation offered for this role is $98,100 - $150,500 annually and is based on experience and qualifications.The candidate(s) offered this position will be required to submit to a background investigation.
Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger - a winning team making a meaningful impact.
Allstate generally does not sponsor individuals for employment-based visas for this position.
Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.
For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.
To view the "EEO Know Your Rights" poster click "here". This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs.
To view the FMLA poster, click "here". This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.
It is the Company's policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee's ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.
Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs.
When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.
What Allstate Insurance employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Allstate Insurance
Sourced by ZipRecruiter
We're a purpose-driven company powered by purpose-driven people. We're reinventing protection and transforming the company for our customers, communities and each other. You could play a role in our transformation. Join a 90-year-old, Fortune 100 insurance company as we challenge the status quo, champion inclusion and strengthen our communities. If being a part of that future gives you goosebumps, you've come to the right place. Reinventing the future of protection means rethinking how we work together. From marketing to claims, our employees have flexibility in how, when and where they work — whether at home, the office or both. We're creating an inclusive, diverse and equitable workplace. We encourage collaboration, support taking chances and foster a strong sense of community. Let's build a new kind of Allstate together.
Industry
Insurance services, real estate, finance and insurance and insurance agencies and brokerages
Company size
10,000+ Employees
Headquarters location
Northbrook, IL, US