1

Generative Ai Testing Jobs in Oklahoma (NOW HIRING)

Evaluate and implement agentic / generative AI capabilities with appropriate guardrails and human ... Establish standards for architecture, testing, monitoring, documentation, releases, and support

... generative AI solutions that support internal teams while ensuring compliance with governance ... architecture, testing, monitoring, documentation, releases, and supportEnforce governance ...

Evaluate and implement agentic / generative AI capabilities with appropriate guardrails and human ... Establish standards for architecture, testing, monitoring, documentation, releases, and support

Evaluate and implement agentic / generative AI capabilities with appropriate guardrails and human ... Establish standards for architecture, testing, monitoring, documentation, releases, and support

... put generative AI in the hands of real users - not just prototypes or notebooks. The ideal ... Drive engineering best practices across the team: code review, testing, CI/CD, documentation, and ...

... put generative AI in the hands of real users - not just prototypes or notebooks. The ideal ... Drive engineering best practices across the team: code review, testing, CI/CD, documentation, and ...

... put generative AI in the hands of real users - not just prototypes or notebooks. The ideal ... Drive engineering best practices across the team: code review, testing, CI/CD, documentation, and ...

... generative AI, agentic AI, and decision-science problem statements. * Perform exploratory data analysis, statistical analysis, hypothesis testing, experimental design, feature engineering, predictive ...

... generative AI, agentic AI, and decision-science problem statements. * Perform exploratory data analysis, statistical analysis, hypothesis testing, experimental design, feature engineering, predictive ...

AI Engineer

Tulsa, OK · On-site

$50K - $112K/yr

... Applying generative AI techniques, including prompt engineering, LLM evaluation, and fine-tuning ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...

... and validate Generative AI agents and data pipelines, promoting reliability, scalability, and ... Responsibilities - Apply automated testing and governance controls effectively - Analyze complex ...

next page

Showing results 1-20

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in Oklahoma?

For Generative Ai Testing jobs in Oklahoma, the most frequently searched job titles are:

Infographic showing various Generative Ai Testing job openings in Oklahoma as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 12% Part Time, 4% Contract, and 1% Nights. Highlights an 90% Physical, 2% Hybrid, and 8% Remote job distribution.

AI and Automation Lead

MIRATECH

Tulsa, OK • On-site

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted 4 days ago


Job description

Reports to: Software Development Manager
Cooperates with: Software Development, Enterprise Platforms, IT, Operations, Finance, Product, Sales, Engineering
Location: Tulsa, OK
Primary Responsibility:
Responsible for designing, building, and maintaining the organization's automation ecosystem to reduce manual and repetitive business processes, improve process reliability, and enable scalable business operations. This role partners with business and technology leaders to identify and develop workflow automations, integrations, and selected agentic / generative AI solutions that support internal teams while ensuring compliance with governance standards such as DLP, security, and approved data handling practices. This role also establishes engineering best practices, mentors developers, and helps define a roadmap for expanding automation and AI capabilities across the organization.
What You'll Do:
  • Design, build, deploy, and maintain automations for manual business processes
  • Automate approvals, routing, notifications, data movement, and exception handling across internal workflows
  • Translate business requirements into scalable automation and integration solutions
  • Develop and maintain integrations using APIs, scripting, workflow platforms, and automation tooling
  • Evaluate and implement agentic / generative AI capabilities with appropriate guardrails and human review
  • Define and prioritize AI use cases aligned to business value, while establishing frameworks for measuring AI effectiveness (ROI, accuracy, adoption)
  • Incorporate generative AI capabilities into overall automation solutions using SDKs and MCP servers, as needed
  • Establish guidelines for when the use of artificial intelligence may be required and when deterministic solutions are more appropriate
  • Establish standards for architecture, testing, monitoring, documentation, releases, and support
  • Enforce governance requirements including DLP, secure data handling, access controls, auditability, and approved tool usage
  • Monitor and continuously improve automation reliability, performance, and supportability
  • Mentor developers through design reviews, code reviews, technical coaching, and knowledge sharing
  • Partner with IT, security, and business leaders to prioritize initiatives and define a long-term automation roadmap

How to Qualify:
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent combination of education and experience
  • 10+ years of experience in software engineering, automation engineering, integrations, or related development roles
  • Experience building or supporting business workflow automations or enterprise integrations using Microsoft's Power Platform
  • Strong proficiency in Python, JavaScript/TypeScript, or similar languages
  • Experience working with APIs, web services, data transformation, and system integration patterns
  • Experience building tools using SDKs for OpenAI, Claude, Gemini, or similar models.
  • Experience integrating MCP servers into tools and workflows
  • Hands-on experience with workflow automation, orchestration, RPA, low-code platforms, or custom automation services
  • Practical experience with generative AI and agentic systems, including prompt design, tool usage, guardrails, evaluation, and human-in-the-loop workflows
  • Strong understanding of SDLC practices including version control, testing, CI/CD, documentation, and release management
  • Experience implementing security and governance controls such as DLP, access management, logging, and audit requirements
  • Strong analytical and problem-solving skills with the ability to translate business needs into technical solutions
  • Experience mentoring developers and leading technical standards across projects or teams
  • Strong communication skills for working with business stakeholders, leadership, and cross-functional technical teams

What Sets You Apart:
  • Experience responsibly applying AI in business workflows with clear governance and measurable outcomes
  • Experience working in a fast-paced, Agile environment
  • Ability to balance delivery speed, reliability, security, and governance in production systems
  • Experience coordinating with IT infrastructure, cybersecurity, enterprise platforms, and business operations
  • Experience in manufacturing, supply chain, or operations environments

How Success is Measured:
  • Reduction in manual effort / process cycle time
  • Adoption of automation solutions across teams
  • Reliability and performance of automation systems
  • Number and impact of AI-enabled workflows
  • Stakeholder satisfaction and business value delivered

What We Offer:
  • Health, Dental & Vision Insurance
  • Annual Bonus Program
  • $350 Annual Wellness Credit
  • Flexible Spending Account (FSA)
  • 401k with match up to 5%
  • Life insurance
  • Disability insurance
  • 5 days of paid sick leave annually (prorated based on start date)
  • 15 days PTO annually (prorated based on start date)

Equal Opportunity: MIRATECH is an equal opportunity employer and supports a diverse and inclusive workforce. All employment practices are based on qualification and merit, without regards to race, color, national origin, ancestry, religion, age, sex, gender identity, sexual orientation or preference, marital status or spousal affiliation, physical or mental disability, medical conditions, pregnancy, status as a protected veteran, genetic information, or citizenship within the limits imposed by federal laws and regulations.