ZipRecruiter

Log In

1

Ai Automation Testing Jobs in Colorado (NOW HIRING)

Go West IT

AI & Automation Engineer

Greenwood Village, CO · On-site

$145K - $175K/yr

As the AI & Automation Engineer, you will be a member of the MSP Team, helping transform how we ... Establish and maintain AI governance frameworks, testing standards, monitoring processes, and ...

Go West IT

AI & Automation Engineer

Greenwood Village, CO · On-site

$150 - $200/hr

As the AI & Automation Engineer, you will be a member of the MSP Team, helping transform how we ... Establish and maintain AI governance frameworks, testing standards, monitoring processes, and ...

Prologis

Senior AI Automation Engineer

Denver, CO · On-site

$107K - $140K/yr

Job Title: Senior AI Automation Engineer Company: Prologis A day in the life The Senior AI ... Experience implementing testing, evaluation, monitoring, and feedback loops for AI applications ...

Troxis

Sr.QA Automation Engineer

Denver, CO · On-site

$125 - $150/hr

The ideal candidate will have strong experience in automation testing, CI/CD integration, AI-assisted development tools, and test management platforms. This role requires hands-on expertise in ...

Centstone

QA Analyst

Denver, CO · On-site

$60 - $65/day

Quality assurance, manual testing, automation testing, API testing, or performance testing ... Experience with MCP, AI-assisted testing, or modern AI-based QA practices preferred * Bachelor ...

Prologis

AI Product Owner

Denver, CO

Partner with AI Automation Engineers, AI/ML Engineers, platform teams, and delivery partners through discovery, prototyping, build, testing, launch, adoption, and continuous improvement. Facilitate ...

Delan Associates, Inc

AI Agentic Tester

Denver, CO · On-site

$100 - $125/hr

API Testing (Postman, REST APIs, Swagger) * Python * Test Automation (Selenium / Playwright / PyTest) * AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency) * End-to-End Workflow ...

CoorsTek

AI Deployment Engineer

Golden, CO · On-site +1

... automation strategy by building, deploying, and scaling practical AI-enabled solutions. This is a ... Provide practical support on design, testing, documentation, security, supportability, and ...

CoorsTek, Inc.

AI Deployment Engineer

Golden, CO · On-site

Job Title AI Deployment Engineer The AI Deployment Engineer will support the AI and automation ... Provide strong, hands-on guidance as users participate in solution design, prototyping, testing ...

next page

Showing results 1-20

All JobsAi Automation Testing JobsAi Automation Testing Jobs in Colorado

Ai Automation Testing information

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

How to become an AI automation tester?

To become an AI automation tester, you should have a strong understanding of software testing principles, programming languages such as Python or Java, and experience with automation tools like Selenium or TestComplete. Familiarity with AI and machine learning concepts can be beneficial, along with certifications in testing or automation. Gaining hands-on experience through internships or projects is also valuable for this role.

Is AI automation testing a good career?

AI automation testing is a growing field within software quality assurance that involves using AI tools and scripting to automate test cases, increasing efficiency and coverage. It requires knowledge of programming, testing frameworks, and AI concepts, making it a valuable skill set with strong job prospects and competitive salaries.

What are popular job titles related to Ai Automation Testing jobs in Colorado?

For Ai Automation Testing jobs in Colorado, the most frequently searched job titles are:

What job categories do people searching Ai Automation Testing jobs in Colorado look for?

The top searched job categories for Ai Automation Testing jobs in Colorado are:

What cities in Colorado are hiring for Ai Automation Testing jobs?

Cities in Colorado with the most Ai Automation Testing job openings:

Ai Automation Testing jobs near you

AI & Automation Engineer

Greenwood Village, CO • On-site

Go West IT
IT Services • 11 - 50 employees
Learn more about Go West ITexternal

$145K - $175K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 11 days ago

Job description

As a leading MSSP in Colorado, Go West IT is the trusted guide to the digital frontier. Our mission is to help companies benefit from technology by expertly guiding them to opportunities and protecting them from harm. We do this by providing a team of trusted guides with the knowledge, skills, and expertise needed to navigate this constantly changing landscape. Our entire team is continually building their knowledge base, keeping us ahead of the technology curve and helping us succeed at our mission.
As the AI & Automation Engineer, you will be a member of the MSP Team, helping transform how we deliver technology services by designing, building, and maintaining AI-powered solutions and intelligent automations. This role combines traditional automation engineering with modern AI engineering to improve internal operations, increase efficiency, and enhance the client experience.
You will develop AI agents, LLM-powered workflows, automation scripts, integrations, and cloud-native solutions that eliminate repetitive work, accelerate service delivery, and enable data-driven decision making. You'll work closely with engineering, service desk, account management, and leadership teams to identify opportunities where automation and AI can deliver measurable business value.
What you can expect from us:
  • Opportunity to be an integral part of an organization on the cutting edge of AI and technical innovation
  • A fast-paced environment where every day brings new technical challenges and opportunities
  • Opportunity to research, experiment with, and implement emerging AI technologies
  • A commitment to professional development with resources to continuously learn and grow
  • Collaboration with an exceptionally talented and supportive technical team
  • Hybrid work environment
  • Company-paid events and employee recognition programs
  • Competitive annual salary range of $145,000-$175,000 and comprehensive benefits including PTO, medical, dental, vision, life, disability, and 401(k) with generous company match

What we will expect from you:
  • Consistently demonstrate Go West's Core Values
  • Passion for solving complex business problems through automation and AI
  • Strong ownership mentality with the ability to independently drive projects from concept through deployment
  • Excellent written and verbal communication skills
  • Ability to explain technical AI concepts to non-technical audiences
  • Strong analytical thinking and curiosity for emerging technologies
  • Exceptional documentation habits and commitment to maintainable code
  • Ability to prioritize multiple initiatives while managing stakeholder expectations
  • Continuous improvement mindset with enthusiasm for learning new tools and technologies

What you will be doing:
AI Engineering:
  • Design, develop, and deploy AI-powered solutions that improve internal operations and client service delivery
  • Build and maintain AI agents using Claude and other modern LLM technologies
  • Develop prompt engineering standards, reusable prompt libraries, and AI workflows
  • Create internal AI tools that increase technician productivity and automate repetitive work
  • Evaluate emerging AI technologies and recommend adoption where appropriate
  • Develop retrieval-augmented generation (RAG) solutions utilizing company documentation and knowledge bases
  • Build AI-assisted reporting, knowledge management, and operational tools
  • Establish and maintain AI governance frameworks, testing standards, monitoring processes, and security controls to ensure all AI solutions follow industry best practices and protect internal and client data throughout the AI lifecycle
  • Ensure all AI solutions follow approved governance policies, access controls, auditability requirements, and secure-by-design principles throughout the development lifecycle

Automation Engineering:
  • Develop, test, and deploy automation scripts across business systems and managed service platforms
  • Build integrations between PSA, RMM, Microsoft 365, Azure, security platforms, and other business applications
  • Develop PowerShell and API-driven automation for Windows, macOS, Linux, and cloud environments
  • Automate software deployment, monitoring, remediation, and infrastructure management
  • Improve existing automation frameworks and identify new automation opportunities across the organization

Cloud & DevOps:
  • Develop and maintain Azure Functions, Logic Apps, Automation Accounts, and other cloud-native services
  • Build and maintain CI/CD pipelines using Azure DevOps
  • Manage Git repositories, branching strategies, code reviews, and release processes
  • Maintain secure development practices including secrets management and Key Vault integration
  • Monitor production AI and automation solutions for reliability and performance

Collaboration & Innovation:
  • Partner with technical teams to identify automation opportunities
  • Work alongside leadership to prioritize AI initiatives with measurable ROI
  • Document standards, architecture, and implementation procedures
  • Participate in architecture discussions and continuous improvement initiatives
  • Research and prototype emerging AI technologies to keep Go West at the forefront of innovation

Qualifications we require from you:
  • Must be local to Colorado apply
  • 3+ years of experience developing automation solutions in a professional IT environment
  • Experience working within a Managed Services Provider (MSP) environment
  • Advanced PowerShell scripting experience
  • Strong experience building integrations using REST APIs and Microsoft Graph
  • Experience using Azure DevOps for source control, project management, and CI/CD pipelines
  • Experience using Git, branching strategies, pull requests, and modern source control practices
  • Required experience using Claude and Claude Code
  • Experience designing, deploying, and supporting solutions within Microsoft Azure
  • Strong understanding of cloud security best practices
  • Experience with Azure OpenAI and prompt engineering
  • Experience integrating AI solutions with Microsoft 365 (Teams, SharePoint, Outlook)
  • Experience with DLP policies and data governance
  • Background in business process automation or systems integration
  • Knowledge of security, compliance, and responsible AI practices
  • Experience troubleshooting complex automation and integration issues
  • Authorization to work in the United States

Preferred skills from you:
  • 5+ years of MSP experience
  • Experience building AI agents and agentic workflows
  • Experience with Model Context Protocol (MCP)
  • Experience integrating LLMs into production workflows
  • Experience with vector databases and Retrieval Augmented Generation (RAG)
  • Experience with Azure AI Services, Azure OpenAI, or similar AI platforms
  • Experience with Python in addition to PowerShell
  • Experience with Microsoft Power Platform
  • Knowledge of containerization
  • Experience with infrastructure as code
  • Familiarity with Power BI and data visualization
  • Microsoft Certified: DevOps Engineer Expert
  • AI-related certifications or equivalent demonstrated experience
  • ITIL 4 Foundation Certification

Application deadline: 8/28/2026

Apply