Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. AI Application Engineer for a ... Track, prioritize, validate, and retest defects using Azure DevOps. * AI Evaluation & Observability
Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. AI Application Engineer for a ... Track, prioritize, validate, and retest defects using Azure DevOps. * AI Evaluation & Observability
Senior XMPP DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior XMPP DevOps Engineer LOCATION: Phoenix AZ SALARY: Based on Experience SPONSORSHIP : No Responsibilities * Design and implement zero-downtime to accomplish highly available service (99.99%
Senior XMPP DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior XMPP DevOps Engineer LOCATION: Phoenix AZ SALARY: Based on Experience SPONSORSHIP : No Responsibilities * Design and implement zero-downtime to accomplish highly available service (99.99%
Senior XMPP DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior XMPP DevOps Engineer LOCATION: Phoenix AZ SALARY: Based on Experience SPONSORSHIP : No Responsibilities * Design and implement zero-downtime to accomplish highly available service (99.99%
Senior XMPP DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior XMPP DevOps Engineer LOCATION: Phoenix AZ SALARY: Based on Experience SPONSORSHIP : No Responsibilities * Design and implement zero-downtime to accomplish highly available service (99.99%
Dot Net Developer
Phoenix, AZ · On-site
$48 - $63.25/hr
Utilize Azure DevOps and Git for development and source control. * Troubleshoot and debug application issues. * Provide technical support and perform root-cause analysis. * Write clean, maintainable ...
Quick apply
Dot Net Developer
Phoenix, AZ · On-site
$48 - $63.25/hr
Utilize Azure DevOps and Git for development and source control. * Troubleshoot and debug application issues. * Provide technical support and perform root-cause analysis. * Write clean, maintainable ...
Senior Observability Operations Engineer
Phoenix, AZ · On-site
$129K - $165K/yr
Senior Observability Operations EngineerJob Overview We are seeking a highly skilled Senior ... & DevOps Experience with one or more major cloud platforms: * AWS * Microsoft Azure * Google Cloud ...
Senior Observability Operations Engineer
Phoenix, AZ · On-site
$129K - $165K/yr
Senior Observability Operations EngineerJob Overview We are seeking a highly skilled Senior ... & DevOps Experience with one or more major cloud platforms: * AWS * Microsoft Azure * Google Cloud ...
Senior DevOps Engineer
Chandler, AZ · On-site
$128K - $164K/yr
Mentors DevOps Engineers while setting/contributing to their technical skills development roadmaps, responding to impactful events or issues, and communicating action-plan to * Responds to complex ...
Senior DevOps Engineer
Chandler, AZ · On-site
$128K - $164K/yr
Mentors DevOps Engineers while setting/contributing to their technical skills development roadmaps, responding to impactful events or issues, and communicating action-plan to * Responds to complex ...
Devops Engineer
Phoenix, AZ · On-site
$52.50 - $71.75/hr
Role : Devops Engineer Location - Pheonxi AZ Duration: Long term • Must have experience working with builds and deployments of various programing languages like Java, NodeJS, Python. Nice to have ...
Devops Engineer
Phoenix, AZ · On-site
$52.50 - $71.75/hr
Role : Devops Engineer Location - Pheonxi AZ Duration: Long term • Must have experience working with builds and deployments of various programing languages like Java, NodeJS, Python. Nice to have ...
DeVOps Engineer
Phoenix, AZ · On-site
$51.25 - $70.25/hr
Role : Devops Engineer Location - phoenix AZ (5 Days onsite) Duration: Long term Contract * Must have experience working with builds and deployments of various programing languages like Java, NodeJS ...
DeVOps Engineer
Phoenix, AZ · On-site
$51.25 - $70.25/hr
Role : Devops Engineer Location - phoenix AZ (5 Days onsite) Duration: Long term Contract * Must have experience working with builds and deployments of various programing languages like Java, NodeJS ...
Azure/Databricks Infrastructure Engineer
Tempe, AZ · On-site
$53.50 - $71.25/hr
Developing infrastructure as code solutions using Terraform, Bicep, and ARM templates, and automating deployments through Azure DevOps or GitHub Actions * Supporting cloud modernization, analytics ...
Azure/Databricks Infrastructure Engineer
Tempe, AZ · On-site
$53.50 - $71.25/hr
Developing infrastructure as code solutions using Terraform, Bicep, and ARM templates, and automating deployments through Azure DevOps or GitHub Actions * Supporting cloud modernization, analytics ...
Senior Informatica Developer
Phoenix, AZ · On-site
Senior Informatica Developer Contract 6 Months (Possibility of Extension) Location: Phoenix ... Azure Devops Skills in: * Expertise in ETL data management areas such as ETL and database ...
Quick apply
Senior Informatica Developer
Phoenix, AZ · On-site
Senior Informatica Developer Contract 6 Months (Possibility of Extension) Location: Phoenix ... Azure Devops Skills in: * Expertise in ETL data management areas such as ETL and database ...
Senior DevOps Engineer-1
$129K - $165K/yr
The Senior DevOps Engineer is responsible for configuration, deployment and maintenance of the Services Delivery Platform and QTS Operating System applications. This position requires excellent ...
Senior DevOps Engineer-1
$129K - $165K/yr
The Senior DevOps Engineer is responsible for configuration, deployment and maintenance of the Services Delivery Platform and QTS Operating System applications. This position requires excellent ...
SR DevOps Engineer
Glendale, AZ · On-site
$52.50 - $71.75/hr
POSITION: SR DevOps Engineer LOCATION: Glendale, CA (Locals Only) DURATION: 3 years Top Three Skills: 1. Public Cloud Experience(AWS, Google Cloud) 2. 4+ years exp with automation tools, Chef or ...
SR DevOps Engineer
Glendale, AZ · On-site
$52.50 - $71.75/hr
POSITION: SR DevOps Engineer LOCATION: Glendale, CA (Locals Only) DURATION: 3 years Top Three Skills: 1. Public Cloud Experience(AWS, Google Cloud) 2. 4+ years exp with automation tools, Chef or ...
DevOps Engineer
Phoenix, AZ · On-site
$90K - $120K/yr
Role - DevOps Engineer Experience Required -7+ Years Must Have Technical/Functional Skills CI/CD; Docker; Git (GitHub, GitLab, BitBucket, SVN); Java; Node / Node JS; Python; Go; AWS; GCP; Kubernetes;
DevOps Engineer
Phoenix, AZ · On-site
$90K - $120K/yr
Role - DevOps Engineer Experience Required -7+ Years Must Have Technical/Functional Skills CI/CD; Docker; Git (GitHub, GitLab, BitBucket, SVN); Java; Node / Node JS; Python; Go; AWS; GCP; Kubernetes;
Developer & Infrastructure Expert - Remote
Phoenix, AZ · Remote
$30 - $80/hr
Review workflows involving GitHub, GitLab, Azure DevOps, and JIRA . * Assess AI agents and workplace connectors across tools such as Slack, Google Drive, and Microsoft 365. * Identify technical ...
Quick apply
Developer & Infrastructure Expert - Remote
Phoenix, AZ · Remote
$30 - $80/hr
Review workflows involving GitHub, GitLab, Azure DevOps, and JIRA . * Assess AI agents and workplace connectors across tools such as Slack, Google Drive, and Microsoft 365. * Identify technical ...
Director of DevOps
Arizona City, AZ · On-site
$53 - $72.75/hr
... ) initiatives across AWS, Azure, Kubernetes, and on-premises environments. This is a hands-on ... Lead DevOps, CI/CD, Release Engineering, and SRE strategy across cloud and on-prem infrastructure
New
Director of DevOps
Arizona City, AZ · On-site
$53 - $72.75/hr
... ) initiatives across AWS, Azure, Kubernetes, and on-premises environments. This is a hands-on ... Lead DevOps, CI/CD, Release Engineering, and SRE strategy across cloud and on-prem infrastructure
New
DevOps Engineer - Remote
Phoenix, AZ · Remote
$50 - $150/hr
DevOps Engineer Role Type: Contractor Location: Remote Job Overview We are seeking experienced DevOps Engineers to create and evaluate production-style infrastructure and automation tasks for next ...
Quick apply
DevOps Engineer - Remote
Phoenix, AZ · Remote
$50 - $150/hr
DevOps Engineer Role Type: Contractor Location: Remote Job Overview We are seeking experienced DevOps Engineers to create and evaluate production-style infrastructure and automation tasks for next ...
Sr Devops Engineer - 708442
Tempe, AZ · On-site
$50.50 - $69.25/hr
DevOps Engineer - Skills most likely to generate interview CI/CD AND DevOps AND Cloud AND Terraform AND Kubernetes AND Java OR Python. Green card or US Citizen Only. As a DevOps engineer, the ...
Sr Devops Engineer - 708442
Tempe, AZ · On-site
$50.50 - $69.25/hr
DevOps Engineer - Skills most likely to generate interview CI/CD AND DevOps AND Cloud AND Terraform AND Kubernetes AND Java OR Python. Green card or US Citizen Only. As a DevOps engineer, the ...
Senior Digital Product Configuration Management Engineer
Tucson, AZ · On-site
$86.80 - $165.20/hr
Senior Digital Product Configuration Management Engineer - Tucson, AZ. Position is onsite and ... Microsoft Azure DevOps Server (ADS), Git, Gitlab, Github, Jira, BitBucket, Confluence)
Senior Digital Product Configuration Management Engineer
Tucson, AZ · On-site
$86.80 - $165.20/hr
Senior Digital Product Configuration Management Engineer - Tucson, AZ. Position is onsite and ... Microsoft Azure DevOps Server (ADS), Git, Gitlab, Github, Jira, BitBucket, Confluence)
Senior Realtime DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior Realtime DevOps Engineer LOCATION : Phoenix AZ SALARY : Based on Experience SPONSORSHIP : No Responsibilities : * Design and implement zero-downtime to accomplish highly available service (99 ...
Senior Realtime DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior Realtime DevOps Engineer LOCATION : Phoenix AZ SALARY : Based on Experience SPONSORSHIP : No Responsibilities : * Design and implement zero-downtime to accomplish highly available service (99 ...
Senior Realtime DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior Realtime DevOps Engineer LOCATION : Phoenix AZ SALARY : Based on Experience SPONSORSHIP : No Responsibilities : * Design and implement zero-downtime to accomplish highly available service (99 ...
Senior Realtime DevOps Engineer
Tempe, AZ · On-site
$126K - $162K/yr
Senior Realtime DevOps Engineer LOCATION : Phoenix AZ SALARY : Based on Experience SPONSORSHIP : No Responsibilities : * Design and implement zero-downtime to accomplish highly available service (99 ...
Sr Azure Devops Engineer information
What does a Sr Azure DevOps Engineer do?
What are the key skills and qualifications needed to thrive as a Sr Azure DevOps Engineer?
What are some common challenges faced by Sr Azure DevOps Engineers when managing CI/CD pipelines in large organizations?
What is the difference between Sr Azure Devops Engineer vs Azure Cloud Engineer?
| Aspect | Sr Azure Devops Engineer | Azure Cloud Engineer |
|---|---|---|
| Certifications | Azure DevOps, Azure Solutions Architect, or similar | Azure Fundamentals, Azure Administrator, or similar |
| Work Environment | Focus on CI/CD pipelines, automation, and DevOps practices within Azure | Manage and deploy Azure cloud infrastructure and services |
| Industry Usage | Used in organizations adopting DevOps methodologies for software delivery | Used in organizations managing cloud infrastructure and migrations |
The main difference is that Sr Azure Devops Engineers specialize in implementing DevOps practices, CI/CD pipelines, and automation within Azure environments, while Azure Cloud Engineers focus on managing and deploying Azure infrastructure and services. Both roles require Azure certifications and are vital in cloud-based organizations, but their core responsibilities differ in scope and focus.
What are popular job titles related to Sr Azure Devops Engineer jobs in Arizona?
For Sr Azure Devops Engineer jobs in Arizona, the most frequently searched job titles are:
What job categories do people searching Sr Azure Devops Engineer jobs in Arizona look for?
The top searched job categories for Sr Azure Devops Engineer jobs in Arizona are:
What cities in Arizona are hiring for Sr Azure Devops Engineer jobs?
Cities in Arizona with the most Sr Azure Devops Engineer job openings:

Other
Posted 4 days ago
Job description
We are seeking an AI Engineer to help design, test, optimize, and support AI-powered agent experiences across customer and internal business workflows. This role combines prompt engineering, agent orchestration, quality assurance, evaluation framework development, and AI observability.
We use Salesforce as our CRM - someone who has used Salesforce in their techs stack (AgentForce or Einstein) would get top consideration but is not required.
The ideal candidate is curious, analytical, and hands-on, with experience working with Large Language Models (LLMs), prompt design, testing methodologies, and modern software development practices. You will partner closely with product managers, software engineers, architects, and business stakeholders to improve agent behavior, reliability, accuracy, and user experience.
Responsibilities :
- Prompt Engineering & Agent Design
- Design, develop, and iterate on AI agent logic for business use cases.
- Create, test, and optimize prompts, system instructions, tools, and workflows to improve agent performance.
- Conduct prompt experiments and A/B testing to measure effectiveness.
- Analyze agent responses and refine prompting strategies for accuracy, consistency, groundedness, and user satisfaction.
- Document prompt patterns, reasoning frameworks, reusable templates, and agent design decisions.
- Collaborate with engineering teams to deploy prompt and agent updates through established SDLC processes.
- AI Quality Assurance & Testing
- Design and execute comprehensive test plans covering AI agents, web applications, APIs, and backend services.
- Develop evaluation frameworks and scoring methodologies for AI output quality.
- Create test cases covering:
- Accuracy
- Hallucination detection
- Safety
- Tone and style adherence
- Instruction following
- Context retention
- Response consistency
- Perform regression testing for prompt and model changes.
- Track, prioritize, validate, and retest defects using Azure DevOps.
- AI Evaluation & Observability
- Utilize Arize or similar observability platforms to monitor model and agent performance.
- Analyze user interactions and evaluation results to identify trends and improvement opportunities.
- Develop quality metrics and dashboards for:
- Accuracy
- Relevance
- Latency
- User satisfaction
- Defect rates
- Prompt performance
- Investigate production issues and recommend prompt, workflow, or architectural improvements.
- Software Engineering & Integration
- Support integration of AI capabilities into enterprise applications and workflows.
- Collaborate with developers to validate API integrations, retrieval pipelines, and agent workflows.
- Assist in CI/CD deployment and release validation activities using Azure DevOps.
- Create and maintain automated testing assets where appropriate.
- Documentation & Collaboration
- Maintain documentation for prompts, evaluation methodologies, testing procedures, and agent configurations.
- Participate in sprint planning, backlog refinement, and Agile ceremonies.
- Communicate findings and recommendations to technical and non-technical stakeholders.
- Share best practices and lessons learned across the team.
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 5-10 years of experience in software engineering, QA engineering, automation testing, business systems analysis, or related technical roles.
- 1+ years of hands-on experience with Generative AI, LLMs, prompt engineering, or conversational AI solutions.
- Experience working with Azure DevOps or similar Agile delivery platforms.
- Experience designing and executing structured test plans.
- Strong analytical and troubleshooting skills.
- Experience working with APIs and JSON data structures.
- Excellent written and verbal communication skills.
- Technical Skills
- AI & GenAI
- Prompt Engineering
- Agent Design
- AI Evaluation Frameworks
- RAG Concepts
- LLM Testing
- AI Quality Assurance
- AI Observability
- Prompt Optimization
- Tools
- Arize AI
- Azure DevOps
- Azure OpenAI
- Git
- Postman
- Jira (optional)
- Power BI (optional)
- Development
- Python
- SQL
- REST APIs
- JSON
- Test Automation Frameworks
- AI & GenAI
- Experience with Arize AI or comparable AI observability tools.
- Experience with Azure OpenAI, OpenAI, Anthropic, Gemini, or other LLM platforms.
- Knowledge of Retrieval-Augmented Generation (RAG) architectures.
- Experience evaluating AI systems using human and automated scoring methods.
- Familiarity with vector databases and semantic search.
- Experience creating automated test frameworks.
- Understanding of responsible AI principles and AI governance.
- Experience with Python, SQL, JavaScript, or C#.
- Knowledge of prompt versioning and experimentation practices.
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy
#LI-SL1
About Software Guidance & Assistance
Sourced by ZipRecruiter
Industry
Health care and social assistance
Company size
51 - 200 Employees
Headquarters location
Tarrytown, NY, US