Senior Microsoft CoPilot Studio And Azure AI/Foundry Support Engineer
The City of Phoenix is seeking a senior-level resource to analyze, stabilize, and modernize an existing Copilot Studio implementation that includes approximately 600 topics and extend it using Azure AI/Foundry. This is not a net-new build. This role requires experience cleaning up and improving an existing, large-scale Copilot Studio implementation. Key responsibilities include:
- Review and analyze the existing Copilot Studio Agent with 600 topics to identify:
- Redundant or overlapping topics
- Gaps where generative or RAG approaches would improve quality
- Performance issues or routing inefficiencies
- Implement Azure AI/Foundry enhancements, potentially including:
- Cognitive Search with embeddings
- Custom RAG endpoints
- Function/tool calling for deeper reasoning
- Conversion of static topics to grounded generative versions
- Build new advanced capabilities such as:
- Summarization
- Advanced query understanding
- Context persistence across long conversations
- Multi-step reasoning via Azure AI orchestration
- Improve grounding to our website and internal documents, replacing older GPT‐4 website ingestion with newer Azure AI methods for higher accuracy and control.
- Deliver a scalable Copilot architecture that internal teams can maintain after handoff.
- Document all enhancements and provide troubleshooting playbooks.
Required Skills: Strong knowledge of the Microsoft CoPilot Studio and Azure AI/Foundry platforms. Problem-solving, communication, and organizational skills are essential.
- 2–3+ years building or integrating LLM-based solutions in Azure
- Production-level Copilot Studio or Azure AI/Foundry deployments, ideally at enterprise scale
- Hands‐on RAG solutions with Cognitive Search (index design, chunking, enrichment)
- Strong prompt engineering, testing frameworks, and evaluation methodologies
- Ability to act as a technical lead, guiding solution architecture and mentoring internal teams
This role is vital for taking the city's current public-facing chatbot/virtual assistant to the next level and identify additional areas where new agents can assist with other city-owned public websites as well as internal intranet and Teams sites.
