Llm Jobs in Raleigh, NC (NOW HIRING)

Top Skills' Details• Microsoft Foundry (Azure AI Foundry) hands-on experience with the model catalog, Foundry Agent Service, evaluation, and deployment.

• Azure AI production experience with Azure AI services / Azure OpenAI and LLM/RAG architectures.

• MCP, RAG & LLMs demonstrated experience with the Model Context Protocol (MCP), retrieval-augmented generation, and prompt engineering.

• Microsoft Fabric & One Lake experience grounding AI on governed Fabric/One Lake data (Lakehouse, Direct Lake, shortcuts).

• MLOps CI/CD, monitoring, evaluation, and cost management; strong Python.

Description

The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable internal capability by combining ML engineering, GenAI integration, and prompt engineering into one Senior role. Using Microsoft Foundry, formerly Azure AI Foundry, and the broader Azure AI stack—grounded in governed Microsoft Fabric and One Lake data—this role builds, deploys, monitors, and continuously improves production AI features such as search, personalization, content generation, and internal copilots, reducing reliance on high-cost consulting. The role may initially be proven through consulting support and then internalized once the approach is established.

ESSENTIAL FUNCTIONS:

Production of AI Capability

• Build and deploy production AI features; search, personalization, content generation, and internal copilots on Microsoft Foundry (Azure AI Foundry).

• Implement LLM and RAG solutions grounded in governed One Lake data, using the Model Context Protocol (MCP) to connect models to data and tools.

• Develop and tune prompts, retrieval strategies, and agent workflows via the Foundry Agent Service and model catalog.

MLOps Foundation

• Establish deployment, monitoring, evaluation, and cost-management practices around AI projects — recognizing AI products require continual refinement, not set-and-forget delivery.

• Implement CI/CD for AI artifacts, prompt/model versioning, and automated evaluation.

• Partner with data engineering to keep Fabric/One Lake data AI-ready.

Risk Management & Guardrails

• Implement guardrails, prompt-injection defenses, output validation, and PII handling.

• Ensure technical controls stay aligned with Richemont’s requirements and policies.

• Document responsible-AI practices and model evaluations.

Collaboration & Mentorship

• Work under AI Engineering Manager and partner with data science and data engineering on shared infrastructure.

• Mentor junior engineers and contribute to the AI/ML specialization pathway.

Skills

Foundry, Azure OpenAI, LLM, RAG, Model Context Protocol (MCP), MLOps, Azure AI Services, microsoft fabric, python, CI/CD, OneLake

Top Skills Details

Foundry,Azure OpenAI,LLM,RAG,Model Context Protocol (MCP),MLOps

Additional Skills & Qualifications

• 5+ years in ML/AI engineering, with production generative-AI delivery (RAG, copilots, search, or personalization).

• Hands-on Microsoft Foundry / Azure AI Foundry and Azure AI experience strongly preferred.

• Experience with MCP, RAG, and LLM integration; strong prompt-engineering skills.

• Familiarity with Microsoft Fabric / One Lake and governed data foundations.

• Strong Python; solid MLOps and software-engineering fundamentals.

• Bachelor’s or Master’s in Computer Science, Machine Learning, or related field; relevant Azure AI certifications a plus.

Experience Level

Expert Level

This is a Permanent position based out of Durham, NC.

The pay range for this position is $180000.00 - $220000.00/yr.

Peter Millar provides a competitive corporate benefits package centered around comprehensive health coverage, unique apparel perks, and financial wellness

This is a hybrid position in Durham,NC.

This position is anticipated to close on Aug 19, 2026.

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.

Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.