1

Ai Ml Software Engineer Jobs in Raleigh, NC (NOW HIRING)

USC / GC Only โœ… Must-Have Qualifications: โœ” 8-10+ years of experience in AI/ML, Software Engineering, or Cloud-Native Application Development (13+ years overall IT experience preferred) โœ” ...

Software Engineer About CoVar CoVar is a small, mission-driven AI/ML R&D software company based in Durham, NC and McLean, VA. We build advanced software and machine learning systems that help the ...

CoVar is a small, mission-driven AI/ML R&D software company based in Durham, NC. They are seeking a motivated Software Engineer to develop and maintain applications that involve data processing and ...

Sr AI/ML Engineer

Durham, NC ยท Hybrid

$180K - $220K/yr

Description The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable ... MLOps and software-engineering fundamentals. โ€ข Bachelor's or Master's in Computer Science ...

Sr AI/ML Engineer

Durham, NC ยท Hybrid

$180K - $220K/yr

Description The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable ... MLOps and software-engineering fundamentals. โ€ข Bachelor's or Master's in Computer Science ...

Senior Software Engineer

Raleigh, NC ยท Remote

$119K - $157K/yr

Design, develop, and deliver production-grade AI/ML and Generative AI solutions within the OQGA ... Strong software engineering fundamentals, including Git-based version control, CI/CD pipelines ...

Senior Software Engineer

Raleigh, NC ยท On-site

$119K - $157K/yr

Design, develop, and deliver production-grade AI/ML and Generative AI solutions within the OQGA ... Strong software engineering fundamentals, including Git-based version control, CI/CD pipelines ...

Senior AI Systems Engineer

Raleigh, NC ยท On-site +1

$92K - $126K/yr

Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems ... Bachelor's degree in CS, Software Engineering or other IT-related field or equivalent experience ...

next page

Showing results 1-20

Ai Ml Software Engineer information

See Raleigh, NC salary details

$61.7K

$143.4K

$199.8K

How much do ai ml software engineer jobs pay per year?

As of Aug 24, 2026, the average yearly pay for ai ml software engineer in Raleigh, NC is $143,405.00, according to ZipRecruiter salary data. Most workers in this role earn between $116,600.00 and $168,200.00 per year, depending on experience, location, and employer.

What is the difference between Ai Ml Software Engineer vs Data Scientist?

AspectAi Ml Software EngineerData Scientist
Required SkillsProgramming, machine learning, software developmentStatistics, data analysis, programming
Work EnvironmentSoftware development teams, tech companiesResearch labs, analytics teams
Common CertificationsMachine Learning certifications, programming coursesData Science certifications, statistical courses
Industry UsageAI product development, software solutionsData analysis, predictive modeling

While both roles involve working with data and machine learning, Ai Ml Software Engineers focus on developing and deploying AI applications and software, whereas Data Scientists primarily analyze data to extract insights and build models. The roles often overlap but differ in their core focus and daily tasks.

Are AI ML software engineers in demand?

AI ML software engineers are in high demand due to the rapid growth of artificial intelligence and machine learning applications across industries. Companies seek professionals skilled in programming languages like Python, frameworks such as TensorFlow or PyTorch, and data analysis to develop and deploy AI solutions. This demand is expected to continue as AI technology becomes increasingly integrated into products and services.

What does an AI ML Software Engineer do?

An AI ML Software Engineer designs, develops, and implements artificial intelligence and machine learning models and algorithms. They work with data preprocessing, model training, and deployment using tools like Python, TensorFlow, or PyTorch, often collaborating with data scientists and software developers to integrate AI solutions into applications.

What are popular job titles related to Ai Ml Software Engineer jobs in Raleigh, NC?

For Ai Ml Software Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What cities near Raleigh, NC are hiring for Ai Ml Software Engineer jobs?

Cities near Raleigh, NC with the most Ai Ml Software Engineer job openings:

Infographic showing various Ai Ml Software Engineer job openings in Raleigh, NC as of June 2026, with employment types broken down into 94% Full Time, 5% Part Time, and 1% Contract. Highlights an 75% Physical, 3% Hybrid, and 22% Remote job distribution, with an average salary of $143,397 per year, or $68.9 per hour.

AI Solution Lead

Northern Base

Cary, NC โ€ข On-site

Full-time

Posted 24 days ago


Job description

Role: AI Solution Lead

Location: Cary, NC (Onsite)

Employment Type: Full-Time

Visa Type: USC / GC Only

✅ Must-Have Qualifications:

✔ 8–10+ years of experience in AI/ML, Software Engineering, or Cloud-Native Application Development (13+ years overall IT experience preferred)

✔ Strong experience building and productionizing cloud-native backend services and AI/LLM inference pipelines

✔ Expertise in Python, FastAPI, asynchronous programming, and microservices architecture

✔ Hands-on experience building Agentic AI applications using LangChain and LangGraph

✔ Strong experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, vector databases, prompt engineering, and context engineering

✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time and batch inference

✔ Hands-on experience with Kubernetes, Helm, containerization, and cloud-native deployments

✔ Experience building event-driven, resilient distributed systems and API integrations

✔ Strong knowledge of CI/CD pipelines, automated testing, observability, monitoring, and Service Level Objectives (SLOs)

✔ Strong understanding of systems design including concurrency, caching, reliability, scalability, and rate limiting

✔ Experience with Azure Cloud, Azure Kubernetes Service (AKS), and managed cloud services is preferred

✔ Knowledge of model governance, model monitoring, performance tuning, and data engineering best practices

✔ Experience collaborating with cross-functional engineering, AI, and frontend teams

✔ Bachelor's Degree in Computer Science or a related field