ZipRecruiter

Log In

1

Ai Ml Software Engineer Jobs in Raleigh, NC (NOW HIRING)

Northern Base

AI Solution Lead

Cary, NC · On-site

USC / GC Only ✅ Must-Have Qualifications: ✔ 8-10+ years of experience in AI/ML, Software Engineering, or Cloud-Native Application Development (13+ years overall IT experience preferred) ✔ ...

New

CoVar

Software Engineer

Durham, NC

Software Engineer About CoVar CoVar is a small, mission-driven AI/ML R&D software company based in Durham, NC and McLean, VA. We build advanced software and machine learning systems that help the ...

CoVar

Software Engineer

Durham, NC · On-site

CoVar is a small, mission-driven AI/ML R&D software company based in Durham, NC. They are seeking a motivated Software Engineer to develop and maintain applications that involve data processing and ...

Tihinsurance

AI/ML Developer

Morrisville, NC · On-site

As a Data engineer - AI / ML Developer the associate is required to architect AI and ML infrastructure. * Develop and integrate AI and data using Databricks and other AI tools to provide business ...

CRC Group

AI/ML Developer

Morrisville, NC · On-site

As a Data engineer - AI / ML Developer the associate is required to architect AI and ML infrastructure. * Develop and integrate AI and data using Databricks and other AI tools to provide business ...

Google

Smart NIC Software Engineer, Embedded

Durham, NC · On-site

$127K - $167K/yr

As a software engineer, you will work on a specific project critical to Google's needs with ... Develop next generation AI/ML Networking solutions as well as Smart NICs at Google, taking the ...

Berriehill Research

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems ... Bachelor's degree in CS, Software Engineering or other IT-related field or equivalent experience ...

next page

Showing results 1-20

All JobsAi Ml Software Engineer JobsAi Ml Software Engineer Jobs in Raleigh, NC

Ai Ml Software Engineer information

See Raleigh, NC salary details

$61.7K

$143.4K

$199.8K

How much do ai ml software engineer jobs pay per year?

As of Aug 2, 2026, the average yearly pay for ai ml software engineer in Raleigh, NC is $143,397.00, according to ZipRecruiter salary data. Most workers in this role earn between $116,600.00 and $168,200.00 per year, depending on experience, location, and employer.

What engineers make $500,000?

Senior AI/ML software engineers with extensive experience, advanced skills in deep learning, and proficiency in tools like TensorFlow or PyTorch can earn $500,000 or more annually, especially in high-cost-of-living areas or within top tech companies. Achieving this level often requires a combination of technical expertise, leadership roles, and sometimes stock options or bonuses.

What are some common challenges AI/ML Software Engineers face when deploying machine learning models to production?

AI/ML Software Engineers often encounter challenges such as ensuring model scalability, managing data pipelines, and maintaining model performance over time. Transitioning from prototype to production requires close collaboration with DevOps and data engineering teams to integrate models into existing systems. Additionally, monitoring models for drift and retraining them with new data is crucial to ensure they continue delivering accurate results. Addressing these challenges effectively requires solid software engineering practices and a proactive approach to cross-functional teamwork.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position such as a senior AI/ML engineer or research scientist with extensive experience, advanced skills in machine learning frameworks, and often leadership responsibilities. Such roles usually require a strong educational background, specialized certifications, and may include bonuses or stock options that contribute to the total compensation. These positions are rare and generally found in large tech companies or innovative startups at the forefront of AI development.

Are AI ML engineers in demand?

AI ML engineers are in high demand due to the rapid growth of artificial intelligence and machine learning applications across industries. Companies seek professionals skilled in programming, data analysis, and frameworks like TensorFlow or PyTorch to develop and deploy AI solutions, leading to strong job growth and competitive salaries in this field.

How much do AI ML engineers get paid?

AI ML software engineers typically earn between $80,000 and $150,000 annually, with salaries increasing for those with advanced skills, certifications, or experience in specialized tools like TensorFlow or PyTorch. Entry-level positions may start lower, while senior roles or those in high-demand industries can pay significantly more.

What are the key skills and qualifications needed to thrive as an AI/ML Software Engineer, and why are they important?

To thrive as an AI/ML Software Engineer, you need a strong foundation in computer science, mathematics (especially statistics and linear algebra), and proficiency in programming languages such as Python or Java, often supported by a relevant degree. Experience with machine learning frameworks (like TensorFlow or PyTorch), cloud platforms, and familiarity with data management tools or certifications in AI/ML are typically required. Critical thinking, problem-solving, and effective communication are essential soft skills for collaborating on complex projects and explaining technical concepts. These skills and qualities are vital to successfully design, develop, and deploy intelligent systems that solve real-world problems.

What is the difference between Ai Ml Software Engineer vs Data Scientist?

AspectAi Ml Software EngineerData Scientist
Required SkillsProgramming, machine learning, software developmentStatistics, data analysis, programming
Work EnvironmentSoftware development teams, tech companiesResearch labs, analytics teams
Common CertificationsMachine Learning certifications, programming coursesData Science certifications, statistical courses
Industry UsageAI product development, software solutionsData analysis, predictive modeling

While both roles involve working with data and machine learning, Ai Ml Software Engineers focus on developing and deploying AI applications and software, whereas Data Scientists primarily analyze data to extract insights and build models. The roles often overlap but differ in their core focus and daily tasks.

What are AI/ML Software Engineers?

AI/ML Software Engineers are professionals who design, develop, and implement artificial intelligence (AI) and machine learning (ML) models and systems. They work with large datasets, build algorithms, and use programming languages such as Python or Java to create intelligent applications. Their responsibilities often include data preprocessing, model training, evaluation, and deployment. AI/ML Software Engineers collaborate with data scientists and other engineers to integrate machine learning capabilities into software products. They are essential in fields like healthcare, finance, and technology, where AI-driven solutions are increasingly important.
What are popular job titles related to Ai Ml Software Engineer jobs in Raleigh, NC? For Ai Ml Software Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Ai Ml Software Engineer jobs in Raleigh, NC look for? The top searched job categories for Ai Ml Software Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Ai Ml Software Engineer jobs? Cities near Raleigh, NC with the most Ai Ml Software Engineer job openings:
Ai Ml Software Engineer jobs near you
Infographic showing various Ai Ml Software Engineer job openings in Raleigh, NC as of June 2026, with employment types broken down into 94% Full Time, 5% Part Time, and 1% Contract. Highlights an 75% Physical, 3% Hybrid, and 22% Remote job distribution, with an average salary of $143,397 per year, or $68.9 per hour.

AI Solution Lead

Northern Base

Cary, NC • On-site

Full-time

Posted 3 days ago

New

Job description

Role: AI Solution Lead

Location: Cary, NC (Onsite)

Employment Type: Full-Time

Visa Type: USC / GC Only

✅ Must-Have Qualifications:

✔ 8–10+ years of experience in AI/ML, Software Engineering, or Cloud-Native Application Development (13+ years overall IT experience preferred)

✔ Strong experience building and productionizing cloud-native backend services and AI/LLM inference pipelines

✔ Expertise in Python, FastAPI, asynchronous programming, and microservices architecture

✔ Hands-on experience building Agentic AI applications using LangChain and LangGraph

✔ Strong experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, vector databases, prompt engineering, and context engineering

✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time and batch inference

✔ Hands-on experience with Kubernetes, Helm, containerization, and cloud-native deployments

✔ Experience building event-driven, resilient distributed systems and API integrations

✔ Strong knowledge of CI/CD pipelines, automated testing, observability, monitoring, and Service Level Objectives (SLOs)

✔ Strong understanding of systems design including concurrency, caching, reliability, scalability, and rate limiting

✔ Experience with Azure Cloud, Azure Kubernetes Service (AKS), and managed cloud services is preferred

✔ Knowledge of model governance, model monitoring, performance tuning, and data engineering best practices

✔ Experience collaborating with cross-functional engineering, AI, and frontend teams

✔ Bachelor's Degree in Computer Science or a related field