1

Urgently Hiring Machine Learning Engineer New Grad Jobs in Raleigh, NC

Machine Learning Engineer Lead

Raleigh, NC · On-site

$99K - $131K/yr

Job Summary The Machine Learning Engineer Lead will define and lead the architecture of scalable AI/ML and agentic systems across the global product portfolio. This senior technical leadership role ...

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML ... We are committed to providing a fair and accessible hiring process. If you have a disability or ...

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML ... We are committed to providing a fair and accessible hiring process. If you have a disability or ...

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML ... We are committed to providing a fair and accessible hiring process. If you have a disability or ...

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML ... We are committed to providing a fair and accessible hiring process. If you have a disability or ...

* Own model training and post-training pipelines end to end: SFT, RLHF, PPO, DPO, and reward model training in PyTorch * Build and maintain the infrastructure around RL training: rollout collection ...

* Own model training and post-training pipelines end to end: SFT, RLHF, PPO, DPO, and reward model training in PyTorch * Build and maintain the infrastructure around RL training: rollout collection ...

* Own model training and post-training pipelines end to end: SFT, RLHF, PPO, DPO, and reward model training in PyTorch * Build and maintain the infrastructure around RL training: rollout collection ...

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML ... We are committed to providing a fair and accessible hiring process. If you have a disability or ...

* Own model training and post-training pipelines end to end: SFT, RLHF, PPO, DPO, and reward model training in PyTorch * Build and maintain the infrastructure around RL training: rollout collection ...

Senior Machine Learning Engineer

Cary, NC

$113K - $149K/yr

As a Machine Learning Engineer, you'll design and deliver production-ready AI solutions, develop ... new ideas, and turn innovation into real customer value. We're looking for engineers who are ...

New

Showing results 21-40

Urgently Hiring Machine Learning Engineer New Grad information

What does a machine learning engineer new grad do?

An entry-level Machine Learning Engineer is responsible for designing, developing, and deploying machine learning models to solve real-world problems. They work closely with data scientists, software engineers, and product teams to collect and preprocess data, select appropriate algorithms, and integrate models into production systems. New grads in this role often focus on learning industry best practices, improving model performance, and collaborating on cross-functional projects under the guidance of more senior engineers. They may also participate in code reviews, documentation, and continuous learning to stay updated with advancements in machine learning.

What are some common challenges new graduates face when starting as a machine learning engineer, and how can they overcome them?

New graduates entering Machine Learning Engineering often find it challenging to bridge the gap between academic knowledge and real-world applications, especially when dealing with large, messy datasets and ambiguous business objectives. Collaborating effectively with cross-functional teams—such as data engineers, product managers, and software developers—can also be a learning curve, as clear communication and understanding of broader project goals are essential. To overcome these challenges, new grads should seek mentorship, actively participate in code reviews, and focus on continuously improving their coding and problem-solving skills through hands-on projects. Embracing feedback and staying updated with industry best practices will also accelerate their professional growth.

What are the key skills and qualifications needed to thrive as a machine learning engineer new grad, and why are they important?

To thrive as a Machine Learning Engineer New Grad, you need a solid background in computer science, statistics, and programming (especially Python), typically supported by a relevant degree. Familiarity with machine learning frameworks (such as TensorFlow or PyTorch), cloud platforms, and version control systems is commonly required. Strong problem-solving abilities, teamwork, and effective communication help new grads excel in collaborative and fast-evolving environments. These skills ensure the ability to build, deploy, and continually improve machine learning models that solve real-world problems.

What are popular job titles related to Urgently Hiring Machine Learning Engineer New Grad jobs in Raleigh, NC?

For Urgently Hiring Machine Learning Engineer New Grad jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Urgently Hiring Machine Learning Engineer New Grad jobs in Raleigh, NC look for?

The top searched job categories for Urgently Hiring Machine Learning Engineer New Grad jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Urgently Hiring Machine Learning Engineer New Grad jobs?

Cities near Raleigh, NC with the most Urgently Hiring Machine Learning Engineer New Grad job openings:

Machine Learning Engineer Lead

Compunnel

Raleigh, NC • On-site

$99K - $131K/yr

Contractor

Posted 21 days ago


Key responsibilities

  • Define reference architectures for LLM, machine learning, and agent-based systems across products

  • Design and implement scalable AI platforms supporting large-scale distributed ML systems and enterprise AI workloads

  • Lead the deployment and optimization of LLM, Generative AI, and RAG solutions in production environments


Job description

Job Summary
The Machine Learning Engineer Lead will define and lead the architecture of scalable AI/ML and agentic systems across the global product portfolio. This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG architectures, Agentic AI frameworks, tool orchestration, and enterprise platform engineering. The role will shape long-term AI platform strategy, establish technical standards, and mentor engineering teams while supporting highly available, secure, and scalable AI systems.
Key Responsibilities
• Define reference architectures for LLM, machine learning, and agent-based systems across products.
• Design high-availability and low-latency inference platforms capable of operating at global scale.
• Establish reusable platform components for model lifecycle management, deployment, monitoring, and operationalization.
• Architect scalable AI platforms supporting large-scale distributed ML systems and enterprise AI workloads.
• Architect multi-step, reasoning-driven agentic AI systems.
• Design orchestration patterns for tool use, API invocation, and structured function calling.
• Lead the implementation and governance of Model Context Protocol (MCP) servers to standardize tool integration and context management.
• Define guardrails, permissions, security controls, and audit mechanisms for enterprise-safe AI systems.
• Establish and maintain best practices for MLOps, CI/CD, observability, scalability, and system reliability.
• Design and implement scalable inference systems using containerization and Kubernetes.
• Drive the deployment and optimization of LLM, Generative AI, and RAG solutions in production environments.
• Design cloud-based AI/ML architectures across AWS, Azure, or GCP.
• Establish technical standards and architectural patterns for AI/ML and agentic systems across engineering teams.
• Embed Responsible AI principles into platform architecture and engineering practices.
• Provide technical leadership, mentorship, and guidance to senior engineers and engineering teams.
• Collaborate with cross-functional teams to influence technical direction and ensure alignment with enterprise AI platform strategy.
• Support people management, leadership, and team development activities as required.
Required Qualifications
• 10+ years of experience building and deploying production-grade machine learning systems at scale.
• Strong experience with LLMs, Generative AI, and RAG deployments in production environments.
• Strong Python development background.
• Expertise designing and implementing AI/ML systems in cloud environments such as AWS, Azure, or GCP.
• Hands-on experience with Kubernetes, containerization, and scalable inference systems.
• Experience designing agentic AI systems and tool orchestration frameworks.
• Experience implementing and governing MCP servers or structured architectures for tool integration and context management.
• Experience with large-scale distributed ML systems and enterprise platform engineering.
• Experience establishing MLOps, CI/CD, observability, and system reliability practices.
• Demonstrated people management, technical leadership, or mentorship experience.
• Strong understanding of high-availability and low-latency AI/ML architectures.
• Ability to define technical standards and influence architecture and engineering decisions across teams.

Compunnel logo

About Compunnel

Sourced by ZipRecruiter

Compunnel is a well-known company located in Plainsboro, NJ, US, recognized in the industry of IT Services and Solutions. Established in 1989, Compunnel offers a suite of services that help businesses integrate technology efficiently into their operations, a recognizable name in the IT solutions sphere for over three decades. The company’s service portfolio includes Digital Transformation, Business Intelligence, Cloud Services, Cybersecurity, and Application Modern Services, among others. Guided by its mission "to innovate with industry-leading digital solutions and disruptive tech strategies for unimagining business growth," the company underlines its commitment to offering out-of-the-box solutions to its clients. Remarkable achievements of the company include serving more than 30 Fortune 500 companies and providing job opportunities for over 50,000 individuals.

Industry

It services

Company size

501 - 1,000 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

1994

Social media