1

Associate Ai Engineer Jobs (NOW HIRING)

Associate AI Engineer Innovative Defense Technologies (IDT), provider of cutting-edge cloud-based integration, automated testing and data analysis for complex, mission-critical systems in the US ...

Associate AI Engineer Innovative Defense Technologies (IDT), provider of cutting-edge cloud-based integration, automated testing and data analysis for complex, mission-critical systems in the US ...

Associate AI Engineer

Boston, MA · On-site

$80K - $134K/yr

The Associate AI Engineer will join the AI team supporting the Long-Term Care program in John Hancock and Manulife . This role will contribute to building, deploying, and maintaining AI solutions ...

Associate AI Engineer

Boston, MA · Hybrid

$80K - $134K/yr

The Associate AI Engineer will join the AI team supporting the Long-Term Care program in John Hancock and Manulife . This role will contribute to building, deploying, and maintaining AI solutions ...

KPMG is currently seeking an Associate, AI Engineer to join our Consulting practice. Responsibilities: * Develop GenAI / LLM applications and integrations using foundational models under the guidance ...

As an Associate Software Engineer, you will contribute to the modernization of business-critical ... AI-Assisted Workflows * Create clear prompts, task definitions, and acceptance criteria to ...

New

Associate - AI Engineer

Austin, TX · On-site

$88K - $94K/yr

As an Associate Software Engineer, you will contribute to the modernization of business-critical ... AI-Assisted Workflows * Create clear prompts, task definitions, and acceptance criteria to ...

New

KPMG is currently seeking an Associate, AI Engineer to join our Advisory Services practice. Responsibilities: * Develop GenAI / LLM applications and integrations using foundational models under the ...

next page

Showing results 1-20

Associate Ai Engineer information

See salary details

$41.5K

$82.6K

$132K

How much do associate ai engineer jobs pay per year?

As of Jun 9, 2026, the average yearly pay for associate ai engineer in the United States is $82,636.00, according to ZipRecruiter salary data. Most workers in this role earn between $65,500.00 and $95,000.00 per year, depending on experience, location, and employer.

What does an Associate AI Engineer do?

An Associate AI Engineer assists in designing, developing, and implementing artificial intelligence models and applications. They typically work under the guidance of senior engineers to build machine learning algorithms, preprocess data, and test AI solutions. Their responsibilities often include writing code, evaluating model performance, and collaborating with data scientists and software developers. This entry-level role provides hands-on experience in AI technologies and helps build a foundation for more advanced engineering positions.

What are the key skills and qualifications needed to thrive as an Associate AI Engineer, and why are they important?

To thrive as an Associate AI Engineer, you need a solid understanding of programming (especially Python), mathematics (linear algebra, probability, statistics), and foundational machine learning concepts, often supported by a degree in computer science or a related field. Familiarity with tools and frameworks like TensorFlow, PyTorch, scikit-learn, and experience with cloud platforms such as AWS or Google Cloud are typically required. Strong problem-solving abilities, effective communication, and a willingness to learn new technologies help distinguish top performers in this role. These skills and qualities are essential for successfully developing, implementing, and maintaining AI solutions in a collaborative and rapidly evolving environment.

What is the difference between Associate Ai Engineer vs Data Scientist?

AspectAssociate Ai EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; some certificationsBachelor's or higher in CS, Statistics, or related; often advanced degrees
Work EnvironmentTech companies, startups, R&D teams; focus on AI model developmentResearch labs, tech firms, finance; focus on data analysis and modeling
Employer & Industry UsageAI-focused roles in tech, healthcare, financeData analysis across industries like marketing, finance, healthcare

Associate Ai Engineers typically focus on developing and implementing AI models, often working closely with data and algorithms. Data Scientists analyze large datasets to extract insights and build predictive models. While both roles require programming skills and a background in data or AI, Associate Ai Engineers are more involved in the technical development of AI systems, whereas Data Scientists focus on data analysis and interpretation.

What are some common challenges an Associate AI Engineer may face when working on real-world machine learning projects?

As an Associate AI Engineer, you may encounter challenges such as handling imperfect or limited datasets, balancing model performance with computational constraints, and integrating AI solutions into existing products. Collaboration with data scientists, software engineers, and product managers is crucial to refine objectives and ensure technical feasibility. Additionally, keeping up with evolving AI frameworks and best practices can be demanding, but it provides valuable learning opportunities and skill growth.
More about Associate Ai Engineer jobs
What cities are hiring for Associate Ai Engineer jobs? Cities with the most Associate Ai Engineer job openings:
What are the most commonly searched types of Ai Engineer jobs? The most popular types of Ai Engineer jobs are:
What states have the most Associate Ai Engineer jobs? States with the most job openings for Associate Ai Engineer jobs include:
Infographic showing various Associate Ai Engineer job openings in the United States as of May 2026, with employment types broken down into 1% As Needed, 83% Full Time, 13% Part Time, 1% Temporary, and 2% Contract. Highlights an 97% Physical, 1% Hybrid, and 2% Remote job distribution, with an average salary of $82,636 per year, or $39.7 per hour.
Associate AI Engineer

Associate AI Engineer

Navstar

Mount Laurel, NJ

Other

Retirement, PTO

Posted 13 days ago


Job description

Associate AI Engineer

Innovative Defense Technologies (IDT), provider of cutting-edge cloud-based integration, automated testing and data analysis for complex, mission-critical systems in the US Department of Defense (DOD), is seeking an Associate AI Engineer to be part of our Warfare Systems team and based out of our Arlington, VA or Mt. Laurel, NJ location.

The Associate AI Engineer will design and deliver engineering-focused AI solutions that move beyond demos into reliable, mission-relevant systems. This role is ideal for an early-career engineer who is strong in Python, excited by LLMs and autonomous agents, and motivated to build end-to-end capabilities including MCP integrations, RAG pipelines, tool-using agents, and production-grade AI workflows.

Clearance & Location Requirements:

  • All applicants must be able to obtain/maintain an active Secret U.S. Security Clearance.
  • This is an on-site position. Requiring at least 3 days in office, based out of our Arlington, VA or Mt. Laurel, NJ location.

What You Will Do:

  • Design and Build AI Solutions: Design and implement end-to-end agentic AI systems that support planning, reasoning, tool use, and multi-step execution in real-world environments. Build modular, testable components that move from prototype to operational capability.
  • Integrate Models and Tools: Develop integrations across LLMs, APIs, data sources, and Model Context Protocol (MCP) interfaces to enable intelligent agents to interact with external systems, retrieve context, and take action safely and reliably.
  • Develop Retrieval Pipelines: Build and optimize Retrieval-Augmented Generation (RAG) pipelines that connect models to live knowledge sources, structured data, and enterprise content to improve factual grounding, contextual relevance, and response quality.
  • Engineer Conversational and Agentic Interfaces: Create conversational systems and intelligent agents with memory, contextual awareness, adaptive decision-making, and support for multi-turn user and system interactions.
  • Implement and Evaluate AI Workflows: Translate technical objectives into working pipelines, run experiments, evaluate agent behavior, and iterate on prompts, orchestration logic, retrieval quality, and system performance to improve reliability and usability.
  • Scope and Define Requirements: Gather, document, and validate technical and functional requirements from project artifacts, stakeholders, and mission needs to ensure feasibility, completeness, and alignment with operational goals.
  • Collaborate Across Teams: Work closely with engineers, technical leads, and mission stakeholders to integrate AI capabilities into broader software and system architectures. Participate in technical reviews, design discussions, and delivery planning.
  • Support Technical Quality: Contribute to testing, debugging, and performance optimization of AI-enabled applications, including edge cases involving context management, retrieval failures, tool execution, and orchestration logic.
  • Learn and Apply Emerging Practices: Stay current on advances in LLMs, agent frameworks, orchestration methods, and applied AI engineering practices, and bring that knowledge into practical system design and implementation.
  • Communicate Technical Work: Clearly document architectures, workflows, assumptions, and implementation decisions so that solutions are maintainable, explainable, and transferable across teams.

Who You Are (Required):

  • Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, Data Science, Applied Mathematics, Artificial Intelligence, or a related technical field, or equivalent full-time professional experience
  • 0–3 years of full-time professional experience in software engineering, machine learning engineering, AI engineering, or related technical roles
  • Ability to travel up to 10% of the time as needed
  • Proficiency in Python, including experience with core libraries such as NumPy and Pandas
  • Experience building software with one or more modern AI/ML frameworks such as PyTorch, TensorFlow, LangChain, LangGraph, Semantic Kernel, or AutoGen
  • Familiarity with Large Language Models (LLMs), prompt engineering, agent orchestration, or conversational AI systems
  • Familiarity with retrieval systems, vector databases, embeddings, or RAG-based application design
  • Understanding of software engineering fundamentals, including version control, testing, debugging, and writing maintainable code
  • Ability to work independently on technical tasks while collaborating effectively in a team environment
  • Strong problem-solving skills, curiosity, and a builder mindset focused on turning ideas into working systems

What Makes You Stand Out:

  • Experience building agentic AI systems that use tools, memory, planning, or multi-step execution
  • Familiarity with Model Context Protocol (MCP) integrations or similar model-to-tool integration patterns
  • Experience deploying AI services, APIs, or workflows in cloud or production environments
  • Experience with vector databases, retrieval infrastructure, knowledge graph integration, or enterprise search
  • Exposure to evaluation methods for LLMs and agents, including reasoning quality, hallucination reduction, tool-use reliability, and retrieval performance
  • Experience with Docker, REST APIs, Git-based development workflows, or CI/CD pipelines
  • Experience working on defense, government, or other mission-oriented technical programs
  • Strong interest in building practical AI systems that must operate reliably in complex, real-world environments

If you see yourself reflected in this role and are excited about the impact you could make, we encourage you to apply! If you know someone who may be a great fit, please feel free to share this opportunity with your network.

Pay Range*: $74,000 - $116,000 or $90,000 - $150,000. This amount may not be reflective of actual compensation that may be earned as pay is dependent on a candidate's experience, skills, and education. The posted range does not include bonuses, commissions, tips, or other benefits. IDT is often looking to place multiple candidates at various levels. Therefore, more than one pay range has been included, commensurate with experience. *Pursuant to New Jersey Senate Bill 2310 IDT is required to disclose the "pay scale" or "pay range" associated with a job posting. Notably, however, this amount may not be reflective of actual compensation that may be earned as pay is dependent on a candidate's experience, skills, and education. The posted range does not include bonuses, commissions, tips, or other benefits.

About Innovative Defense Technologies (IDT): Innovative Defense Technologies (IDT) is a leading defense technology company focused on rapidly delivering mission-critical software and systems solutions to the U.S. government. The company specializes in automation, digital engineering, and enabling the rapid integration of advanced capabilities into complex weapon and combat systems. These essential solutions empower the warfighter to field, operate, and sustain decisive capability at speed and scale.

At IDT, our employees are developing advanced mission-critical outcomes by consistently delivering high-quality results, fostering innovation, applying rigorous problem-solving, and effectively collaborating across multifaceted teams and stakeholders. Grounded in these competencies, IDT translates complex customer priorities into robust software solutions.

Why Work at Innovative Defense Technologies (IDT): IDT is a growing company with a vibrant, entrepreneurial culture. We are headquartered in Arlington, VA with additional offices in Fall River, MA; Mount Laurel, NJ; and San Diego, CA. At each location, our employees work together in a modern, snack-filled, and social office space, designing innovative solutions for our defense industry customers. We offer employees competitive pay and benefits including:

  • Generous benefits package
  • Competitive PTO
  • Paid holidays
  • 401(k) with immediate vesting and matching
  • 9/80 optional schedule (2nd and 4th Friday off every month)
  • Tuition Assistance Reimbursement Program
  • Professional Development Resources
  • Pre-Tax Commuter Benefits
  • Organization-Wide Monthly Tech Connect Events
  • Annual Employee Recognition Awards
  • Regular Social Events and Catered Lunches

EEO Statement: IDT is an Equal Opportunity employer.