ZipRecruiter

Log In

1

Embedded Ai Engineer Jobs in New Rochelle, NY (NOW HIRING)

Indicium AI

Forward Deployed AI Engineer

New York, NY

$180K - $240K/yr

Sitting embedded directly with client CDOs, VPs of Data, and engineering leadership, you will ... Agentic AI & Orchestration: Proven track record building and deploying production multi-agent ...

Indicium AI

Forward Deployed AI Engineer

New York, NY · On-site

$180K - $240K/yr

Sitting embedded directly with client CDOs, VPs of Data, and engineering leadership, you will ... Agentic AI & Orchestration: Proven track record building and deploying production multi-agent ...

Quantifi

AI Engineer

Manhattan, NY · On-site

$180K - $200K/yr

As our first AI Engineer, you will play a pivotal role in architecting, building, and deploying the ... Your work will directly shape how AI is embedded across the company, influencing both our current ...

Quantifi

AI Engineer

Manhattan, NY

As our first AI Engineer, you will play a pivotal role in architecting, building, and deploying the ... Your work will directly shape how AI is embedded across the company, influencing both our current ...

AI

AI Engineer - Backend [New York]

Manhattan, NY · On-site

$150 - $300/hr

Our roots remain deeply embedded in AI research, and we're channeling that scientific rigor and ... The Role As a Backend AI Engineer at Traversal, you'll play a key role in designing and building ...

New

Traversal

AI Engineer - Backend

New York, NY · On-site

$150K - $300K/yr

Our roots remain deeply embedded in AI research, and we're channeling that scientific rigor and ... The Role As a Backend AI Engineer at Traversal, you'll play a key role in designing and building ...

Traversal Inc.

AI Engineer - Backend

Manhattan, NY · On-site

$150 - $300/hr

Our roots remain deeply embedded in AI research, and we're channeling that scientific rigor and ... The Role As a Backend AI Engineer at Traversal, you'll play a key role in designing and building ...

Drata Inc

Senior AI Engineer

New York, NY · On-site +1

$114K - $157K/yr

As a Senior AI Engineer, you will own the end-to-end design, implementation, and evolution of AI-driven systems embedded directly into Drata's core platform. Your work will focus on building ...

Percepta

Applied AI Engineer

New York, NY · On-site

$150K - $400K/yr

Strategic partnerships with Anthropic, McKinsey, AWS, companies within the General Catalyst portfolio, and more Our team is a quickly growing group of Applied AI Engineers, Embedded Product Managers ...

DeepIntent

Applied AI Engineer

New York, NY

$105K - $120K/yr

Serve as the technical point of contact embedded within commercial and PMO teams, building strong ... Engineering * Hands-on experience with AI/LLM tools, including configuring and prompting models ...

Socket.dev

Agentic AI Engineer

Manhattan, NY · On-site

$155 - $215/hr

This is a Agentic AI Engineer position at the Vice President level, which is part of the job family ... Utilize generative coding assistants and LLMs embedded into applications. * Employ enterprise-grade ...

New

474 MS Services Group, Inc.

Agentic AI Engineer

Manhattan, NY · On-site

$155 - $215/hr

This is a Agentic AI Engineer position at the Vice President level, which is part of the job family ... Utilise generative coding assistants and LLMs embedded into applications. Employ enterprise‑grade ...

New

Morgan Stanley

Agentic AI Engineer

New York, NY · On-site

This is a Agentic AI Engineer position at the Vice President level, which is part of the job family ... Utilize generative coding assistants and LLMs embedded into applications. * Employ enterprise-grade ...

Traversal

AI Engineer - AI Platform

New York, NY · On-site

$150K - $300K/yr

Our roots remain deeply embedded in AI research, and we're channeling that scientific rigor and ... The Role As an AI Platform Engineer at Traversal, you'll work on the core foundations that make ...

Traversal

AI Engineer - AI Platform

Manhattan, NY · On-site

$150 - $300/hr

Our roots remain deeply embedded in AI research, and we're channeling that scientific rigor and ... The Role As an AI Platform Engineer at Traversal, you'll work on the core foundations that make ...

Meta

Embedded Software Engineer

New York, NY

$184K/yr

We embrace AI-native ways of working -- using AI tools as force multipliers to accelerate ... Embedded Software Engineer Responsibilities: * Own the design, development, and debugging of ...

Edison

Forward Deployed AI Engineer

Manhattan, NY · On-site

$140 - $180/hr

Role As a Forward Deployed AI Engineer , you'll be embedded directly with leading scientific R&D organizations across pharma and biotech - taking full ownership of how Edison's AI agents create value ...

New

previous pagenext page

Showing results 21-40

All JobsEmbedded Ai Engineer JobsEmbedded Ai Engineer Jobs in New Rochelle, NY

Embedded Ai Engineer information

See New Rochelle, NY salary details

$72K

$157.8K

$179.1K

How much do embedded ai engineer jobs pay per year?

As of Aug 21, 2026, the average yearly pay for embedded ai engineer in New Rochelle, NY is $157,841.00, according to ZipRecruiter salary data. Most workers in this role earn between $135,300.00 and $178,000.00 per year, depending on experience, location, and employer.

What is an embedded AI engineer?

An Embedded AI Engineer is a professional who designs, develops, and implements artificial intelligence (AI) algorithms and models directly onto embedded systems, such as microcontrollers or edge devices. Their work involves optimizing AI solutions to run efficiently on hardware with limited computing resources, power, and memory. They collaborate with hardware engineers and software developers to integrate machine learning, computer vision, or other AI functionalities into products like smart appliances, autonomous vehicles, or IoT devices. Their expertise helps bring intelligent features directly to devices, enabling real-time decision-making without needing constant cloud connectivity.

What are the key skills and qualifications needed to thrive as an embedded AI engineer?

To thrive as an Embedded AI Engineer, you need expertise in embedded systems, AI/ML algorithms, programming languages like C/C++ and Python, and typically a degree in computer engineering or a related field. Familiarity with development tools such as TensorFlow Lite, ONNX, embedded Linux, and microcontroller platforms is essential, along with experience deploying AI models on resource-constrained devices. Strong problem-solving, collaboration, and communication skills help you work effectively in multidisciplinary teams and address real-world challenges. These skills ensure efficient integration of AI into embedded systems, enabling innovative, high-performance solutions for edge computing.

How does an embedded AI engineer typically collaborate with hardware and software teams during a project?

Embedded AI Engineers work closely with both hardware and software teams to ensure AI models are efficiently integrated into resource-constrained devices. They often collaborate with hardware engineers to optimize model performance based on device limitations like memory and processing power. At the same time, they coordinate with software developers to design efficient firmware and manage data pipelines. Regular cross-functional meetings and code reviews are common to address integration challenges and maintain alignment throughout the project lifecycle.

What is the difference between Embedded Ai Engineer vs Machine Learning Engineer?

CriteriaEmbedded Ai EngineerMachine Learning Engineer
Required CredentialsBachelor's in Electrical Engineering, Computer Science, or related; knowledge of embedded systemsBachelor's or Master's in Computer Science, Data Science, or related; strong programming skills
Work EnvironmentEmbedded systems, IoT devices, hardware integrationData centers, cloud platforms, software development environments
Employer & Industry UsageConsumer electronics, automotive, IoT companiesTech firms, startups, research institutions
Common Search & ComparisonYesNo

Embedded Ai Engineers focus on integrating AI algorithms into embedded hardware and IoT devices, requiring knowledge of hardware constraints and embedded programming. Machine Learning Engineers develop models primarily for software applications and data analysis. While both roles involve AI, Embedded Ai Engineers specialize in hardware-software integration within embedded systems, whereas Machine Learning Engineers work on developing and deploying AI models in software environments.

What are popular job titles related to Embedded Ai Engineer jobs in New Rochelle, NY?

For Embedded Ai Engineer jobs in New Rochelle, NY, the most frequently searched job titles are:

What job categories do people searching Embedded Ai Engineer jobs in New Rochelle, NY look for?

The top searched job categories for Embedded Ai Engineer jobs in New Rochelle, NY are:

What cities near New Rochelle, NY are hiring for Embedded Ai Engineer jobs?

Cities near New Rochelle, NY with the most Embedded Ai Engineer job openings:

Embedded Ai Engineer jobs near you

Forward Deployed AI Engineer

Indicium AI

New York, NY

$180K - $240K/yr

Full-time

Medical, PTO

Posted 16 days ago

Job description

Forward Deployed Software Engineer - US / NYCAbout Indicium AI

Indicium AI was Anthropic's first European launch partner, a Preferred Anthropic Partner, and sits among a handful of organizations globally trusted to deploy Claude at an enterprise scale. Named the 2026 Databricks Consulting Partner of the Year and backed by Databricks Ventures, we build and deploy production AI systems for complex enterprises, making AI a genuine competitive advantage.

The Role

The Senior Forward Deployed AI Engineer, Data Platform & Agents bridges the gap between complex enterprise data estates (Databricks, Lakehouses, vector stores) and frontier agentic AI execution (Anthropic Claude, multi-agent frameworks, custom MCP servers). Sitting embedded directly with client CDOs, VPs of Data, and engineering leadership, you will translate messy operational workflows and fragmented data sources into production-grade multi-agent platforms, real-time context retrieval systems, and LLM evaluation architectures.

This is a high-agency "builder-consultant" role for engineers who care as much about stakeholder adoption and runtime business impact as they do about model accuracy, protocol design, and low-latency data execution.

Key Responsibilities

  • Agentic Tooling & MCP Architecture: Architect and deploy custom data interfaces and tool servers using the Model Context Protocol (MCP), function calling, and structured JSON schemas-enabling autonomous AI agents to query, synthesize, and execute actions across 10+ disparate enterprise data sources safely.

  • Enterprise Lakehouse & Retrieval Engineering: Build high-performance data pipelines, vector search, and hybrid RAG layers over Lakehouse environments (Databricks, PySpark, Delta Lake, Unity Catalog)-slashing retrieval times and optimizing CPU/GPU query runtimes over massive structured and unstructured datasets.

  • Embedded Client Execution & PoCs: Sit side-by-side with client technical teams to run daily requirements discovery, lead architecture reviews, and rapidly ship zero-to-one production Proofs of Concept (PoCs) in weeks rather than months.

  • LLM Evals, Observability & Guardrails: Implement robust evaluation frameworks (LLM evals, hallucination tracking, retrieval precision/recall) and observability pipelines to monitor non-deterministic agent behavior and guarantee reliability in strictly regulated enterprise environments (Financial Services, Healthcare).

  • Enterprise Security & Data Isolation: Collaborate with client CISO and security governance teams to enforce strict access-control lists (ACLs), multi-tenant isolation, row/column-level permissions, and zero-data-leakage constraints.

Qualifications & Experience

  • Agentic AI & Orchestration: Proven track record building and deploying production multi-agent systems, RAG platforms, and MCP servers using frameworks like LangGraph, AutoGen, or CrewAI.

  • Data Engineering & Lakehouse Depth: 5+ years of experience with Databricks, PySpark, Delta Lake, SQL, and Python-with specific expertise optimizing high-QPS analytical queries and processing unstructured enterprise documents (PDFs, contracts, logs).

  • Statistical Rigor & Model Evals: Strong foundation in quantitative methods, statistics, or applied ML (M.S./Ph.D. or equivalent industry experience) to evaluate model uncertainty, ground truth, and non-deterministic systems systematically.

  • Client-Facing / Consultative Muscle: Demonstrated ability to run technical discovery calls, manage non-technical client stakeholders, handle technical pushback, and lead co-engineering efforts on-site.

 
Why Indicium AI

  • Deep Anthropic Partnership: Work at the bleeding edge as a Preferred Anthropic Partner, with direct access to partner teams, official training, and early access to unreleased capabilities.

  • High Autonomy Culture: Sharp, high-agency teams with no middle-management layers or corporate theater.

  • Frontier-Level L&D: Generous learning budget, dedicated research time, and unencumbered access to state-of-the-art AI tools.

  • Top-Tier Benefits: Competitive pay with performance bonuses, comprehensive health coverage, generous PTO, flexible holidays, parental leave, and a paid company shutdown the last week of December.

The anticipated base salary range for this role is $180,000 - $240,000. In addition to base pay, this position may be eligible for an annual discretionary bonus. An individual's final salary offer will be determined based on a variety of factors, including geographic location, experience, specialized skills, and qualifications. This compensation range is subject to updates or modifications at the company's discretion

Apply