ZipRecruiter

Log In

2

Remote Rag Jobs in Manhattan, NY (NOW HIRING)

Arc

Senior Staff Engineer, AI

New York, NY · On-site +1

$180K - $300K/yr

Open to exceptional Remote candidates Employment Type: Full-Time Hiring Manager: Andrew Rosen, Head ... RAG systems * State-of-the-art model leveraging techniques * Optimize for inference performance ...

Contech Systems, Inc.

AI Process Engineer

Newark, NJ · Remote

This predominantly remote role focuses on transforming business workflows through process ... Familiarity with Generative AI concepts such as agents, RAG, and tool calling. * Proficiency in ...

Precision Technologies Corp

Data Scientist

New York, NY · Remote

$130K - $135K/yr

Role: Data Scientist Location: Remote, however travel might be required as per business ... RAG) * Exposure to Agentic AI concepts, such as autonomous agents, tool usage, planning, memory ...

Inizio Partners Corp

Lead AI Engineer

New York, NY · Remote

$112K - $147K/yr

Lead AI & Analytics Engineer US Remote * Experience: 6-9 years * AI experience is a must (agentic AI, LangChain, RAG, chatbots, etc.) and should clearly demonstrate hands-on projects or at least 1-2 ...

Drata Inc

Staff Applied AI Engineer

New York, NY · On-site +1

We'll consider remote candidates across the U.S. who are a strong match for the role. What you'll do: * Design and evaluate information access + reasoning strategies across RAG, agents, and classic ...

Consumer Reports

Software Engineer - Product

Yonkers, NY · On-site +1

$120K - $140K/yr

... Generation (RAG) application. This individual will play a crucial role in building intelligent ... This is a remote position. This position is not eligible for sponsorship or relocation assistance.

Avantos

Senior Data and Platform Engineer

New York, NY · On-site +1

$116K - $157K/yr

Senior Data & Platform Engineer NYC (Hybrid) or US Remote | Competitive + Equity About Avantos ... LLMs / RAG, vector search, fintech or regulated systems * Have startup or early-stage experience.

Pryon

Solutions Architect

New York, NY · Remote

$64.50 - $85/hr

Now we're building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG ... Benefits for Full Time Employees: - Remote first organization - 100% Company paid Health/Dental ...

next page

Showing results 1-20

All JobsRag JobsRemote Rag JobsRemote Rag Jobs in Manhattan, NY

Remote Rag information

See Manhattan, NY salary details

$19

$23

$26

How much do remote rag jobs pay per hour?

As of Jun 11, 2026, the average hourly pay for remote rag in Manhattan, NY is $23.73, according to ZipRecruiter salary data. Most workers in this role earn between $19.90 and $25.19 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote Rag, and why are they important?

I'm sorry, but 'Remote Rag' does not appear to be a recognized professional occupation. Please provide a valid job title.

What is a Remote RAG (Retrieval-Augmented Generation) specialist?

A Remote RAG specialist is a professional who works with Retrieval-Augmented Generation (RAG) systems, typically in the field of artificial intelligence and machine learning. RAG combines traditional information retrieval techniques with generative models like large language models to provide more accurate and contextually relevant answers to user queries. Remote RAG specialists often build, fine-tune, and maintain these systems while working from a remote location. They may also work on integrating RAG models into applications, improving retrieval accuracy, and customizing outputs based on user needs.

What are some common challenges faced by professionals working in a remote RAG (Responsible AI Governance) role?

Professionals in remote RAG roles often encounter challenges related to cross-functional collaboration and maintaining clear communication, especially when working across different time zones. Ensuring alignment on ethical AI standards and compliance requirements can be complex, as it typically involves coordinating with data scientists, legal teams, and business stakeholders. Staying current with evolving regulatory frameworks and best practices in AI governance is also essential, demanding continuous learning and adaptability. Building trust and rapport within a remote team can require extra effort, but leveraging digital collaboration tools and regular check-ins can help mitigate these challenges.
What are popular job titles related to Remote Rag jobs in Manhattan, NY? For Remote Rag jobs in Manhattan, NY, the most frequently searched job titles are:
What job categories do people searching Remote Rag jobs in Manhattan, NY look for? The top searched job categories for Remote Rag jobs in Manhattan, NY are:
What cities near Manhattan, NY are hiring for Remote Rag jobs? Cities near Manhattan, NY with the most Remote Rag job openings:
Remote Rag jobs near you

Associate AI Engineer

GREATER NEW YORK MUTUAL INSURANCE COMPANY

Edison, NJ • Remote

$69K - $124K/yr

Other

Posted 17 days ago

Job description

Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.

Position Summary: The position is responsible for designing, building, deploying, and maintaining enterprise-grade Agentic AI solutions under the direction of an Sr. AI Engineer. This role focuses on implementing autonomous and semi-autonomous AI agents using large language models (LLMs), orchestration frameworks, and Azure-native AI services.

The position supports intelligent automation initiatives across Insurance business domains by translating product requirements into scalable, secure, and observable AI systems.

Essential Duties and Responsibilities:
  • Design, develop, and deploy Agentic AI systems based on product requirements defined by the Business SMEs.
  • Implement agent workflows including:
    • Planning, execution, validation, and retry logic
    • Tool and API invocation
    • Context and memory management
  • Build and maintain LLM-powered pipelines, including RAG-based architectures.
  • Integrate AI agents with enterprise systems using APIs, event-driven workflows, and automation services.
  • Develop and manage data ingestion and enrichment pipelines for structured and unstructured data.
  • Monitor AI system performance, accuracy, latency, and cost; implement optimizations and improvements.
  • Implement guardrails, safety mechanisms, and human-in-the-loop controls.
  • Support production deployment using Azure-native services and CI/CD pipelines.
  • Document system architecture, workflows, prompts, and operational runbooks.
  • Collaborate with product managers, architects, and data teams to iterate on AI solutions.
  • Participate in special projects and perform additional duties as required.
Education and Experience:
  • Bachelor’s Degree in Computer Science, Engineering, or related field required.
  • 1–3 years of experience in AI/ML engineering, data engineering, or software engineering required.
  • Hands-on experience with LLMs, GenAI, or intelligent automation systems required.
  • Experience building AI solutions on cloud platforms, preferably Microsoft Azure required.
  • Exposure to Agentic AI, workflow orchestration, or multi-agent systems preferred.
Skills:
  • Strong proficiency in Python and AI/ML libraries.
  •  Hands-on experience with:
    • LLMs, prompt engineering, and RAG architectures
    • Vector databases and semantic search
    • Agent orchestration frameworks
  • Experience with Microsoft Azure, including:
    • Azure OpenAI
    • Azure Functions, Logic Apps, AKS
  • Knowledge of API development and system integration.
  • Familiarity with CI/CD pipelines, Git-based version control, and Agile delivery.
  • Strong analytical, troubleshooting, and communication skills.
  • Azure AI Fundamentals or equivalent certification preferred.
  • Familiarity with data privacy, security, and compliance in AI development.
  • Exposure to prompt engineering and GenAI tools a plus.
  • Insurance domain exposure preferred.

The salary range for this role is $69,100-$124,400. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs.  Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.

Apply