1

Ai Rag Jobs in New York (NOW HIRING)

* Senior Software Engineer - Generative AI (Applied AI & Engineering) * New York City (Hybrid - 3 ... Design and deploy sophisticated Retrieval-Augmented Generation (RAG) pipelines, including vector ...

AI Engineer

New York, NY · On-site

$175K - $250K/yr

Build, test, and deploy production-grade AI solutions using generative AI approaches, including LLMs, RAG, fine-tuning, prompt optimization, and agentic workflows * Help redesign how business ...

Apply RAG techniques to improve information retrieval and decision-making processes. * Collaborate with cross-functional teams including AI, data science, and investment banking divisions. * Develop ...

Establish best practices for LLM/SLM adoption, multi-agent systems, and RAG architectures. * Drive AI platform strategy leveraging Google Cloud (Vertex AI, GKE, Cloud Run). * Lead architecture ...

Apply RAG techniques to improve information retrieval and decision-making processes. Collaborate with cross-functional teams including AI, data science, and investment banking divisions. Develop ...

Lead solution architecture spanning AI agents, RAG, Knowledge Graphs, MCP, multi-agent systems, enterprise integrations, and cloud-native platforms. * Serve as the primary technical advisor for ...

New

Build AI platform capabilities using Python, AWS, Agentic AI, MCP, and Graph/RAG . * Automate infrastructure and platform provisioning using Terraform and Docker . * Manage AI platform costs, token ...

Senior Agentic AI Engineer

Iselin, NJ · On-site

$106K - $145K/yr

Role: Senior AI Software Engineer (Agentic AI / AI Agents) Location: Iselin, NJ Duration: 12 ... Develop reusable agent frameworks, SDKs, evaluation pipelines, RAG, and memory systems * Own ...

New

Apply RAG techniques to improve information retrieval and decision-making processes. * Collaborate with cross-functional teams including AI, data science, and investment banking divisions. * Develop ...

Gen AI Architect Location: NJ, Jersey City Experience: 12 to 15 Years We are seeking a highly ... RAG Pipelines, Vector Databases & MCP Architect and deploy RAG pipelines using vector databases ...

Azure AI Engineer

Jersey City, NJ · On-site

$57.50 - $71.25/hr

Azure AI Engineer Work Location: New Jersey, New Jersey (Hybrid) Long Term Contract If you find ... Leverage SharePoint content for RAG and MCP integration build pipelines that index enterprise ...

Senior Gen AI Engineer

Jersey City, NJ · On-site

$109K - $149K/yr

Generative AI | Agentic AI | LLM | RAG | Python | NLP | LangChain | Multi-Agent Systems | AWS/Azure/Google Cloud Platform | PyTorch/TensorFlow We are seeking a Senior GenAI Engineer to lead the ...

Stayupdated with the latest trends and advancements in AI, especially relatedto RAG and Azure OpenAI. Requirements Qualifications: * Provenexperience in investment banking or financial services.

The ideal candidate will have hands-on experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, prompt engineering, vector databases, and cloud-native AI ...

Title : AI Architect Location: NYC, NY AI Architect to lead the design and implementation of ... Expert knowledge of RAG architectures, advanced RAG patterns, and vector database optimization.

Agentic AI Architect

New York, NY · Hybrid

$77.50 - $99.75/hr

Establish architecture patterns for - RAG and grounding, Vector search and retrieval, MCP tool access layer, prompt management and evaluation AI & GenAI Enablement * Define where and how to use ...

Showing results 41-60

Ai Rag information

What are the key skills and qualifications needed to thrive as an AI researcher?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What is an AI RAG?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.
What are popular job titles related to Ai Rag jobs in New York? For Ai Rag jobs in New York, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in New York look for? The top searched job categories for Ai Rag jobs in New York are:
What cities in New York are hiring for Ai Rag jobs? Cities in New York with the most Ai Rag job openings:

AI Developer (Gen AI)

Elliot Partnership

New York, NY • On-site

Full-time

Re-posted 5 days ago


Job description

  • Senior Software Engineer - Generative AI (Applied AI & Engineering)
  • New York City (Hybrid - 3 days a week in-office)
  • Generous compensation

Are you a hands-on builder with a first-principles mindset, ready to architect the future of Generative AI at a premier global quantitative investment firm?
A top-tier investment and technology development firm is seeking an exceptional Software Engineer to join its pioneering Generative AI initiative.
We're looking for a true builder who can combine hands-on GAI expertise with a rigorous software engineering background. You'll be responsible for designing, developing, and deploying the core platforms, from sophisticated RAG systems to agentic workflows.
As a Software Engineer on this central team, you will:
  • Architect and build production-grade, high-performance GAI applications and platforms from the ground up.
  • Design and deploy sophisticated Retrieval-Augmented Generation (RAG) pipelines, including vector search, knowledge graph integration, and advanced reranking.
  • Develop and orchestrate complex, multi-agent workflows (using frameworks like LangGraph) to automate high-stakes business processes.
  • Partner directly with quantitative researchers, traders, and other business units to understand their problems and deliver tangible, high-impact GAI solutions.
  • Serve as a hands-on technical expert, shipping code in Python.

Required Qualifications
  • A Bachelor's or advanced degree (MS or PhD) in Computer Science, Applied Mathematics, or a related quantitative field is required.
  • Several years of professional, hands-on experience in software engineering, with deep proficiency in Python.
  • Direct, hands-on experience building and deploying modern Generative AI systems (e.g RAG, Agentic AI, Fine-Tuning).
  • Strong understanding of system design, MLOps, and cloud-native development (e.g.Docker, Kubernetes, CI/CD, AWS/GCP/Azure).