2

Remote Retrieval Augmented Generation Jobs in Hingham, MA

Remote | Full-time | Competitive Compensation Apiphani is building the future of intelligent ... models (LLMs), retrieval-augmented generation (RAG), and intelligent agents. What You'll Do

Senior AI Engineer (US Remote)

Waltham, MA ยท Remote

$180K - $210K/yr

RAG (Retrieval-Augmented Generation) architectures * Agentic frameworks (LangChain, LlamaIndex, or ... REMOTE Basic Requirements * 8+ years experience in software development * AND 2+ years with AI ...

Senior Backend Engineer - AI Platform

Boston, MA ยท On-site +1

$133K - $175K/yr

This is a remote position; however, the candidate must reside within 30 miles of one of the ... Design solutions for context management, memory, and retrieval-augmented generation (RAG) to ...

Senior Backend Engineer - AI Platform

Boston, MA ยท On-site +1

$133K - $175K/yr

This is a remote position; however, the candidate must reside within 30 miles of one of the ... Design solutions for context management, memory, and retrieval-augmented generation (RAG) to ...

AI Cyber Principal

Cambridge, MA ยท On-site +1

$100K - $275K/yr

A strong understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI. * Proficiency in coding languages like Python, as well as IaC (Infrastructure as Code ...

Senior AI Security Engineer

Boston, MA ยท On-site +1

$124K - $170K/yr

Collaborate on designing secure-by-default patterns for LLM integration, agentic workflows, retrieval-augmented generation (RAG) pipelines, and MCP server deployments across firm systems * Lead ...

... a modern, AI-augmented growth team operates. This role offers full remote flexibility for ... Plan and execute end-to-end demand generation campaigns across digital and offline channels ...

Senior Engineer, Test Automation

Boston, MA ยท Remote

$130K - $180K/yr

Evaluate and apply AI-assisted testing techniques, such as LLM-based test generation and ... Remote within the United States. This role requires 100% of work to be performed in a remote office ...

next page

Showing results 1-20

Remote Retrieval Augmented Generation information

What is remote retrieval augmented generation?

Remote Retrieval Augmented Generation (RAG) is an advanced AI technique that combines large language models with external information sources. In a remote RAG setup, the model retrieves relevant data from remote databases or APIs during the generation process, enhancing its responses with up-to-date or domain-specific knowledge. This approach is widely used in applications that require accurate, context-aware answers, such as chatbots, search engines, and virtual assistants. By leveraging remote retrieval, RAG systems can access a broader range of information without needing to store all data locally.

What skills and qualifications are needed to thrive as a remote retrieval augmented generation engineer?

To thrive as a Remote Retrieval Augmented Generation (RAG) Engineer, you need a strong background in machine learning, natural language processing, and information retrieval, often backed by a degree in computer science or a related field. Familiarity with tools and frameworks like PyTorch, TensorFlow, Hugging Face Transformers, and experience with retrieval systems such as Elasticsearch or FAISS are typically required. Problem-solving, effective communication, and adaptability are important soft skills for collaborating remotely and iterating on rapidly evolving AI solutions. These skills ensure the engineer can design, deploy, and optimize robust RAG systems that effectively combine retrieval and generation for high-quality AI outputs.

What are common challenges faced by professionals working in remote retrieval augmented generation roles, and how can they be addressed?

Professionals in Remote Retrieval Augmented Generation (RAG) roles often encounter challenges related to integrating diverse data sources, ensuring low latency in information retrieval, and maintaining the quality and relevance of augmented outputs. Coordinating effectively with distributed teams and adapting to rapidly evolving AI technologies are also common hurdles. To address these, staying current with best practices in data engineering, leveraging robust APIs, and participating in regular team check-ins can help ensure smooth collaboration and system performance.

What is the difference between Remote Retrieval Augmented Generation vs Remote Data Scientist?

AspectRemote Retrieval Augmented GenerationRemote Data Scientist
CredentialsAI/ML knowledge, programming skillsStatistics, programming, domain expertise
Work EnvironmentAI development, NLP projectsData analysis, model building
Industry UsageAI, NLP, machine learningTech, finance, healthcare
Search & ComparisonOften compared for AI roles involving language modelsCompared for data analysis roles

Remote Retrieval Augmented Generation focuses on developing AI models that combine retrieval techniques with language generation, requiring expertise in AI, NLP, and programming. Remote Data Scientists analyze data, build models, and interpret results, often with statistical and domain knowledge. While both roles may work remotely and involve data handling, Retrieval Augmented Generation emphasizes AI model development, whereas Data Scientists focus on data analysis and insights.

What job categories do people searching Remote Retrieval Augmented Generation jobs in Hingham, MA look for?

The top searched job categories for Remote Retrieval Augmented Generation jobs in Hingham, MA are:

What cities near Hingham, MA are hiring for Remote Retrieval Augmented Generation jobs?

Cities near Hingham, MA with the most Remote Retrieval Augmented Generation job openings:

Senior Software Engineer (AI / LLMs)

Boston, MA โ€ข Remote

apiphani
IT Servicesย โ€ขย 1 - 10 employees

$120K - $160K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 11 days ago


Job description

Apiphani is a technology-enabled managed services company dedicated to redefining what it means to support mission-critical enterprise workloads. We're a small but rapidly growing company, which means there's lots of room for growth and learning opportunities abound! 

Apiphani is dedicated to creating a diverse and inclusive work environment for all as a fundamental component of our business. Diversity and inclusion are the bedrock of creativity and innovation. Without diversity of experience and thought, we would fail to progress as a company and as a team. Apiphani strives to foster an environment of belonging, where every employee feels respected, valued, and empowered.  We embrace the unique experiences, perspective, and cultural background, which only you can bring to the table.  

Senior Software Engineer — Agentic AI Platform 

Location: Remote | Full-time | Competitive Compensation 

Apiphani is building the future of intelligent infrastructure automation through agentic AI. We're looking for a Senior Backend Engineer to help design and build the systems that power Luumen — an AI-driven automation platform used by enterprise IT and managed service providers around the world. 

This is a high-impact, zero-to-one engineering role focused on building the backend foundations for large-scale AI orchestration. You'll work on distributed systems that combine traditional infrastructure automation with large language models (LLMs), retrieval-augmented generation (RAG), and intelligent agents. 

What You'll Do 

  • Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions 
  • Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines 
  • Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure 
  • Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities 
  • Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant) 
  • Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows 
  • Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health 
  • Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices 
  • Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality 

What We're Looking For 

  • 6+ years of backend engineering experience in production environments 
  • Strong proficiency in Python and TypeScript for building distributed, event-driven systems 
  • Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.) 
  • Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models 
  • Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation 
  • Experience with infrastructure-as-code tools such as Terraform or AWS CDK 
  • Understanding of SQL and schema migration workflows (PostgreSQL or similar) 
  • Hands-on experience with Docker, GitHub Actions, and cloud-native CI/CD workflows 
  • Ability to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team 
  • Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments 

Bonus Points 

  • Experience working with LangChain, OpenAI, or Anthropic APIs 
  • Familiarity with agentic frameworks or AI orchestration systems 
  • Background in observability or APM tooling (e.g., Datadog, Dynatrace) 
  • Prior experience building automation or infrastructure management tools 
  • Contributions to open-source LLM or MLOps projects 
  • Interest in shaping how AI is applied to real-world IT operations 

Why Join Apiphani 

You'll be joining a globally distributed, high-performing team focused on redefining how enterprises manage infrastructure. Every feature you build will directly impact how engineers interact with intelligent systems in production environments. 

This is an opportunity to help architect the foundations of a platform that blends infrastructure automation, AI, and agentic reasoning — where your technical decisions will shape the next generation of enterprise operations. 

Base Salary
$120,000—$160,000 USD
Company Benefits*
  • Medical/dental/vision - 100% paid for employees, 50% paid for dependents
  • Life and disability - 100% paid for employees
  • 401K - 3% contribution, no employee contribution necessary 
  • Education and tuition reimbursement
  • Accident, critical illness, hospital indemnity benefits offered through our providers
  • Employee Assistance Program 
  • Legal assistance
  • Paid Time Off - up to 6 weeks per year 
  • Sick Leave - up to 2 weeks per year
  • Parental Leave - up to 12 weeks 

*Benefits listed in the job description apply to employees working in the United States. For international employees, Apiphani partners with an Employer of Record, Deel, and provides all statutory benefits required under local law; certain U.S.-specific programs (such as EAP, legal assistance, etc.) may not be available outside the United States. The specific benefits package will be outlined in the local employment agreement issued through Deel.