ZipRecruiter

Log In

1

Retrieval Augmented Generation Jobs (NOW HIRING)

Axle

AI Engineer II

Rockville, MD

$99.40K - $136.10K/yr

This role involves architecting retrieval-augmented generation (RAG) systems, agentic pipelines, document understanding workflows, and the shared platform services that make these systems reliable ...

Cynet Systems

AI Platform Architect

Nashville, TN

Strong experience designing and implementing Retrieval-Augmented Generation (RAG) architectures. * Experience building vector embedding pipelines and vector search solutions. * Strong cloud-native ...

Zensark Inc

Sr AI Engineer

Boston, MA

$70/hr

This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the ...

CYNET SYSTEMS

AI Platform Architect

Nashville, TN · On-site

$60/hr

Strong experience designing and implementing Retrieval-Augmented Generation (RAG) architectures. * Experience building vector embedding pipelines and vector search solutions. * Strong cloud-native ...

CereCore

Sr Staff Agentic AI Engineer

Nashville, TN

This role will focus on practical applications of AI, including Retrieval-Augmented Generation (RAG), the design of sophisticated grounding data structures, and the construction of robust pipelines ...

CYNET SYSTEMS

Gen AI Developer

Nashville, TN · On-site

$50/hr

Strong experience designing and implementing Retrieval-Augmented Generation (RAG) architectures. * Experience building vector embedding and vector search pipelines. * Strong cloud-native application ...

Cresta

Senior Machine Learning Engineer

OR · On-site +1

$205K - $270K/yr

Architect and scale LLM and retrieval-augmented generation pipelines that ground models in enterprise data. This track focuses on building high-performance ML systems that process complex data ...

ThinkBeyond Inc

$44.75 - $61.75/hr

Design, develop, and maintain robust and scalable backend systems, incorporating AI/ML capabilities (e.g., Retrieval-Augmented Generation, Large Language Model integration, Machine Learning Control ...

Tata Consultancy Service Limited

AI Developer

Tampa, FL · On-site

$100K - $130K/yr

Neural Networks, Decision Trees, SVM, NLP, Reinforcement Learning, Ensemble Methods, MCP • Strong knowledge with RAG (Retrieval-Augmented Generation), Prompt Engineering, Agentic AI • Knowledge ...

Tata Consultancy Service Limited

AI Developer

Mckinney, TX · On-site

$100K - $130K/yr

Neural Networks, Decision Trees, SVM, NLP, Reinforcement Learning, Ensemble Methods, MCP • Strong knowledge with RAG (Retrieval-Augmented Generation), Prompt Engineering, Agentic AI • Knowledge ...

Cresta

Senior Machine Learning Engineer

$125.40K - $165.30K/yr

Architect and scale LLM and retrieval-augmented generation pipelines that ground models in enterprise data. This track focuses on building high-performance ML systems that process complex data ...

Waymo

Senior Software Engineer, DevAI

San Diego, CA

$130.10K - $171.50K/yr

Advanced AI/ML: Strong expertise in Large Language Models (LLMs), including techniques like prompt engineering and Retrieval-Augmented Generation (RAG) * Coding Excellence: Proficiency in ...

Compunnel

Principal Software Engineer

Dallas, TX · On-site

$133.50K - $179.10K/yr

... Retrieval-Augmented Generation (RAG), and agentic workflows. The ideal candidate will combine deep software engineering expertise with hands-on machine learning engineering experience to build ...

New

next page

Showing results 1-20

People also search for

All JobsRetrieval Augmented Generation Jobs

Retrieval Augmented Generation information

What is a Retrieval Augmented Generation job?

A Retrieval Augmented Generation (RAG) job typically involves developing and optimizing AI systems that enhance text generation by incorporating external knowledge retrieved from relevant sources. Professionals in this field work on integrating retrieval mechanisms with large language models to improve the relevance, accuracy, and factual grounding of generated content. Common responsibilities include designing retrieval systems, fine-tuning language models, optimizing performance, and ensuring the seamless integration of factual data into AI-generated text. This role is highly interdisciplinary, involving expertise in natural language processing (NLP), machine learning, and information retrieval.

What are the key skills and qualifications needed to thrive in the Retrieval Augmented Generation position, and why are they important?

To thrive in a Retrieval Augmented Generation (RAG) engineering role, you need a solid background in machine learning, natural language processing (NLP), and experience with scalable information retrieval systems, typically supported by a relevant degree in computer science or a related field. Familiarity with tools such as Python, PyTorch or TensorFlow, vector databases, and search platforms like Elasticsearch is essential, along with practical experience deploying and tuning RAG pipelines. Strong problem-solving skills, a collaborative mindset, and effective communication abilities set outstanding professionals apart in this field. These competencies are crucial for designing, implementing, and optimizing hybrid retrieval-generation AI systems that address complex, real-world information needs.

What are the typical daily responsibilities of a Retrieval Augmented Generation engineer?

A Retrieval Augmented Generation engineer typically spends their day designing and implementing systems that combine information retrieval with advanced generative models, such as large language models. This includes fine-tuning models, integrating external data sources, developing vector search pipelines, and evaluating output quality. Collaboration with data scientists, machine learning engineers, and product teams is common to ensure the solutions meet user requirements and scale effectively. Additionally, RAG engineers often troubleshoot issues, monitor model performance in production, and stay informed about the latest advancements in AI and information retrieval.
More about Retrieval Augmented Generation jobs
What cities are hiring for Retrieval Augmented Generation jobs? Cities with the most Retrieval Augmented Generation job openings:
What are the most commonly searched types of Retrieval Augmented Generation jobs? The most popular types of Retrieval Augmented Generation jobs are:
What states have the most Retrieval Augmented Generation jobs? States with the most job openings for Retrieval Augmented Generation jobs include:
What job categories do people searching Retrieval Augmented Generation jobs look for? The top searched job categories for Retrieval Augmented Generation jobs are:
Retrieval Augmented Generation jobs near you
Infographic showing various Retrieval Augmented Generation job openings in the United States as of May 2026, with employment types broken down into 19% Full Time, 77% Part Time, and 4% Contract. Highlights an 77% Physical, 8% Hybrid, and 15% Remote job distribution.

AI Engineer II

Axle

Rockville, MD

$99.40K - $136.10K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 9 days ago

Job description

(ID: 2026-1850)

Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organizations nationally and abroad. With experts in biomedical science, software engineering, and program management, we focus on developing and applying research tools and techniques to empower decision-making and accelerate research discoveries. We work with some of the top research organizations and facilities in the country including multiple institutes at the National Institutes of Health (NIH).

Benefits We Offer:

  • 100% Medical, Dental & Vision Coverage for Employees
  • Paid Time Off and Paid Holidays
  • 401K match up to 5%
  • Educational Benefits for Career Growth
  • Employee Referral Bonus
  • Flexible Spending Accounts:
    • Healthcare (FSA)
    • Parking Reimbursement Account (PRK)
    • Dependent Care Assistant Program (DCAP)
    • Transportation Reimbursement Account (TRN)

Role Summary

Axle is seeking an AI Engineer II with experience designing and delivering production AI systems to lead the development of intelligent applications that support translational research and scientific operations. This role involves architecting retrieval-augmented generation (RAG) systems, agentic pipelines, document understanding workflows, and the shared platform services that make these systems reliable and reusable.

A significant portion of this role involves working directly with clients — scientists, program managers, and operational staff — who understand the problem domain but may not have a technical background. You will partner with them to elicit requirements, translate domain needs into well-defined technical solutions, and ensure delivered software meets their real-world needs. The role requires a self-directed engineer who can make sound architectural decisions, take ownership of technical components end-to-end, mentor junior team members, and deliver iteratively while managing client relationships and expectations.

Key Responsibilities

  • Architect, develop, and maintain AI-powered applications in Python, including conversational assistants, agentic tools, and retrieval-augmented generation (RAG) systems.
  • Design and optimize retrieval pipelines: embedding generation, vector search, hybrid search, and reranking against large domain-specific corpora.
  • Build document ingestion and parsing pipelines that extract structured content (text, tables, figures, citations) from scientific and technical documents for downstream use by AI systems.
  • Integrate structured knowledge — ontologies, controlled vocabularies, and knowledge graphs — with unstructured text to produce evidence-grounded, provenance-aware AI outputs.
  • Develop and operate shared platform services that accelerate delivery of new AI applications: model gateways, agent-tool integrations, authentication, API key management, and observability.
  • Lead technical design decisions and establish best practices for code quality, testing, evaluation, and deployment of AI systems.
  • Provision, deploy, monitor, and troubleshoot services on Kubernetes and cloud infrastructure, including container builds, manifests, and CI/CD pipelines.
  • Design and maintain relational and vector databases, including schema design, indexing, migrations, and incremental data updates.
  • Define and track quality metrics for AI systems (retrieval quality, answer faithfulness, latency, cost) and drive measurable improvements over time.
  • Engage directly with non-technical clients to gather requirements, clarify goals, manage expectations, and validate that delivered solutions align with their objectives.
  • Translate high-level client and mission needs into actionable technical specifications and development plans.
  • Mentor junior engineers and contribute to a culture of technical excellence.
  • Participate in and help facilitate standups, sprint planning, and cross-team review meetings across multiple project streams.

Required Skills & Qualifications

  • 5+ years of professional experience in software development, with recent hands-on work building AI or ML-powered applications.
  • Strong proficiency in Python for application development, scripting, and tooling.
  • Demonstrated experience building retrieval-augmented generation (RAG) systems, including embeddings, vector search, and reranking.
  • Experience integrating large language models (LLMs) into production applications using modern agent or orchestration frameworks.
  • Experience with vector databases and semantic search.
  • Demonstrated experience making architectural decisions and owning technical direction for software projects.
  • Experience with Docker, containerization workflows, and Kubernetes for deploying and operating production services.
  • Experience with PostgreSQL and relational database design.
  • Strong command of Linux development environments.
  • Experience with Git/GitHub workflows, including branching, pull requests, and code review practices.
  • Proven ability to work independently, prioritize across concurrent workstreams, and drive projects to completion with minimal oversight.

Preferred Qualifications

  • Experience with document parsing, OCR, and layout-aware extraction for scientific or technical documents.
  • Familiarity with knowledge graphs, ontologies, and controlled vocabularies, including RDF, SPARQL, or graph query languages.
  • Experience with agent-tool integration frameworks, including the Model Context Protocol (MCP).
  • Experience with LLM observability, tracing, and evaluation tooling.
  • Experience with GPU computing (CUDA/NVIDIA) for embedding or inference workloads.
  • Experience with AWS (IAM, S3, deployment, general infrastructure management).
  • Familiarity with OIDC/OAuth authentication and API key management in production systems.
  • Background in biomedical informatics, translational research, or health sciences.
  • Experience with AI-assisted development tools (e.g., Claude Code, GitHub Copilot).
  • Familiarity with Jira or similar project management tools.

Interpersonal Skills

  • Strong written and verbal communication skills, including the ability to convey technical concepts to non-technical collaborators and translate domain expertise into software requirements.
  • Skilled at requirements elicitation — able to ask the right questions, listen actively, and bridge the gap between what subject matter experts need and what engineering can deliver.
  • Ability to work effectively across multiple teams and project streams with different leads, priorities, and cadences.
  • Comfortable operating in a large, cross-functional team environment where coordination and alignment are essential.
  • Proactive in communicating progress, raising blockers, and seeking input from teammates and stakeholders.
  • Tactful and professional when engaging with clients and external partners; able to navigate sensitive situations and escalate appropriately.
  • Receptive to feedback and committed to iterative improvement.

Disclaimer: The above description is meant to illustrate the general nature of work and level of effort being performed by individuals assigned to this position or job description. This is not restricted as a complete list of all skills, responsibilities, duties, and/or assignments required. Individuals may be required to perform duties outside of their position, job description or responsibilities as needed.

The diversity of Axle's employees is a tremendous asset. We are firmly committed to providing equal opportunity in all aspects of employment and will not tolerate any illegal discrimination or harassment based on age, race, gender, religion, national origin, disability, marital status, covered veteran status, sexual orientation, status with respect to public assistance, and other characteristics protected under state, federal, or local law and to deter those who aid, abet, or induce discrimination or coerce others to discriminate.

Accessibility: If you need an accommodation as part of the employment process please contact: careers@axleinfo.com

This role has a market-competitive salary with an anticipated base compensation range listed below. Actual salaries will vary depending on a candidate's experience, qualifications, skills, and location.

#IND

Salary Range
$120,000—$150,000 USD