ZipRecruiter

Log In

2

Remote Rag Jobs in Baltimore, MD (NOW HIRING)

T12 TECHNOLOGIES LLC

AI Solutions Architect

Baltimore, MD · On-site +1

$140K - $165K/yr

... RAG), fine-tuning, prompt engineering, and evaluation. Strong grasp of data architecture ... Working Conditions Remote position with approximately one on-site visit per quarter; travel ...

USALCO

AI Platform Engineer

Baltimore, MD · Remote

This is a REMOTE position. RESPONSIBILITIES AI Platform Architecture & Engineering: Design, develop ... generation (RAG) pipelines, prompt management, vector search capabilities, model integration ...

ZIO Technologies

AI ML Software Engineer

Annapolis, MD · On-site +1

$113K - $136K/yr

Remote (U.S.-based) with occasional onsite requirements Duration: Long-term engagement (up to 5 ... Knowledge retrieval improvements (RAG, vector search, system integration) * AI capabilities for ...

All JobsRag JobsRemote Rag JobsRemote Rag Jobs in Baltimore, MD

Remote Rag information

See Baltimore, MD salary details

$17

$21

$23

How much do remote rag jobs pay per hour?

As of Jun 11, 2026, the average hourly pay for remote rag in Baltimore, MD is $21.36, according to ZipRecruiter salary data. Most workers in this role earn between $17.93 and $22.69 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote Rag, and why are they important?

I'm sorry, but 'Remote Rag' does not appear to be a recognized professional occupation. Please provide a valid job title.

What is a Remote RAG (Retrieval-Augmented Generation) specialist?

A Remote RAG specialist is a professional who works with Retrieval-Augmented Generation (RAG) systems, typically in the field of artificial intelligence and machine learning. RAG combines traditional information retrieval techniques with generative models like large language models to provide more accurate and contextually relevant answers to user queries. Remote RAG specialists often build, fine-tune, and maintain these systems while working from a remote location. They may also work on integrating RAG models into applications, improving retrieval accuracy, and customizing outputs based on user needs.

What are some common challenges faced by professionals working in a remote RAG (Responsible AI Governance) role?

Professionals in remote RAG roles often encounter challenges related to cross-functional collaboration and maintaining clear communication, especially when working across different time zones. Ensuring alignment on ethical AI standards and compliance requirements can be complex, as it typically involves coordinating with data scientists, legal teams, and business stakeholders. Staying current with evolving regulatory frameworks and best practices in AI governance is also essential, demanding continuous learning and adaptability. Building trust and rapport within a remote team can require extra effort, but leveraging digital collaboration tools and regular check-ins can help mitigate these challenges.
What are the most commonly searched types of Rag jobs in Baltimore, MD? The most popular types of Rag jobs in Baltimore, MD are:
What are popular job titles related to Remote Rag jobs in Baltimore, MD? For Remote Rag jobs in Baltimore, MD, the most frequently searched job titles are:
What job categories do people searching Remote Rag jobs in Baltimore, MD look for? The top searched job categories for Remote Rag jobs in Baltimore, MD are:
What cities near Baltimore, MD are hiring for Remote Rag jobs? Cities near Baltimore, MD with the most Remote Rag job openings:
Remote Rag jobs near you

Software Engineer - TS/SCI with Poly

Staffed4U

Annapolis Junction, MD • On-site, Remote

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 5 days ago

Job description

Software Engineer
$160k- $230k

Location: Annapolis Junction, MD
Clearance Required: TS/SCI with Polygraph
Experience Level: 7+ years of experience
Education: Bachelor's degree in Computer Science, Engineering, or related field
Position Summary:
We are seeking a skilled and mission-driven Software Engineer to support the ML Frameworks team. In this role, you will contribute to the design, development, and deployment of a Retrieval-Augmented Generation (RAG) solution within a high-performance computing (HPC) Linux environment. This position is ideal for someone with a strong Linux background and a passion for AI/ML technologies, especially Large Language Models (LLMs) and secure AI systems.
Primary Responsibilities:

  • Contribute to the development and deployment of secure RAG pipelines in an HPC Linux environment
  • Work with cutting-edge AI/ML technologies, including LLM orchestration frameworks, embedding models, and inference platforms
  • Develop and maintain services using Python and Golang
  • Build and manage containerized services using Docker, Podman, and containerd
  • Deploy services using orchestration tools like Kubernetes and Docker Compose
  • Automate and monitor workflows with CI/CD pipelines, using GitLab CI and version control with Git
  • Integrate monitoring tools such as Prometheus and Grafana for performance and reliability
  • Participate in system administration, including Linux CLI, shell scripting, and general support tasks
Required Qualifications:
  • Active TS/SCI clearance with Polygraph
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field
  • 7+ years of professional software engineering experience
  • Strong experience with Linux system administration, CLI, and shell scripting
  • Proficiency in Python and Golang
  • Familiarity with RAG pipelines, LLMs, and knowledge retrieval systems
  • Experience with containerization technologies and orchestration tools (Docker, PodMan, Kubernetes, Docker Compose)
  • Solid understanding of CI/CD principles and related tools (GitLab CI)
  • Experience with metrics and monitoring tools (e.g., Prometheus, Grafana)
  • Experience using Git for version control
Desired Skills & Technologies:
  • Experience with GPU-enabled applications and debugging tools
  • Familiarity with LLM orchestration frameworks and OpenAPI
  • Experience with distributed processing frameworks such as Spark, Dask, or Ray
  • Familiarity with SQL, Elasticsearch, and vector databases
  • Experience with HTMX or Hyperscript
  • Understanding of multi-node, multi-GPU AI training environments
  • Knowledge of AI inferencing platforms such as Nvidia NIM/TRITON, vLLM, or Ray-based deployment
  • Experience with the Atlassian suite (Confluence, Jira)

Our client offers a highly competitive and comprehensive benefits package designed to support your personal and professional growth, while promoting a healthy work-life balance. Benefits include:

  • 100% Employer-Paid Health, Dental, and Vision Insurance – Full coverage for employees

  • Zero Vesting 401(k) Plan with 10% Company Contribution – Immediate access to all contributions

  • 31 Days of Paid Time Off – Includes vacation, personal time, and all federal holidays

  • Student Loan Repayment Assistance – Helping you pay down your educational debt

  • Unlimited Certification & Training Support – Invest in your professional development

  • Flexible Work Environment – Remote work options and flexible scheduling available

  • Multiple Incentive Bonuses – Performance-based rewards throughout the year

  • Exclusive Company Memberships – Access to curated memberships and employee perks

This package reflects our client’s commitment to empowering their employees with meaningful benefits and recognizing outstanding performance.
 


We are an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other protected status under applicable law.