1

Ai Rag Jobs in Baltimore, MD (NOW HIRING)

Senior AI Engineer

Annapolis Junction, MD · On-site

$106K - $146K/yr

Senior AI Engineer ***(Active Clearance with a Polygraph is Required) We're on multiple contracts ... Build and maintain database solutions supporting RAG architectures, including vector stores ...

Senior AI Engineer (SWE-3)

Linthicum Heights, MD · On-site

$102K - $140K/yr

... RAG) systems, and automated testing pipelines. • Develop and optimize data preprocessing ... and deploy networked AI tools within secure enclaves and conduct performance profiling ...

Software Engineer (AI Infrastructure)

Columbia, MD · On-site

$170K - $201K/yr

Support the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies * Navigate ambiguity ...

AI Software Engineer

Baltimore, MD · Remote

$100K - $135K/yr

Design and implement Retrieval-Augmented Generation (RAG) architectures using enterprise knowledge sources and vector databases. * Develop Agentic AI workflows capable of autonomous reasoning ...

Develop AI-enabled applications using large language models and retrieval-augmented generation (RAG) architectures. Integrate AI agents with APIs, databases, enterprise systems, and external services.

Senior AI Engineer

Annapolis, MD · On-site

$103K - $142K/yr

Senior AI Engineer ***(Active Clearance with a Polygraph is Required) We're on multiple contracts ... Build and maintain database solutions supporting RAG architectures, including vector stores ...

Showing results 21-40

Ai Rag information

See Baltimore, MD salary details

$31.8K

$57.9K

$83K

How much do ai rag jobs pay per year?

As of Aug 6, 2026, the average yearly pay for ai rag in Baltimore, MD is $57,875.00, according to ZipRecruiter salary data. Most workers in this role earn between $48,700.00 and $64,600.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an AI researcher?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What is an AI RAG?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.
What are popular job titles related to Ai Rag jobs in Baltimore, MD? For Ai Rag jobs in Baltimore, MD, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in Baltimore, MD look for? The top searched job categories for Ai Rag jobs in Baltimore, MD are:
What cities near Baltimore, MD are hiring for Ai Rag jobs? Cities near Baltimore, MD with the most Ai Rag job openings:

Senior AI Engineer

Que Technology Group

Fort George G Meade, MD • On-site

$115K - $159K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 3 days ago


Job description

Que Technology Group, Inc., is looking for a motivated Senior AI Engineer with a proven track record in software engineering and deep understanding of Artificial Intelligence/Machine Learning (AI/ML) techniques to support the exciting new AI and Emerging Technologies (AI&ET) mission. The engineer will work closely with mission stakeholders to capture requirements, aid in structured planning, and improve the certification process by introducing AI/ML tooling.Additionally, the engineer will use AI/ML to develop tools and techniques to include fine tuning Large Language Models (LLM) that assist in enhanced vulnerability identification and mitigation capabilities.
Responsibilities include, but are not limited to:
  • Collaborate closely with technical leadership to design, develop, and maintain LLM orchestration frameworks that coordinate static analyzers, retrieval-augmented generation (RAG) systems, and automated testing pipelines.
  • Develop and optimize data preprocessing pipelines to ingest, clean, transform, and vectorize product documentation, source code, and test results for LLM consumption.
  • Design and implement database solutions to support RAG architectures, artifact storage, audit trails, and metadata management.
  • Collaboratively work with systems engineers to architect and deploy networked AI tools within secure enclaves and conduct performance profiling, optimization, and scalability analysis of mission systems.
  • Support security assessments and authority to operate (ATO) processes
Required Qualifications:
  • Bachelor's degree plus 8-years of relevant experience or equivalent.
  • Proficiency in Python, LLM integration, and data engineering.
  • Experience with static analyzers, RAG framework, and relational and vector databases.
  • Familiarization with Agile, Git, Jira, and Confluence.

Preferred Qualifications:
  • Familiarization with RUST, Claude Code, Codex, and CI/CD.
Security Clearance:
  • Active TS/SCI with Polygraph required.

BENEFITS:
  • Competitive salary
  • Company Medical/Dental/Vision plans - Company paid
  • Short-term Disability, Long-term disability and Life Insurance - Company paid
  • Business/ First Class travel upgrade for 7 hour or longer flights & company card will be provided for expenses
  • Vacation / Personal days granted at 25 days per year
  • Paid Federal Holidays - 11 days
  • $5,000 Annual Professional Development Fund plus 40 paid hours if in class
  • 401K with 6% company match; all contributions are immediately vested by Employee
  • Employee will be paid a bonus of $10,000 per employee hired based on their referral
  • Up to 3 paid Code Red days due to customer closure

Que Technology Group, Inc., is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.