ZipRecruiter

Log In

1

Ai Rag Jobs in Baltimore, MD (NOW HIRING)

Dell, Inc.

Senior Systems Engineer

Annapolis, MD · On-site

$103K - $141K/yr

Unstructured data & AI/RAG: Understanding of vector databases (e.g., Elasticsearch, Milvus, pgvector), embedding models, and RAG architectures. Familiarity with document processing pipelines ...

next page

Showing results 1-20

All JobsAi Rag JobsAi Rag Jobs in Baltimore, MD

Ai Rag information

See Baltimore, MD salary details

$31.8K

$57.9K

$83K

How much do ai rag jobs pay per year?

As of Jun 21, 2026, the average yearly pay for ai rag in Baltimore, MD is $57,875.00, according to ZipRecruiter salary data. Most workers in this role earn between $48,700.00 and $64,600.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an AI Researcher, and why are they important?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What are AI RAGs?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are some common challenges faced by AI RAG (Retrieval-Augmented Generation) engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.
What are popular job titles related to Ai Rag jobs in Baltimore, MD? For Ai Rag jobs in Baltimore, MD, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in Baltimore, MD look for? The top searched job categories for Ai Rag jobs in Baltimore, MD are:
What cities near Baltimore, MD are hiring for Ai Rag jobs? Cities near Baltimore, MD with the most Ai Rag job openings:
Ai Rag jobs near you

Senior AI/ML Engineer AI Platform & RAG Systems

Unisoft Technology Inc

Baltimore, MD

$103K - $142K/yr

Other

Posted 24 days ago

Job description

Job Summary

Seeking a Senior AI/ML Engineer with strong experience in building scalable AI platforms, retrieval-augmented generation (RAG) systems, and production-grade ML/data pipelines for enterprise environments. The ideal candidate will have deep expertise in AI/ML engineering, cloud-native architecture, data engineering, and deploying secure, scalable solutions into production.

Key Responsibilities

  • Design and build multi-tenant AI platforms, including agentic workflows, RAG services, and LLM orchestration.
  • Develop LLM-powered applications for intelligent automation, enterprise search, and knowledge retrieval.
  • Implement and optimize vector search and retrieval pipelines using OpenSearch kNN, metadata indexing, and hybrid search.
  • Build secure, event-driven ingestion pipelines integrating data lakes, streaming systems, and document processing workflows.
  • Design advanced chunking and document parsing strategies to improve retrieval relevance across multiple file types.
  • Develop LLM evaluation pipelines, golden datasets, custom evaluators, and explainable scoring mechanisms.
  • Implement feedback and human-in-the-loop systems to improve AI performance in production.
  • Establish observability for AI systems, including tracing, latency monitoring, token usage, and model performance insights.
  • Build and optimize batch and real-time data pipelines for ML and analytics workloads.
  • Implement MLOps practices for model training, deployment, versioning, and monitoring.
  • Ensure security, governance, compliance, and responsible AI controls across enterprise deployments.
  • Partner with architecture, product, and security teams to define readiness criteria and production rollout plans.

Required Qualifications

  • 10+ years of overall IT experience with strong focus on AI/ML engineering, data engineering, or platform engineering.
  • Strong hands-on programming experience in Python and SQL.
  • Proven experience building RAG systems, LLM-based applications, and AI orchestration workflows.
  • Strong knowledge of vector databases or vector search technologies such as OpenSearch kNN or similar platforms.
  • Experience building ETL/ELT and ML-ready data pipelines using Spark, PySpark, or similar big data frameworks.
  • Hands-on experience with streaming technologies such as Kafka, Kinesis, or Event Hub.
  • Experience with MLOps tools and deployment frameworks such as MLflow, Docker, Kubernetes, and CI/CD pipelines.
  • Strong experience with AWS and/or Azure cloud ecosystems.
  • Experience implementing observability, monitoring, and evaluation frameworks for AI systems.
  • Knowledge of secure enterprise architecture including RBAC, OAuth2, PII handling, and compliance controls.
  • Bachelor s or Master s degree in Computer Science, Engineering, or a related field.

Preferred Qualifications

  • Experience with enterprise AI platforms such as C3.ai, AWS AI, or Azure AI services.
  • Familiarity with agentic AI, multi-agent systems, and tool-based LLM workflows.
  • Experience with Delta Lake, Snowflake, OpenSearch, and modern cloud data platforms.
  • Exposure to regulated industries such as banking, healthcare, or financial services.
  • Experience with Terraform, ArgoCD, autoscaling frameworks, and cloud-native infrastructure.
  • Ability to translate business requirements into scalable, production-ready AI solutions.

Apply