2

Entrylevel Retrieval Augmented Generation Jobs in Philadelphia, PA

Python AI Developer

Malvern, PA · On-site

$49.25 - $68/hr

Experience designing and implementing Retrieval-Augmented Generation (RAG) solutions * Hands-on experience with LangChain or similar AI orchestration frameworks * Experience with AWS services such as:

Senior Python AI Engineer

Mount Laurel, NJ · On-site

$120K - $161K/yr

Have prior knowledge & hands on Experience with - Building production-ready AI services and APIs using Python LLM integration Prompt engineering frameworks RAG (Retrieval-Augmented Generation ...

Your work will involve techniques such as fine-tuning, retrieval-augmented generation (RAG), and prompt engineering to solve meaningful business challenges. You will work closely with teams to ...

Your work will involve techniques such as fine-tuning, retrieval-augmented generation (RAG), and prompt engineering to solve meaningful business challenges. You will work closely with teams to ...

Develop retrieval-augmented generation (RAG) systems that connect AI models with trusted scientific and scholarly content. * Create intelligent capabilities for search, ranking, recommendation ...

Develop retrieval-augmented generation (RAG) systems that connect AI models with trusted scientific and scholarly content. * Create intelligent capabilities for search, ranking, recommendation ...

Develop retrieval-augmented generation (RAG) systems that connect AI models with trusted scientific and scholarly content. * Create intelligent capabilities for search, ranking, recommendation ...

Develop retrieval-augmented generation (RAG) systems that connect AI models with trusted scientific and scholarly content. * Create intelligent capabilities for search, ranking, recommendation ...

next page

Showing results 1-20

Entrylevel Retrieval Augmented Generation information

See Philadelphia, PA salary details

$32.3K

$52.6K

$76.7K

How much do entrylevel retrieval augmented generation jobs pay per year?

As of Aug 25, 2026, the average yearly pay for entrylevel retrieval augmented generation in Philadelphia, PA is $52,610.00, according to ZipRecruiter salary data. Most workers in this role earn between $40,400.00 and $65,600.00 per year, depending on experience, location, and employer.

What are popular job titles related to Entrylevel Retrieval Augmented Generation jobs in Philadelphia, PA?

For Entrylevel Retrieval Augmented Generation jobs in Philadelphia, PA, the most frequently searched job titles are:

What job categories do people searching Entrylevel Retrieval Augmented Generation jobs in Philadelphia, PA look for?

The top searched job categories for Entrylevel Retrieval Augmented Generation jobs in Philadelphia, PA are:

What cities near Philadelphia, PA are hiring for Entrylevel Retrieval Augmented Generation jobs?

Cities near Philadelphia, PA with the most Entrylevel Retrieval Augmented Generation job openings:

Software Developer / Engineer - Philadelphia, PA (Locals Only)

Philadelphia, PA • On-site

Apetan Consulting llc
IT Services • 1 - 10 employees

$80 - $150/hr

Contractor

Re-posted 2 days ago


Job description

Software Developer / Engineer
Location: Philadelphia, PA 
Work Schedule: Hybrid 3 days on site, 2 remote


Position Overview

We are seeking a Software Developer / Engineer to help design and implement an on-premises Large Language Model (LLM) platform with Retrieval-Augmented Generation (RAG) capabilities. This role will focus on deploying open-source AI models, integrating vector databases, and building secure, enterprise-grade AI solutions in a private environment.

This is an excellent opportunity for a developer with hands-on experience in modern AI technologies who enjoys building scalable, high-performance systems.

Responsibilities

  • Deploy and optimize open-source large language models (LLMs) such as Meta Llama 3 and Mistral/Mixtral in on-premises or private environments.
  • Develop Python-based applications for LLM inference, prompt engineering, and model integration.
  • Optimize CPU-based model inference through quantization and performance tuning.
  • Design and implement Retrieval-Augmented Generation (RAG) (RAG) pipelines.
  • Configure and manage open-source vector databases such as Qdrant, Chroma, Milvus, or pgvector.
  • Generate and manage embeddings while implementing metadata filtering strategies.
  • Support enterprise security requirements, including air-gapped deployments, access controls, data privacy, and audit logging.
  • Produce technical documentation, deployment guidance, and knowledge transfer materials for internal teams.
  • Build a working prototype integrating an LLM, vector database, and RAG architecture.

Required Qualifications

  • Professional experience deploying open-source LLMs (e.g., Meta Llama 3, Mistral/Mixtral) in on-premises or private environments.
  • Strong Python development experience.
  • Hands-on experience with LLM inference, prompt engineering, and AI application integration.
  • Experience optimizing CPU-based inference through model quantization and performance tuning.
  • Experience with vector databases such as Qdrant, Chroma, Milvus, or pgvector.
  • Proven experience implementing Retrieval-Augmented Generation (RAG) solutions.
  • Understanding of enterprise security, data privacy, air-gapped environments, access controls, and audit logging.

Preferred Qualifications

  • Experience with LangChain or LlamaIndex.
  • Familiarity with Docker and Kubernetes.
  • Experience with inference frameworks such as vLLM, llama.cpp, or Hugging Face Transformers.
  • Experience with Rust, Go, or C++.
  • Previous experience working in enterprise or regulated environments.

Deliverables

  • Reference architecture and deployment guidance.
  • Working prototype integrating an LLM, vector database, and RAG solution.
  • Technical documentation and knowledge transfer to internal teams.