ZipRecruiter

Log In

1

Llm Data Engineer Jobs (NOW HIRING)

Tek Ninjas

Senior Data Engineer

Dallas, TX · On-site

$104K - $142K/yr

Experience supporting AI/ML or LLM data pipelines * Knowledge of data governance and observability tool Qualifications * Bachelor's or Master's degree in Computer Science, Engineering, Information ...

Yakamconsulting

$150 - $200/hr

Conduct data preprocessing, cleaning, and feature engineering to prepare text data for analysis ... Utilize NLP and LLM techniques to extract insights, sentiment analysis, entity recognition, and ...

Vast

Senior Data Engineer

Long Beach, CA · On-site

$143K - $203K/yr

Familiarity with vector databases, knowledge graphs, and AI/LLM data architectures * Understanding ... Senior Data Engineer: $143,000.00 - $203,000.00

SupportFinity™

Staff Data Engineer

San Francisco, CA · On-site

$200 - $250/hr

K.ATS Foundry is Keystone's engineering center of excellence, embedding data, platform, and ... Contribute to research and evaluation of emerging technologies (SQLMesh, OpenLineage, LLM data ...

RA Capital Management, LLC

Data Engineer

Boston, MA · On-site

$124K - $149K/yr

You will help bridge enterprise data systems with LLM-based interfaces that support self-service ... Partner with AI/ML engineers to enable LLM-powered data access. * Contribute to AI-native data ...

Delaware Nation Industries

Data Engineer

Dahlgren, IL · On-site

$150 - $200/hr

... LLM) optimization. The role integrates data engineering, FinOps, Zero Trust security, and AI/ML infrastructure responsibilities within a single position. This position is expected to work onsite at ...

Delaware Nation Industries

Data Engineer

Dahlgren, VA · On-site

$116K - $140K/yr

... LLM) optimization. The role integrates data engineering, FinOps, Zero Trust security, and AI/ML infrastructure responsibilities within a single position. This position is expected to work onsite at ...

Delaware Nation Industries

Data Engineer

Dahlgren, VA · On-site

$116K - $140K/yr

... LLM) optimization. The role integrates data engineering, FinOps, Zero Trust security, and AI/ML infrastructure responsibilities within a single position. This position is expected to work onsite at ...

Delaware Nation Industries

Data Engineer

Dahlgren, VA · On-site

$116K - $140K/yr

... LLM) optimization. The role integrates data engineering, FinOps, Zero Trust security, and AI/ML infrastructure responsibilities within a single position. This position is expected to work onsite at ...

Anveta Inc

Data Engineer

Westlake, TX · On-site

$60/hr

Data Engineer Target Pay Rate: Maximum USD $60.00/hr C2C * Location: Westlake, TX * Work Mode ... AI/LLM Skills: Direct experience working with, tuning, and optimizing Large Language Models (LLMs)

Programmers.io

Data Engineer

Dallas, TX · On-site

$113K - $136K/yr

Role - Data Engineer * 2-3 years of hands-on experience in Data Engineering * Strong experience in ... GenAI exposure (preferred): understanding of LLM workflows, prompt versioning, evaluation ...

next page

Showing results 1-20

All JobsTechnology JobsData JobsLlm Data Engineer Jobs

Llm Data Engineer information

See salary details

$44.5K

$129.7K

$177.5K

How much do llm data engineer jobs pay per year?

As of Sep 9, 2026, the average yearly pay for llm data engineer in the United States is $129,716.00, according to ZipRecruiter salary data. Most workers in this role earn between $114,500.00 and $137,500.00 per year, depending on experience, location, and employer.

What is an LLM data engineer?

An LLM Data Engineer is a specialized data engineer who focuses on designing, building, and maintaining data pipelines and infrastructure to support large language models (LLMs) like GPT, BERT, or similar AI systems. Their responsibilities include collecting, cleaning, and organizing massive datasets used for training and fine-tuning LLMs, as well as ensuring data quality and scalability. They often work closely with data scientists, machine learning engineers, and researchers to optimize data workflows that enhance the performance and reliability of LLMs.

How does an LLM data engineer typically collaborate with data scientists and machine learning engineers during model development?

As a LLM Data Engineer, you'll work closely with data scientists and machine learning engineers by designing and maintaining data pipelines that supply high-quality, relevant datasets for large language model (LLM) training. This involves frequent communication to understand data requirements, preprocessing needs, and model feedback, ensuring that data is clean, annotated, and formatted correctly for experimentation. Collaboration often includes iterating on dataset creation, addressing issues such as data bias or imbalance, and supporting scalable infrastructure for large-scale model training. Your role is essential in bridging the gap between raw data and robust, high-performing language models.

What are the key skills and qualifications needed to thrive as an LLM data engineer, and why are they important?

To thrive as an LLM Data Engineer, you need strong expertise in data engineering, Python programming, and an understanding of large language models, along with a degree in computer science or a related field. Familiarity with tools like TensorFlow, PyTorch, SQL/NoSQL databases, data pipelines (e.g., Apache Airflow), and experience with cloud platforms such as AWS or GCP are typically required. Excellent problem-solving, communication, and collaboration skills help you work effectively with cross-functional teams and adapt to evolving AI technologies. These skills are crucial to efficiently manage, process, and optimize large datasets that enable accurate and scalable language model solutions.

What are popular job titles related to Llm Data Engineer jobs?

For Llm Data Engineer jobs, the most frequently searched job titles are:

Infographic showing various Llm Data Engineer job openings in the United States as of June 2026, with employment types broken down into 89% Full Time, and 11% Part Time. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution, with an average salary of $129,716 per year, or $62.4 per hour.

Senior Data Engineer (Agentic Retrieval & Memory)

Oaks, PA • On-site

TekShapers
Software Development • 201 - 500 employees
Learn more about TekShapersexternal

$108K - $147K/yr

Other

Posted 8 days ago

Job description

Senior Data Engineer – Agentic Retrieval & Memory

Location: Oaks, PA
Type: Long-Term Contract
Experience: 10+ Years
Work Model: Hybrid – Onsite from Day 1

Seeking a Senior Data Engineer with 10+ years of experience, including 5+ years in data engineering and strong hands-on experience with Agentic AI/LLM data, memory, and retrieval systems.

Key Responsibilities

  • Design and implement agent memory across session, conversation, and long-term memory tiers.
  • Build scalable solutions using Redis, NoSQL/document stores, and vector databases.
  • Design and optimize retrieval and semantic search for enterprise AI applications.
  • Evaluate data stores for performance, scalability, latency, retention, and cost.
  • Support RAG, embeddings, chunking, and retrieval quality.
  • Build production-grade data interfaces and libraries using Python.

Required Skills

  • 5+ years Data Engineering with strong data modeling, storage, and query optimization experience.
  • 3+ years Agentic AI/LLM data experience, specifically agent memory, conversation state, summarization, retention, and user/thread isolation.
  • 3+ years Vector/Semantic Search with Azure AI Search, pgvector, Elasticsearch, or similar.
  • Strong NoSQL, Document/Key-Value databases, Redis, caching, partitioning, TTL, and high-volume workloads.
  • Strong Python development experience.
  • Experience with RAG, embeddings, chunking, and retrieval evaluation.
  • Cloud experience with managed data services, identity/access, and private networking.

Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Apply