ZipRecruiter

Log In

1

Senior Llm Engineer Jobs (NOW HIRING)

Censys

Senior AI/LLM Engineer

$179K - $201K/yr

Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The ... Prior knowledge in prompt engineering improving LLM accuracy, reasoning and consistency

Gap International

AI/LLM Engineer

Philadelphia, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

TMS

AI/ LLM Engineer- Next.js

Princeton, NJ · On-site

Role: Senior Full Stack Engineer - AI & Next.js Duration: Long Term Location: United States- Remote Role Summary We are looking for a Senior Full Stack Engineer with strong experience in AI/LLM ...

next page

Showing results 1-20

All JobsLlm Engineer JobsSenior Llm Engineer Jobs

Senior Llm Engineer information

See salary details

$59.5K

$126.6K

$183.5K

How much do senior llm engineer jobs pay per year?

As of Aug 9, 2026, the average yearly pay for senior llm engineer in the United States is $126,557.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $143,500.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a senior LLM engineer, and why are they important?

To thrive as a Senior LLM Engineer, you need deep expertise in machine learning, natural language processing, and advanced programming skills, typically supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as PyTorch, TensorFlow, Hugging Face Transformers, and cloud platforms, along with experience in deploying large-scale language models, is crucial. Strong problem-solving, collaboration, and communication skills set top performers apart in leading cross-functional AI initiatives. These abilities are vital for developing, optimizing, and scaling cutting-edge language models that drive innovation and business value.

Are senior Llm engineers in demand?

Senior Llm engineers are in high demand due to the rapid growth of artificial intelligence and natural language processing industries. They are sought after for their expertise in developing and deploying large language models, often requiring skills in machine learning frameworks, programming, and data management. This demand is expected to continue as AI applications expand across various sectors.

What is a senior LLM engineer?

Senior LLM (Large Language Model) Engineers are experienced professionals who design, build, optimize, and maintain advanced language models like GPT, BERT, or similar AI systems. They work on tasks such as model training, fine-tuning, deployment, and troubleshooting, often collaborating with data scientists and software engineers. Their expertise includes deep learning frameworks, natural language processing, and software engineering best practices. Senior LLM Engineers also play a key role in ensuring the ethical and efficient use of AI models in production systems.

What are some common challenges senior LLM engineers face when deploying large language models in production environments?

Senior LLM Engineers often encounter challenges related to scaling models efficiently, managing latency, and ensuring model outputs are safe and reliable. Deploying large language models requires careful optimization to balance performance with computational costs, as well as robust monitoring to detect and mitigate issues like bias or hallucination in outputs. Collaboration with cross-functional teams, including data scientists, product managers, and DevOps, is key to addressing these challenges and ensuring successful model deployment and maintenance.

What is the difference between Senior Llm Engineer vs Machine Learning Engineer?

AspectSenior Llm EngineerMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or AI; strong programming skills
Work EnvironmentFocus on NLP, language models, and large-scale data processingBroader ML tasks, including data modeling, algorithms, and deployment
Industry UsagePrimarily in AI/NLP-focused companies, research labs

Senior Llm Engineers specialize in large language models and NLP-specific tasks, often requiring advanced NLP knowledge and experience with LLMs. Machine Learning Engineers have a broader scope, working on various ML models and applications across industries. While both roles require strong technical skills, Senior Llm Engineers focus more on language-specific AI, whereas Machine Learning Engineers handle diverse ML projects.

More about Senior Llm Engineer jobs
What cities are hiring for Senior Llm Engineer jobs? Cities with the most Senior Llm Engineer job openings:
What are the most commonly searched types of Llm Engineer jobs? The most popular types of Llm Engineer jobs are:
What states have the most Senior Llm Engineer jobs? States with the most job openings for Senior Llm Engineer jobs include:
What job categories do people searching Senior Llm Engineer jobs look for? The top searched job categories for Senior Llm Engineer jobs are:
Senior Llm Engineer jobs near you
Infographic showing various Senior Llm Engineer job openings in the United States as of August 2026, with employment types broken down into 92% Full Time, 2% Part Time, and 6% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $126,557 per year, or $60.8 per hour.

Software Engineer (Language Modeling), BS+12 yrs

LinkLLC

Columbia, MD • On-site

Full-time

Re-posted 23 days ago

Job description

Job Summary:
LinkLLC is seeking a highly skilled and motivated Sr. LLM Engineer to join their AI/ML team. The role involves designing, developing, and maintaining infrastructure for training and optimizing Large Language Models, as well as collaborating with cross-functional teams to deliver impactful language solutions.
Responsibilities:
• Design, develop, and maintain the infrastructure for training, hosting, and serving LLM instances.
• Optimize model training pipelines to achieve high performance and resource efficiency.
• Implement and integrate state-of-the-art LLM architectures and techniques.
• Collaborate with cross-functional teams to understand business requirements and deliver impactful language solutions.
• Monitor and analyze model performance metrics, identifying areas for improvement and implementing optimizations.
• Develop and maintain documentation, best practices, and coding standards for LLM development and deployment.
• Stay up-to-date with the latest advancements in LLM research and industry trends, and incorporate them into our projects.
• Mentor and guide junior engineers, fostering a culture of continuous learning and knowledge sharing.
Qualifications:
Required:
• 12+ years of experience in software engineering, with a focus on machine learning or natural language processing.
• Degree in Computer Science, Artificial Intelligence, or a related field.
• Strong expertise in deep learning frameworks such as TensorFlow, PyTorch, or MXNet.
• Proficiency in programming languages such as Python, C++, or Java.
• Solid understanding of LLM architectures, training techniques, and evaluation methodologies.
• Familiarity with cloud platforms (e.g., AWS, GCP) and their machine learning services.
• Knowledge of software engineering best practices, including version control, testing, and continuous integration/deployment.
• Excellent problem-solving and debugging skills.
• Strong communication and collaboration abilities to work effectively with cross-functional teams.
Preferred:
• Advanced degree (Master's or Ph.D.) in Computer Science, Artificial Intelligence, or a related field.
• Proven track record of implementing and deploying large-scale LLM systems in production environments.
• Experience with distributed computing frameworks like Apache Spark or Hadoop.
• Experience with natural language understanding, generation, and dialogue systems.
• Familiarity with techniques such as transfer learning, few-shot learning, and reinforcement learning.
• Contributions to open-source projects or research publications in the field of LLMs.
• Experience with serving models using APIs and building scalable inference pipelines.
• Knowledge of DevOps practices and tools like Docker, Kubernetes, and Jenkins.
Company:
We engineer lasting solutions in partnership with our clients, to protect our nation's security information/systems and infrastructure and to defend our country and interests. Founded in , the company is headquartered in Annapolis Junction , Maryland, US, , with a team of 11-50 employees. The company is currently Early Stage.

Apply