ZipRecruiter

Log In

1

Senior Prompt Engineering Jobs in Boston, MA (NOW HIRING)

Motorola

Senior AI Engineer (US Remote)

Waltham, MA · Remote

$180K - $210K/yr

As a senior member of our AI engineering team, you'll provide technical leadership, mentor ... Prompt engineering & optimization * Model evaluation & testing frameworks * AI observability ...

Klaviyo

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

They are seeking a Senior AI Engineer to design, build, and scale production-grade LLM integrations ... prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Recorded Future

Senior Software Engineer

Boston, MA · On-site

$133K - $175K/yr

In this Senior Software Engineer role, you will design, build, and deploy AI Agentic systems to ... LLMs, prompt engineering, agentic loop design, and retrieval-augmented generation (RAG). • ...

Klaviyo

Senior AI Application Engineer

Boston, MA · On-site

They are seeking a Senior AI Application Engineer to design, build, and scale production-grade LLM ... prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Re:Build Manufacturing

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

This senior engineer will work alongside our engineering team and head of product to build ... Strong understanding of LLM fundamentals: prompt engineering, function/tool calling, retrieval ...

Klaviyo

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

... prompt engineering, few-shot learning, fine tuning and evaluation. • Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of ...

Klaviyo

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

... prompt engineering, few-shot learning, fine tuning and evaluation. • Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of ...

Verisk

Senior Software Engineer

Boston, MA · Hybrid

$133K - $175K/yr

Description We are hiring a Senior Software Engineer with deep expertise in AI/ML engineering and ... Experience with LLMs, prompt engineering, or RAG (Retrieval-Augmented Generation) systems

1 point system

Senior AI/Automation Engineer

Boston, MA · On-site

$113K - $148K/yr

Requirement - Senior AI/Automation Engineer Location- Boston, MA and Minneapolis, MN(4 days a week ... Prompt engineering standards o Agent-based orchestration patterns o Secure model invocation and ...

next page

Showing results 1-20

All JobsPrompt Engineering JobsSenior Prompt Engineering JobsSenior Prompt Engineering Jobs in Boston, MA

Senior Prompt Engineering information

See Boston, MA salary details

$64.6K

$137.5K

$199.4K

How much do senior prompt engineering jobs pay per year?

As of Aug 6, 2026, the average yearly pay for senior prompt engineering in Boston, MA is $137,492.00, according to ZipRecruiter salary data. Most workers in this role earn between $113,500.00 and $155,900.00 per year, depending on experience, location, and employer.

Are senior prompt engineers still in demand?

Senior prompt engineers are increasingly in demand as organizations adopt AI and natural language processing technologies. Their expertise in designing effective prompts and working with large language models is valuable across industries, and demand is expected to grow with advancements in AI tools and applications.

What are the key skills and qualifications needed to thrive as a senior prompt engineer, and why are they important?

To excel as a Senior Prompt Engineer, you need strong expertise in natural language processing (NLP), machine learning principles, and experience with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python, frameworks such as TensorFlow or PyTorch, and prompt design tools is essential, as are any relevant certifications in AI or data science. Exceptional analytical thinking, creativity, and communication skills help in crafting effective prompts and collaborating with cross-functional teams. These competencies ensure the development of high-quality AI solutions that meet user requirements and drive innovation.

What are some common challenges faced by senior prompt engineers when collaborating with cross-functional teams?

Senior Prompt Engineers often work closely with data scientists, product managers, and software engineers to develop effective AI prompts. A common challenge is ensuring clear communication about technical constraints and user requirements, as team members may have varying levels of familiarity with prompt engineering concepts. Balancing creativity with practical limitations—such as model capabilities and ethical guidelines—requires active collaboration and adaptability. Additionally, aligning prompt design with evolving project goals can be complex, so strong project management and interpersonal skills are essential for success in this role.

What is the difference between Senior Prompt Engineering vs Prompt Engineer?

AspectSenior Prompt EngineeringPrompt Engineer
CredentialsTypically requires experience in AI, NLP, and related certificationsEntry to mid-level skills in AI and prompt design
Work EnvironmentAdvanced projects, leadership roles, strategic planningHands-on prompt creation, testing, and optimization
Industry UsageUsed in organizations developing AI models and NLP applicationsCommon in AI startups, research labs, and tech companies

Senior Prompt Engineering involves leading complex AI projects, designing advanced prompts, and mentoring teams, while Prompt Engineers focus on creating and refining prompts for specific applications. The senior role requires more experience and strategic oversight, whereas the prompt engineer role is more hands-on and task-focused.

What is a senior prompt engineer?

A Senior Prompt Engineer is a specialist who designs, develops, and optimizes prompts to interact effectively with artificial intelligence language models, such as ChatGPT or other generative AI systems. They leverage deep understanding of AI behavior and natural language processing to create instructions that yield accurate, relevant, and safe outputs. Senior Prompt Engineers may also lead teams, establish best practices, and collaborate with product, engineering, and research teams to improve AI performance and user experience.
What are the most commonly searched types of Prompt Engineering jobs in Boston, MA? The most popular types of Prompt Engineering jobs in Boston, MA are:
What are popular job titles related to Senior Prompt Engineering jobs in Boston, MA? For Senior Prompt Engineering jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Senior Prompt Engineering jobs in Boston, MA look for? The top searched job categories for Senior Prompt Engineering jobs in Boston, MA are:
What cities near Boston, MA are hiring for Senior Prompt Engineering jobs? Cities near Boston, MA with the most Senior Prompt Engineering job openings:
Senior Prompt Engineering jobs near you
Infographic showing various Senior Prompt Engineering job openings in Boston, MA as of June 2026, with employment types broken down into 84% Full Time, 8% Part Time, 1% Temporary, and 7% Contract. Highlights an 89% Physical, 3% Hybrid, and 8% Remote job distribution, with an average salary of $137,492 per year, or $66.1 per hour.

Senior AI Engineer - Boston, MA - Contract Opportunity

Zodiac Solutions

Boston, MA • On-site

$113K - $155K/yr

Contractor

Posted 27 days ago

Job description

Job Title: Senior AI Engineer
Location: Boston, MA – 4 days/week onsite

Duration: Contract Opportunity

Senior Level – 15+ yrs Only

F2F Interview is required for final round mandatory.

Job Description:

This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise. Need someone with Langchain/LangGraph exp.

Seeking a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how our company operates and serves customers. This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise for internal and customer facing use cases.

The ideal candidate has strong experience with a modern AI/ML stack, including a profound Python experience, including AI relevant packages and tools, LLM architectures and frameworks, RAG, MCP, prompt engineering, use of AI tools, budling teams of AI agents, and production-grade AI systems design and development.

You will work closely with technology, data, and business teams to build scalable AI solutions that drive operational efficiency and innovation across the enterprise.

Key Responsibilities:

  • Design, build, and deploy scalable LLM-powered applications, solutions, and digital products for customer support, business use cases, and internal productivity.
  • Develop AI agents, Agentic Platforms, and Agentic AI systems capable of reasoning, planning, and executing multi-step workflows.
  • Implement Retrieval-Augmented Generation (RAG) architectures and pipelines to leverage proprietary data, and internal knowledge bases.
  • Build MCP servers, multi-connectivity enabled and multi-modal Agentic platforms, and AI assistants to support internal teams and customer facing.
  • Integrate AI/ML solutions with enterprise systems, APIs, and data platforms.
  • Design prompt strategies, evaluation frameworks, and guardrails to ensure accuracy, security, and regulatory compliance.
  • Optimize LLM performance through fine-tuning, prompt engineering, and model orchestration.
  • Develop MLOps and LLMOps pipelines for monitoring, evaluation, and continuous improvement of AI systems.
  • Help in forming buy or build decisions and work with external vendors, consultants and internal teams to deliver scalable top-quality AI solutions timely.
  • Stay up to date with emerging advancements in AI/ML, Generative AI, Agentinc frameworks, and model architectures. 

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.
  • 2+ years of software engineering experience, including work with machine learning (ML) or AI systems.
  • Hands-on experience building LLM-powered applications in production environments.
  • Strong programming skills in Python, and familiarity with AI/ML relevant packages such as NumPy, Pandas, SciPy and Scikit-learn.
  • Experience with LLM ecosystems such as:
    • OpenAI / Anthropic / Google, Open-source LLMs
    • Hugging Face
    • LangChain, LlamaIndex, or similar orchestration frameworks
  • Experience building RAG pipelines and working with vector databases.
  • Understanding of prompt engineering, embeddings, and model evaluation.
  • Experience building APIs, MCPs, and scalable backend services.
  • Experience with Claude Code, Codex, Cursor, GitHub Copilot, or similar.
  • Ability to collaborate with cross-functional teams.
  • Passion for technology and AI.

Preferred Qualifications:

  • Experience building AI agents, agentic platforms, or autonomous workflows.
  • Familiarity with agent frameworks (LangGraph, AutoGen, CrewAI, Semantic Kernel, Frontier, etc.).
  • Experience with fine-tuning LLMs or parameter-efficient training methods (LoRA, PEFT).
  • Experience with cloud-based AI infrastructure (AWS, Azure, or GCP).
  • Familiarity with Java, JS, and Java applications and environments.
  • Experience with MLOps / LLMOps tools and evaluation pipelines.

Experience implementing AI governance, observability, and guardrails.