1

Prompt Engineer Jobs in Boston, MA (NOW HIRING)

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

... prompt engineering, few-shot learning, fine tuning and evaluation. • Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of ...

Implement agent-specific testing strategies including prompt validation, multi-step workflow ... Mentor junior engineers on building production-grade agents, designing tool integrations, and ...

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

... prompt engineering, few-shot learning, fine tuning and evaluation. • Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of ...

... prompt injection resistance, guardrail robustness, and graceful degradation under ambiguous patient inputs. • Champion 'shift-left' quality practices: embed eval criteria into prompt engineering ...

Champion "shift-left" quality practices: embed eval criteria into prompt engineering workflows, define acceptance criteria for new agent behaviors, and make quality a first-class concern in the ...

AI/ML Engineer

Boston, MA · On-site

$32 - $35/hr

Nice to Have AI Agent Development Multi-Agent Systems Prompt Engineering Fine-tuning LLMs Knowledge Graphs MLOps Certification Cloud Certifications (AWS, Azure, GCP)

AI/ML Engineer

Boston, MA · On-site

$35 - $45/hr

Prompt Engineering * Fine-tuning LLMs * Knowledge Graphs * MLOps Certification * Cloud Certifications (AWS, Azure, GCP)

AI/ML Engineer

Boston, MA · On-site

$124K - $149K/yr

Nice to Have AI Agent Development Multi-Agent Systems Prompt Engineering Fine-tuning LLMs Knowledge Graphs MLOps Certification Cloud Certifications (AWS, Azure, GCP)

AI/ML Engineer

Boston, MA · On-site

$30 - $35/hr

Nice to Have AI Agent Development Multi-Agent Systems Prompt Engineering Fine-tuning LLMs Knowledge Graphs MLOps Certification Cloud Certifications (AWS, Azure, GCP)

AI/ML Engineer

Boston, MA · On-site

$124K - $149K/yr

Nice to Have AI Agent Development Multi-Agent Systems Prompt Engineering Fine-tuning LLMs Knowledge Graphs MLOps Certification Cloud Certifications (AWS, Azure, GCP)

Senior AI Engineer

Concord, MA · On-site

$114K - $157K/yr

Hands-on familiarity with Prompt Engineering by leveraging LLM frameworks such as LangChain. * Strong programming skills in Python and familiarity with modern data/ML pipelines. * Solid understanding ...

Senior AI Engineer

Concord, MA · On-site

$114K - $157K/yr

Hands-on familiarity with Prompt Engineering by leveraging LLM frameworks such as LangChain. * Strong programming skills in Python and familiarity with modern data/ML pipelines. * Solid understanding ...

Senior AI Engineer - Customer Agent

Boston, MA · On-site

$113K - $155K/yr

... prompt engineering, few-shot learning, fine tuning and evaluation. • Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of ...

Software Engineer, UI

Boston, MA · On-site

$113K - $151K/yr

Skills in prompt engineering to optimally guide AI tools in solving development tasks would be beneficial * Experience with AI-assisted test generation to enhance automation coverage and efficiency ...

Senior Data & AI Engineer

Boston, MA

$115K - $156K/yr

Establish engineering standards and best practices for agentic systems, including observability, evaluation, prompt management, governance, and operational guardrails. What You'll bring: * Deep ...

Senior AI/ML Engineer

Boston, MA · On-site

$113K - $155K/yr

Implement end to end AI application pipelines including data ingestion, prompt engineering, evaluation, deployment, and monitoring * Collaborate closely with engineering, data, and business teams to ...

Senior Software Engineer

Boston, MA · Hybrid

$133K - $175K/yr

Experience with LLMs, prompt engineering, or RAG (Retrieval-Augmented Generation) systems * Familiarity with MLflow, Weights & Biases, or other ML lifecycle management tools * AWS Certification ...

Prompt engineering and prompt iteration * Tool use and API integration for AI agents * Multi-step workflow automation * Rapid prototyping andproductionization * Evaluation, testing, and quality ...

Showing results 41-60

Prompt Engineer information

See Boston, MA salary details

$10

$51

$95

How much do prompt engineer jobs pay per hour?

As of Aug 7, 2026, the average hourly pay for prompt engineer in Boston, MA is $51.15, according to ZipRecruiter salary data. Most workers in this role earn between $38.89 and $66.06 per hour, depending on experience, location, and employer.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance.
What are the most commonly searched types of Prompt Engineer jobs in Boston, MA? The most popular types of Prompt Engineer jobs in Boston, MA are:
What cities near Boston, MA are hiring for Prompt Engineer jobs? Cities near Boston, MA with the most Prompt Engineer job openings:
Infographic showing various Prompt Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 4% Internship, 72% Full Time, 15% Part Time, and 9% Contract. Highlights an 59% In-person, and 41% Remote job distribution, with an average salary of $106,402 per year, or $51.2 per hour.

Senior AI Engineer

Klaviyo

Boston, MA • On-site

$113K - $155K/yr

Full-time

Re-posted 13 days ago


Job description

Job Summary:
Klaviyo is a company that empowers creators to own their own destiny by making first-party data accessible and actionable. As a Senior AI Engineer, you will design and build scalable backend systems and user experiences that power AI products and solutions, collaborating closely with product managers, machine learning engineers, and data scientists.
Responsibilities:
• Design and build backend systems that support scaling our AI solutions for 167K+ customers.
• Develop robust, reliable and scalable data collection and processing pipelines for machine learning models to train and consume.
• Develop robust, reliable and scalable services to serve AI models in production environments.
• Contribute to evolving our agentic architecture — making our AI agents more self-sufficient and performant.
• Contribute to a culture of ownership, experimentation, and customer-centric product thinking.
Qualifications:
Required:
• 5–7 years of professional experience in software engineering, with a strong focus on backend systems and distributed architectures.
• Have hands-on experience building and deploying generative AI and agentic AI applications into production, with expertise in prompt engineering, few-shot learning, fine tuning and evaluation.
• Experienced backend engineer with a strong track record of building scalable, distributed systems, especially in the service of AI agent capabilities.
• Proficient in Python and modern backend frameworks (FastAPI, Django preferred).
• Experience creating human and automated evals to ensure high AI model quality.
• Proficient in big data tools such as Apache Spark and Hadoop.
• Deep experience with asynchronous processing and distributed task queues (Celery, Kafka, SQS, RabbitMQ, Redis).
• Strong understanding of database technologies and ORMs (SQLAlchemy, Alembic).
• Comfortable with cloud-native architectures (AWS) and container orchestration (Kubernetes); can manage infrastructure and CI/CD pipelines.
• Skilled at designing and building robust APIs.
• Able to operate with a high degree of autonomy, handle ambiguity, and thrive in a fast-moving, startup-like environment.
• Driven by curiosity. You're someone who learns and stays up to date with this rapidly evolving field.
• Comfortable collaborating directly with product managers and customers to shape solutions.
Preferred:
• Trained ML models in the past and deployed them in production systems to generate impact to businesses.
• Experience in reinforcement learning.
Company:
Klaviyo is an automation and email platform designed to help grow businesses. Founded in 2012, the company is headquartered in Boston, USA, with a team of 1001-5000 employees. The company is currently Late Stage.