ZipRecruiter

Log In

1

Prompt Engineer Jobs in Boston, MA (NOW HIRING)

Klaviyo

Senior AI Application Engineer

Boston, MA · On-site

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · On-site +1

$133K - $175K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · Hybrid

$133K - $175K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · Remote

$125K - $165K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

YO AI Labs

AI Software Engineer Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Technical Documentation * Technical & Professional Writing * Content Review & Editing * Data Annotation * Fact Checking * Independent Research * Business ...

New

Philips

AI Solutions Engineer

Cambridge, MA · On-site

$107K - $170K/yr

  • Retirement

  • PTO

Design, develop, and deploy enterprise AI solutions from concept through production, leveraging large language models (LLMs), AI agents, prompt engineering, and Retrieval-Augmented Generation (RAG)

YO AI Labs

AI Software Engineer Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Technical Documentation * Technical & Professional Writing * Content Review & Editing * Data Annotation * Fact Checking * Independent Research * Business ...

New

Vrtx

Principal Engineer, AI Authoring

Boston, MA · Hybrid

$166K - $250K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Expertise in prompt engineering, retrieval pipelines, and modular AI system design. * Strong background in engineering data workflows, including structured and unstructured data integration.

CVS Health

Staff Software Development Engineer

Wellesley, MA · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Design, implement, and integrate LLM-based solutions into UM workflows, applying hands-on knowledge of ML concepts such as prompt engineering, fine-tuning, embeddings, and retrieval-augmented ...

Recorded Future

Senior Software Engineer

Boston, MA · On-site

$133K - $175K/yr

... prompt engineering, agentic loop design, and retrieval-augmented generation (RAG). • Experience driving coordinated action between cross-functional teams (product, research, stakeholders) working ...

Entegris

Specialist, AI Engineer

Bedford, MA · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Specialist, AI Engineer The Role Entegris is seeking a Junior AI Engineer to join our IT Digital ... Contribute to prompt development, evaluation, and basic observability practices (e.g., logging ...

Entegris

Specialist, AI Engineer

Bedford, MA · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Specialist, AI Engineer The Role Entegris is seeking a Junior AI Engineer to join our IT Digital ... Contribute to prompt development, evaluation, and basic observability practices (e.g., logging ...

Entegris

Specialist, AI Engineer

Bedford, MA · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Specialist, AI Engineer The Role Entegris is seeking a Junior AI Engineer to join our IT Digital ... Contribute to prompt development, evaluation, and basic observability practices (e.g., logging ...

previous pagenext page

Showing results 21-40

All JobsPrompt Engineer JobsPrompt Engineer Jobs in Boston, MA

Prompt Engineer information

See Boston, MA salary details

$10

$51

$95

How much do prompt engineer jobs pay per hour?

As of Aug 12, 2026, the average hourly pay for prompt engineer in Boston, MA is $51.22, according to ZipRecruiter salary data. Most workers in this role earn between $38.94 and $66.15 per hour, depending on experience, location, and employer.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance.
What are the most commonly searched types of Prompt Engineer jobs in Boston, MA? The most popular types of Prompt Engineer jobs in Boston, MA are:
What are popular job titles related to Prompt Engineer jobs in Boston, MA? For Prompt Engineer jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Prompt Engineer jobs in Boston, MA look for? The top searched job categories for Prompt Engineer jobs in Boston, MA are:
What cities near Boston, MA are hiring for Prompt Engineer jobs? Cities near Boston, MA with the most Prompt Engineer job openings:
Prompt Engineer jobs near you
Infographic showing various Prompt Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 86% Full Time, 7% Part Time, and 7% Contract. Highlights an 66% In-person, 7% Hybrid, and 27% Remote job distribution, with an average salary of $106,532 per year, or $51.2 per hour.

Senior AI Application Engineer

Klaviyo

Boston, MA • On-site

Full-time

Re-posted 14 days ago

Job description

Job Summary:
Klaviyo is a company that empowers creators by making first-party data accessible and actionable. They are seeking a Senior AI Application Engineer to design, build, and scale production-grade LLM integrations and AI-powered automation tools, focusing on applied AI research and full-stack software engineering.
Responsibilities:
• Design and build LLM-powered applications: Architect and develop production-grade systems leveraging large language models (GPT-4, Claude, Mistral, Llama) for internal automation, knowledge retrieval, and intelligent workflow assistance.
• Build and maintain AI integration pipelines: Design robust, scalable API integrations between AI models and internal systems such as HRIS, ticketing, CRM, and knowledge bases, ensuring reliability, low latency, and high availability.
• Develop full-stack AI features end-to-end: Own the complete development of AI features across the stack from backend model orchestration and API layers to frontend interfaces that make AI accessible to non-technical employees.
• Architect and manage CI/CD pipelines for AI systems: Build and maintain automated deployment pipelines for AI models and services, including model evaluation frameworks, A/B testing infrastructure, and safe rollout strategies.
• Implement RAG and retrieval systems: Design and build retrieval-augmented generation systems grounded in Klaviyo internal knowledge, ensuring accuracy, relevance, and up-to-date responses at scale.
• Evaluate and fine-tune AI models: Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques.
• Establish AI engineering best practices: Define coding standards, testing frameworks, and architectural patterns for AI development at Klaviyo, enabling the team to ship reliable AI features consistently.
• Build AI observability and monitoring tooling: Instrument AI systems with latency monitoring, output quality evaluation, hallucination detection, cost dashboards, and production alerting.
• Collaborate with Product and Data Science: Work closely with PMs, data scientists, and ML engineers to translate requirements into technical implementations, maintaining a tight feedback loop between experimentation and production.
• Drive security and compliance in AI systems: Ensure AI integrations follow data privacy best practices, implement guardrails for sensitive data handling, and maintain compliance with Klaviyo security and governance standards.
Qualifications:
Required:
• 3+ years of software engineering experience, with at least 2 years focused on building AI, ML, or LLM-powered systems in production.
• Deep expertise with large language models such as OpenAI, Anthropic, Mistral, or Llama, and experience integrating them into production applications via API.
• Strong full-stack engineering skills across Python (FastAPI, Flask, or Django) and TypeScript or JavaScript, with experience in modern frontend frameworks.
• Proven experience designing and building CI/CD pipelines for software or ML systems using tools such as GitHub Actions, Jenkins, or CircleCI.
• Experience with RAG systems, vector databases (Pinecone, Weaviate, pgvector), and embedding models.
• Proficiency with cloud infrastructure (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and infrastructure-as-code tools such as Terraform or Pulumi.
• Experience with prompt engineering, model evaluation frameworks, and LLM observability tools such as LangSmith or Weights and Biases.
Company:
Klaviyo is an automation and email platform designed to help grow businesses. Founded in 2012, the company is headquartered in Boston, USA, with a team of 1001-5000 employees. The company is currently Late Stage.

Apply