1

Prompt Engineer Jobs in Massachusetts (NOW HIRING)

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Associate AI Engineer

Boston, MA · On-site

$88 - $124/hr

Advanced knowledge of NLP techniques and large language models (LLMs), including prompt engineering, context management, and implementation strategies for enterprise applications.* **Cloud Computing:

Advanced knowledge of NLP techniques and large language models (LLMs), including prompt engineering, context management, and implementation strategies for enterprise applications. * Cloud Computing:

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Drive prompt engineering and iteration - refine prompts, templates, and context strategies to meet product quality and reliability goals. * Manage real-world evaluation metrics - measure usefulness ...

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

You've shipped LLM-powered agent systems to real users, you have strong intuitions about prompt engineering, tool use, and orchestration patterns, and you keep up with a field that changes fast. You ...

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

AI Engineer Job Posting Description The AI Engineer will join the AI team supporting the Long-Term ... Implement GenAI and LLM-based solutions, including retrieval-augmented generation, prompt ...

New

Prompt Engineering * AI Output Evaluation * Technical Documentation * Technical & Professional Writing * Content Review & Editing * Data Annotation * Fact Checking * Independent Research * Business ...

AI Solutions Engineer

Cambridge, MA · On-site

$107K - $170K/yr

Design, develop, and deploy enterprise AI solutions from concept through production, leveraging large language models (LLMs), AI agents, prompt engineering, and Retrieval-Augmented Generation (RAG)

Prompt Engineering * AI Output Evaluation * Technical Documentation * Technical & Professional Writing * Content Review & Editing * Data Annotation * Fact Checking * Independent Research * Business ...

Showing results 21-40

Prompt Engineer information

See Massachusetts salary details

$11

$51

$96

How much do prompt engineer jobs pay per hour?

As of Aug 21, 2026, the average hourly pay for prompt engineer in Massachusetts is $51.42, according to ZipRecruiter salary data. Most workers in this role earn between $39.13 and $66.44 per hour, depending on experience, location, and employer.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

How much do prompt engineers make?

Prompt engineers typically earn between $80,000 and $150,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in AI and machine learning can command higher salaries, especially in tech hubs or companies investing heavily in AI development.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant responses. This role involves understanding AI behavior, crafting clear instructions, and often requires knowledge of machine learning, programming, or data analysis.

What are the most commonly searched types of Prompt Engineer jobs in Massachusetts?

The most popular types of Prompt Engineer jobs in Massachusetts are:

What cities in Massachusetts are hiring for Prompt Engineer jobs?

Cities in Massachusetts with the most Prompt Engineer job openings:

Infographic showing various Prompt Engineer job openings in Massachusetts as of August 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 85% Physical, 6% Hybrid, and 9% Remote job distribution, with an average salary of $106,962 per year, or $51.4 per hour.

Senior AI Engineer

Klaviyo

Boston, MA • On-site

$113K - $155K/yr

Full-time

Re-posted 27 days ago


Job description

Job Summary:
Klaviyo is a company that empowers creators to own their destiny by making first-party data accessible and actionable. They are seeking a Senior AI Engineer to design, build, and scale production-grade LLM integrations and AI-powered automation tools, focusing on applied AI research and full-stack software engineering.
Responsibilities:
• Design and build LLM-powered applications: Architect and develop production-grade systems leveraging large language models (GPT-4, Claude, Mistral, Llama) for internal automation, knowledge retrieval, and intelligent workflow assistance.
• Build and maintain AI integration pipelines: Design robust, scalable API integrations between AI models and internal systems such as HRIS, ticketing, CRM, and knowledge bases, ensuring reliability, low latency, and high availability.
• Develop full-stack AI features end-to-end: Own the complete development of AI features across the stack from backend model orchestration and API layers to frontend interfaces that make AI accessible to non-technical employees.
• Architect and manage CI/CD pipelines for AI systems: Build and maintain automated deployment pipelines for AI models and services, including model evaluation frameworks, A/B testing infrastructure, and safe rollout strategies.
• Implement RAG and retrieval systems: Design and build retrieval-augmented generation systems grounded in Klaviyo internal knowledge, ensuring accuracy, relevance, and up-to-date responses at scale.
• Evaluate and fine-tune AI models: Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques.
• Establish AI engineering best practices: Define coding standards, testing frameworks, and architectural patterns for AI development at Klaviyo, enabling the team to ship reliable AI features consistently.
• Build AI observability and monitoring tooling: Instrument AI systems with latency monitoring, output quality evaluation, hallucination detection, cost dashboards, and production alerting.
• Collaborate with Product and Data Science: Work closely with PMs, data scientists, and ML engineers to translate requirements into technical implementations, maintaining a tight feedback loop between experimentation and production.
• Drive security and compliance in AI systems: Ensure AI integrations follow data privacy best practices, implement guardrails for sensitive data handling, and maintain compliance with Klaviyo security and governance standards.
Qualifications:
Required:
• 3+ years of software engineering experience, with at least 2 years focused on building AI, ML, or LLM-powered systems in production.
• Deep expertise with large language models such as OpenAI, Anthropic, Mistral, or Llama, and experience integrating them into production applications via API.
• Strong full-stack engineering skills across Python (FastAPI, Flask, or Django) and TypeScript or JavaScript, with experience in modern frontend frameworks.
• Proven experience designing and building CI/CD pipelines for software or ML systems using tools such as GitHub Actions, Jenkins, or CircleCI.
• Experience with RAG systems, vector databases (Pinecone, Weaviate, pgvector), and embedding models.
• Proficiency with cloud infrastructure (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and infrastructure-as-code tools such as Terraform or Pulumi.
• Experience with prompt engineering, model evaluation frameworks, and LLM observability tools such as LangSmith or Weights and Biases.
Company:
Klaviyo is an automation and email platform designed to help grow businesses. Founded in 2012, the company is headquartered in Boston, USA, with a team of 1001-5000 employees. The company is currently Late Stage.