ZipRecruiter

Log In

1

Prompt Engineer Jobs in Boston, MA (NOW HIRING)

Klaviyo

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Mass Digital Health

AI Solutions Engineer

Cambridge, MA · On-site

$107 - $170/hr

  • Retirement

  • PTO

Responsibilities * Design, develop, and deploy enterprise AI solutions from concept through production, leveraging large language models (LLMs), AI agents, prompt engineering, and ...

New

Tata Consultancy Service Limited

AI/ML Engineer

Marlborough, MA · On-site

$150K - $160K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Prompt Engineering * RAG Architecture * Vector Databases * PyTorch / TensorFlow * Azure AI / Azure ML * MLOps (MLflow, Kubeflow) * Databricks & Lakehouse Architecture * Agentic AI Frameworks ...

New

Tata Consultancy Service Limited

AI/ML Engineer

Marlborough, MA · On-site

$150K - $160K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Prompt Engineering * RAG Architecture * Vector Databases * PyTorch / TensorFlow * Azure AI / Azure ML * MLOps (MLflow, Kubeflow) * Databricks & Lakehouse Architecture * Agentic AI Frameworks ...

New

Northeastern University

Associate AI Engineer

Boston, MA · On-site

$88 - $124/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Advanced knowledge of NLP techniques and large language models (LLMs), including prompt engineering, context management, and implementation strategies for enterprise applications.* **Cloud Computing:

NorthEastern

Associate AI Engineer

Boston, MA

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Advanced knowledge of NLP techniques and large language models (LLMs), including prompt engineering, context management, and implementation strategies for enterprise applications. * Cloud Computing:

Northeastern University

Associate AI Engineer

Boston, MA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Advanced knowledge of NLP techniques and large language models (LLMs), including prompt engineering, context management, and implementation strategies for enterprise applications. * Cloud Computing:

SevenAI

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Drive prompt engineering and iteration - refine prompts, templates, and context strategies to meet product quality and reliability goals. * Manage real-world evaluation metrics - measure usefulness ...

Klaviyo

Senior AI Application Engineer

Boston, MA · On-site

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

Re:Build Manufacturing

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

You've shipped LLM-powered agent systems to real users, you have strong intuitions about prompt engineering, tool use, and orchestration patterns, and you keep up with a field that changes fast. You ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · Hybrid

$133K - $175K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · On-site +1

$133K - $175K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Doist

Senior Software Engineer, Agentic AI

Boston, MA · On-site

$140 - $200/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Invicti Security

Senior Software Engineer, Agentic AI

Boston, MA · Remote

$125K - $165K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

LLM Prompt Engineering: Develop and refine prompt chains for real security use cases, including triage, prioritization, and remediation * RAG & Memory Systems: Build retrieval-augmented generation ...

Manulife

AI Engineer - Hybrid

Boston, MA · Hybrid

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

AI Engineer Job Posting Description The AI Engineer will join the AI team supporting the Long-Term ... Implement GenAI and LLM-based solutions, including retrieval-augmented generation, prompt ...

New

YO AI Labs

AI Software Engineer Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Technical Documentation * Technical & Professional Writing * Content Review & Editing * Data Annotation * Fact Checking * Independent Research * Business ...

previous pagenext page

Showing results 21-40

All JobsPrompt Engineer JobsPrompt Engineer Jobs in Boston, MA

Prompt Engineer information

See Boston, MA salary details

$10

$51

$95

How much do prompt engineer jobs pay per hour?

As of Aug 19, 2026, the average hourly pay for prompt engineer in Boston, MA is $51.15, according to ZipRecruiter salary data. Most workers in this role earn between $38.89 and $66.06 per hour, depending on experience, location, and employer.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

How much do prompt engineers make?

Prompt engineers typically earn between $80,000 and $150,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in AI and machine learning can command higher salaries, especially in tech hubs or companies investing heavily in AI development.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant responses. This role involves understanding AI behavior, crafting clear instructions, and often requires knowledge of machine learning, programming, or data analysis.

What are the most commonly searched types of Prompt Engineer jobs in Boston, MA?

The most popular types of Prompt Engineer jobs in Boston, MA are:

What are popular job titles related to Prompt Engineer jobs in Boston, MA?

For Prompt Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Prompt Engineer jobs in Boston, MA look for?

The top searched job categories for Prompt Engineer jobs in Boston, MA are:

What cities near Boston, MA are hiring for Prompt Engineer jobs?

Cities near Boston, MA with the most Prompt Engineer job openings:

Prompt Engineer jobs near you
Infographic showing various Prompt Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 90% Full Time, 5% Part Time, and 5% Contract. Highlights an 86% Physical, 6% Hybrid, and 8% Remote job distribution, with an average salary of $106,396 per year, or $51.2 per hour.

Agentic AI & Generative AI Engineer

Career Soft Solutions Inc

Boston, MA • On-site

$105K - $145K/yr

Other

Posted 20 days ago

Job description

Job Title: Agentic AI & Generative AI Engineer
Location: Onsite – Richardson,TX/ charlotte, NC
Employment Type: Full-Time / Contract

Job Summary

We are seeking an experienced Agentic AI & Generative AI Engineer to design, develop, and deploy next-generation AI applications powered by Large Language Models (LLMs), autonomous AI agents, and modern AI frameworks. The ideal candidate will have hands-on experience building intelligent AI systems using OpenAI, Anthropic, Gemini, Llama, LangChain, LangGraph, CrewAI, AutoGen, and Retrieval-Augmented Generation (RAG) architectures.

This role involves developing AI agents capable of reasoning, planning, tool usage, memory management, and workflow automation while integrating enterprise data sources and cloud infrastructure.

Key Responsibilities

  • Design, build, and deploy Agentic AI solutions capable of autonomous decision-making and multi-step reasoning.
  • Develop Generative AI applications using Large Language Models (LLMs) such as GPT-4/5, Claude, Gemini, and Llama.
  • Build multi-agent systems using frameworks like LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and enterprise knowledge repositories.
  • Develop AI copilots, intelligent assistants, chatbots, and workflow automation solutions.
  • Integrate AI applications with REST APIs, enterprise applications, databases, and cloud services.
  • Fine-tune prompt engineering strategies to improve response quality, reasoning, and accuracy.
  • Design agent memory, planning, orchestration, and tool-calling capabilities.
  • Deploy AI workloads on Azure, AWS, or Google Cloud using containerized architectures.
  • Optimize inference performance, latency, scalability, and cost.
  • Implement AI governance, security, responsible AI, and compliance best practices.
  • Monitor model performance and continuously improve AI systems using user feedback and evaluation metrics.
  • Collaborate with product owners, architects, data scientists, and software engineers throughout the AI development lifecycle.

Required Qualifications

  • Bachelor''''''''s or Master''''''''s degree in Computer Science, Artificial Intelligence, Data Science, or related field.
  • 5+ years of software engineering experience.
  • 2+ years of hands-on experience building Generative AI or LLM-powered applications.
  • Strong programming skills in Python.
  • Experience with OpenAI, Anthropic Claude, Gemini, Llama, or other foundation models.
  • Strong understanding of Prompt Engineering and LLM optimization.
  • Experience building RAG applications.
  • Experience with Vector Databases such as Pinecone, Weaviate, Chroma, FAISS, Milvus, or Azure AI Search.
  • Experience with LangChain, LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Knowledge of embeddings, chunking, semantic search, and retrieval optimization.
  • Experience integrating AI solutions with REST APIs and enterprise applications.
  • Strong understanding of Docker, Kubernetes, CI/CD pipelines, and Git.
  • Experience deploying AI solutions on Azure, AWS, or Google Cloud.

Preferred Qualifications

  • Experience fine-tuning open-source LLMs.
  • Knowledge of Model Context Protocol (MCP).
  • Experience with AI agent orchestration platforms.
  • Familiarity with AI observability tools such as LangSmith, Phoenix, Weights & Biases, or MLflow.
  • Experience with Azure AI Foundry, Azure OpenAI, Amazon Bedrock, or Google Vertex AI.
  • Knowledge of knowledge graphs and graph databases (Neo4j).
  • Experience implementing Responsible AI and AI governance frameworks.
  • Experience working with structured and unstructured enterprise data.

Technical Skills

Programming

  • Python
  • SQL
  • JavaScript (preferred)

AI/LLMs

  • OpenAI GPT
  • Anthropic Claude
  • Google Gemini
  • Meta Llama
  • Mistral
  • Hugging Face Transformers

Agentic AI Frameworks

  • LangGraph
  • CrewAI
  • AutoGen
  • Semantic Kernel
  • OpenAI Agents SDK

RAG & Retrieval

  • LangChain
  • LlamaIndex
  • Azure AI Search
  • Pinecone
  • Weaviate
  • Chroma
  • FAISS
  • Milvus

Cloud Platforms

  • Microsoft Azure
  • AWS
  • Google Cloud Platform

DevOps

  • Docker
  • Kubernetes
  • GitHub Actions
  • Azure DevOps
  • Jenkins
  • Terraform

Databases

  • PostgreSQL
  • MongoDB
  • Redis
  • Neo4j

APIs & Integration

  • REST APIs
  • GraphQL
  • MCP
  • Webhooks

Observability

  • LangSmith
  • MLflow
  • Weights & Biases
  • OpenTelemetry

Nice-to-Have Skills

  • AI workflow automation
  • Multi-agent orchestration
  • Human-in-the-loop systems
  • Reinforcement learning concepts
  • AI safety and governance
  • Prompt optimization and evaluation
  • Knowledge graph integration
  • AI-powered business process automation

Soft Skills

  • Strong analytical and problem-solving skills.

Apply