ZipRecruiter

Log In

1

Prompt Engineering Jobs in Massachusetts (NOW HIRING)

Overture Partners

AI Engineer

Boston, MA · On-site

$100 - $130/hr

Strong understanding of prompt engineering, embeddings, model evaluation, and AI application optimization. * Experience developing scalable APIs, backend services, and enterprise AI integrations ...

New

Overture Partners

AI Engineer

Boston, MA · On-site

$65 - $80/hr

Strong understanding of prompt engineering, embeddings, model evaluation, and AI application optimization. * Experience developing scalable APIs, backend services, and enterprise AI integrations ...

Klaviyo

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

YO AI Labs

AI Data Science Expert - Remote

Boston, MA · On-site

$34.44/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

YO AI Labs

AI Data Scientist Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

YO AI Labs

AI Data Scientist Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

YO AI Labs

AI Data Science Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

YO AI Labs

AI Data Science Expert - Remote

Boston, MA · Remote

$100 - $200/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

YO AI Labs

AI Data Scientist Expert - Remote

Boston, MA · On-site

$83 - $124/hr

Prompt Engineering * AI Output Evaluation * Quality Assurance * Technical Documentation * Technical & Report Writing * Content Review & Editing * Data Annotation * Data Interpretation * Fact Checking

Klaviyo

Senior AI Application Engineer

Boston, MA · On-site

Lead benchmarking, evaluation, and fine-tuning of foundation models for Klaviyo use cases, including prompt engineering and parameter-efficient fine-tuning techniques. • Establish AI engineering ...

previous pagenext page

Showing results 21-40

All JobsPrompt Engineering JobsPrompt Engineering Jobs in Massachusetts

Prompt Engineering information

See Massachusetts salary details

$35.5K

$68.8K

$104.3K

How much do prompt engineering jobs pay per year?

As of Aug 21, 2026, the average yearly pay for prompt engineering in Massachusetts is $68,779.00, according to ZipRecruiter salary data. Most workers in this role earn between $51,300.00 and $78,600.00 per year, depending on experience, location, and employer.

What is prompt engineering?

A Prompt Engineering job involves designing, refining, and optimizing prompts to improve the performance of AI language models. Prompt engineers work with large language models (LLMs) to generate accurate, relevant, and high-quality responses. They experiment with different phrasing techniques, fine-tune AI outputs, and collaborate with developers to enhance model capabilities. This role is essential in ensuring AI systems provide reliable and useful responses for various applications.

What skills and qualifications are needed for prompt engineering?

To excel in Prompt Engineering, a strong grasp of natural language processing (NLP), machine learning concepts, and analytical thinking is essential, often supported by a degree in computer science or a related field. Familiarity with AI platforms, code repositories (such as GitHub), and prompt development tools is typically required. Excellent problem-solving, creativity, and cross-functional communication skills help Prompt Engineers effectively collaborate and refine model outputs. These capabilities enable the creation of precise, effective prompts driving high-quality AI responses in rapidly evolving technical environments.

What are the most common challenges faced by prompt engineers in their daily work?

Prompt Engineers frequently encounter challenges such as ensuring the clarity and relevance of prompts to achieve accurate AI responses, troubleshooting inconsistent model behavior, and staying updated with evolving AI technologies. Balancing experimentation with efficiency is often essential, as iterative testing and refinement are core parts of the workflow. Collaboration with data scientists, product managers, and other engineers is common, requiring adaptability and strong communication skills. These challenges make the role dynamic and rewarding for professionals who enjoy problem-solving and innovation.

Is prompt engineering still in demand?

Prompt engineering is currently in high demand as organizations seek experts to optimize interactions with AI language models. The role requires skills in natural language processing, prompt design, and familiarity with AI tools, making it a valuable specialization in AI development and deployment.

What do you do as a prompt engineer?

A prompt engineer designs and refines prompts to optimize the performance of AI language models. They analyze model responses, experiment with prompt structures, and use tools like AI development platforms to improve accuracy and relevance in outputs.

What are the most commonly searched types of Prompt Engineering jobs in Massachusetts?

The most popular types of Prompt Engineering jobs in Massachusetts are:

What are popular job titles related to Prompt Engineering jobs in Massachusetts?

For Prompt Engineering jobs in Massachusetts, the most frequently searched job titles are:

What job categories do people searching Prompt Engineering jobs in Massachusetts look for?

The top searched job categories for Prompt Engineering jobs in Massachusetts are:

What cities in Massachusetts are hiring for Prompt Engineering jobs?

Cities in Massachusetts with the most Prompt Engineering job openings:

Prompt Engineering jobs near you
Infographic showing various Prompt Engineering job openings in Massachusetts as of August 2026, with employment types broken down into 94% Full Time, 3% Part Time, 2% Contract, and 1% Nights. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $68,779 per year, or $33.1 per hour.

Agentic AI & Generative AI Engineer

Career Soft Solutions Inc

Boston, MA • On-site

$105K - $145K/yr

Other

Posted 22 days ago

Job description

Job Title: Agentic AI & Generative AI Engineer
Location: Onsite – Richardson,TX/ charlotte, NC
Employment Type: Full-Time / Contract

Job Summary

We are seeking an experienced Agentic AI & Generative AI Engineer to design, develop, and deploy next-generation AI applications powered by Large Language Models (LLMs), autonomous AI agents, and modern AI frameworks. The ideal candidate will have hands-on experience building intelligent AI systems using OpenAI, Anthropic, Gemini, Llama, LangChain, LangGraph, CrewAI, AutoGen, and Retrieval-Augmented Generation (RAG) architectures.

This role involves developing AI agents capable of reasoning, planning, tool usage, memory management, and workflow automation while integrating enterprise data sources and cloud infrastructure.

Key Responsibilities

  • Design, build, and deploy Agentic AI solutions capable of autonomous decision-making and multi-step reasoning.
  • Develop Generative AI applications using Large Language Models (LLMs) such as GPT-4/5, Claude, Gemini, and Llama.
  • Build multi-agent systems using frameworks like LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and enterprise knowledge repositories.
  • Develop AI copilots, intelligent assistants, chatbots, and workflow automation solutions.
  • Integrate AI applications with REST APIs, enterprise applications, databases, and cloud services.
  • Fine-tune prompt engineering strategies to improve response quality, reasoning, and accuracy.
  • Design agent memory, planning, orchestration, and tool-calling capabilities.
  • Deploy AI workloads on Azure, AWS, or Google Cloud using containerized architectures.
  • Optimize inference performance, latency, scalability, and cost.
  • Implement AI governance, security, responsible AI, and compliance best practices.
  • Monitor model performance and continuously improve AI systems using user feedback and evaluation metrics.
  • Collaborate with product owners, architects, data scientists, and software engineers throughout the AI development lifecycle.

Required Qualifications

  • Bachelor''''''''s or Master''''''''s degree in Computer Science, Artificial Intelligence, Data Science, or related field.
  • 5+ years of software engineering experience.
  • 2+ years of hands-on experience building Generative AI or LLM-powered applications.
  • Strong programming skills in Python.
  • Experience with OpenAI, Anthropic Claude, Gemini, Llama, or other foundation models.
  • Strong understanding of Prompt Engineering and LLM optimization.
  • Experience building RAG applications.
  • Experience with Vector Databases such as Pinecone, Weaviate, Chroma, FAISS, Milvus, or Azure AI Search.
  • Experience with LangChain, LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Knowledge of embeddings, chunking, semantic search, and retrieval optimization.
  • Experience integrating AI solutions with REST APIs and enterprise applications.
  • Strong understanding of Docker, Kubernetes, CI/CD pipelines, and Git.
  • Experience deploying AI solutions on Azure, AWS, or Google Cloud.

Preferred Qualifications

  • Experience fine-tuning open-source LLMs.
  • Knowledge of Model Context Protocol (MCP).
  • Experience with AI agent orchestration platforms.
  • Familiarity with AI observability tools such as LangSmith, Phoenix, Weights & Biases, or MLflow.
  • Experience with Azure AI Foundry, Azure OpenAI, Amazon Bedrock, or Google Vertex AI.
  • Knowledge of knowledge graphs and graph databases (Neo4j).
  • Experience implementing Responsible AI and AI governance frameworks.
  • Experience working with structured and unstructured enterprise data.

Technical Skills

Programming

  • Python
  • SQL
  • JavaScript (preferred)

AI/LLMs

  • OpenAI GPT
  • Anthropic Claude
  • Google Gemini
  • Meta Llama
  • Mistral
  • Hugging Face Transformers

Agentic AI Frameworks

  • LangGraph
  • CrewAI
  • AutoGen
  • Semantic Kernel
  • OpenAI Agents SDK

RAG & Retrieval

  • LangChain
  • LlamaIndex
  • Azure AI Search
  • Pinecone
  • Weaviate
  • Chroma
  • FAISS
  • Milvus

Cloud Platforms

  • Microsoft Azure
  • AWS
  • Google Cloud Platform

DevOps

  • Docker
  • Kubernetes
  • GitHub Actions
  • Azure DevOps
  • Jenkins
  • Terraform

Databases

  • PostgreSQL
  • MongoDB
  • Redis
  • Neo4j

APIs & Integration

  • REST APIs
  • GraphQL
  • MCP
  • Webhooks

Observability

  • LangSmith
  • MLflow
  • Weights & Biases
  • OpenTelemetry

Nice-to-Have Skills

  • AI workflow automation
  • Multi-agent orchestration
  • Human-in-the-loop systems
  • Reinforcement learning concepts
  • AI safety and governance
  • Prompt optimization and evaluation
  • Knowledge graph integration
  • AI-powered business process automation

Soft Skills

  • Strong analytical and problem-solving skills.

Apply