ZipRecruiter

Log In

1

Senior Prompt Engineer Jobs in New York (NOW HIRING)

Accord Technologies Inc.

Senior AI Engineer

Piscataway, NJ · On-site

$106K - $146K/yr

Senior AI Engineer Location: Piscataway, NJ (Hybrid from day one) Local to NJ candidates are ... Hands-on experience with LLMs, embeddings, vector databases, RAG, and prompt engineering.

Conquer AI

Senior Forward Deployed Engineer

Manhattan, NY · On-site

$115K - $158K/yr

Senior Forward Deployed Engineer (AI/LLM, Full Stack) Manhattan New York On Site Contract ... Run prompt engineering and evaluation cycles to keep improving what's shipped What you will bring

New

Compunnel

Senior Database Engineer

Parsippany, NJ · On-site

$106K - $144K/yr

Job Summary We are seeking a highly experienced Senior Database Engineer to work at the ... Drive prompt-engineering best practices for database-related AI applications. • Drive code ...

Future Secure AI

Sr. AI/ML Engineer, Platform

Manhattan, NY · On-site

$115K - $158K/yr

They are seeking a highly skilled Sr. AI/ML Software Engineer to contribute to their core Platform ... for prompt engineering, tool use, streaming, and token management. • Distributed Systems ...

Motorola

Senior AI Engineer (US Remote)

New York, NY · Remote

$180K - $210K/yr

As a senior member of our AI engineering team, you'll provide technical leadership, mentor ... Prompt engineering & optimization * Model evaluation & testing frameworks * AI observability ...

eClercx

Senior AI Engineer

Manhattan, NY · On-site

$100K - $120K/yr

Responsibilities Senior AI Engineer Location: Salt Lake City, Utah Type: Full-time Department: BFSI ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

eClerx

Senior AI Engineer

Manhattan, NY · On-site

$100K - $120K/yr

Senior AI Engineer ----- Location: Salt Lake City, Utah Type: Full-time Department: BFSI ----- Job ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

eClercx

Senior AI Engineer

New York, NY · On-site

$180K - $200K/yr

Responsibilities Senior AI Engineer Location: New York, New Jersey, US Type: Full-time Department ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

Brooksource

Sr Full Stack Engineer

Summit, NJ · On-site

$75 - $80/hr

Sr Full Stack Engineer Summit, NJ Hybrid Role Compensation: $75 - $80 per hour ABOUT THE ROLE Our ... The role requires hands-on expertise in GenAI prompt engineering to ensure consistent, low ...

SPECTRAFORCE

Senior GenAI Cloud Engineer

Newark, NJ · On-site

$109K - $149K/yr

Experience with model tuning, evaluation, and prompt engineering. * Experience with event-driven ... Senior GenAI Cloud Engineer - 5-8 years. Primarily hands-on. Leads implementation of specific ...

New

Milbank LLP

Senior AI/.NET Engineer

New York, NY · On-site

$140K - $175K/yr

Overview The Senior Application Developer is responsible for architecting, building, and ... Implement retrieval-augmented generation (RAG), advanced prompt engineering, tool/function calling ...

PepsiCo

Senior AI Engineer

Purchase, NY · On-site

PepsiCo is a leading company in the food and beverage industry, seeking a Senior AI Engineer ... Multi-agent orchestration (e.g., LangChain, LangGraph, CrewAI); advanced prompt engineering; custom ...

next page

Showing results 1-20

All JobsPrompt Engineer JobsSenior Prompt Engineer JobsSenior Prompt Engineer Jobs in New York

Senior Prompt Engineer information

What is a senior prompt engineer?

Senior Prompt Engineers are professionals who specialize in designing, refining, and optimizing prompts for AI language models, such as ChatGPT or other generative AI systems. They combine expertise in natural language processing, programming, and domain knowledge to ensure AI outputs are accurate, relevant, and aligned with user goals. Senior Prompt Engineers typically lead teams, develop prompt engineering best practices, and collaborate with product managers, data scientists, and developers to improve AI-driven products. Their work is crucial for organizations leveraging AI to enhance user experiences, automate workflows, or generate content.

How does a senior prompt engineer typically collaborate with cross-functional teams to optimize AI system outputs?

Senior Prompt Engineers frequently work alongside data scientists, machine learning engineers, product managers, and UX designers to fine-tune AI models and ensure prompt effectiveness. Collaboration often involves iterative testing, gathering feedback, and adjusting prompts based on real-world user interactions and business goals. This teamwork helps ensure outputs are accurate, contextually appropriate, and aligned with user expectations. Regular communication and shared documentation are essential to maintain alignment and drive continuous improvement.

What are the key skills and qualifications needed to thrive as a senior prompt engineer, and why are they important?

To thrive as a Senior Prompt Engineer, you need expertise in natural language processing, prompt engineering techniques, and a solid background in computer science or a related field. Familiarity with large language model APIs, AI development platforms, and tools like Python, Jupyter, and version control systems is typically required. Exceptional analytical thinking, creativity, and strong communication skills help you craft effective prompts and work collaboratively with multidisciplinary teams. These skills are essential to optimize model outputs, solve complex user challenges, and drive impactful AI solutions.

What are the most commonly searched types of Prompt Engineer jobs in New York?

The most popular types of Prompt Engineer jobs in New York are:

What are popular job titles related to Senior Prompt Engineer jobs in New York?

For Senior Prompt Engineer jobs in New York, the most frequently searched job titles are:

What job categories do people searching Senior Prompt Engineer jobs in New York look for?

The top searched job categories for Senior Prompt Engineer jobs in New York are:

What cities in New York are hiring for Senior Prompt Engineer jobs?

Cities in New York with the most Senior Prompt Engineer job openings:

Senior Prompt Engineer jobs near you
Infographic showing various Senior Prompt Engineer job openings in New York as of August 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution.

Senior AI Engineer

Accord Technologies Inc.

Piscataway, NJ • On-site

$106K - $146K/yr

Contractor

Re-posted 2 days ago

Job description

Senior AI Engineer
Location: Piscataway, NJ (Hybrid from day one)
Local to NJ candidates are preferred.
Position type: W2 contract.
Requirement:

We are seeking an experienced and proactive Senior AI Engineer to join our team.
The ideal candidate will have a strong background in AI/ML, hands-on experience with large language models, and proven ability to drive innovation and implementation in a collaborative environment.
You will collaborate with offshore teams and liaise directly with the client to ensure project deliverables are met on time and to expectations.

Responsibilities:

  • Develop and deploy machine learning models using Python and frameworks like PyTorch and TensorFlow.
  • Design and implement solutions involving Large Language Models (LLMs), embeddings, vector databases, Retrieval-Augmented Generation (RAG), and prompt engineering. 
  • Work with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex to integrate AI capabilities. 
  • Build and maintain MLOps pipelines using Docker, Kubernetes, and monitoring tools for scalable and reliable deployment. 
  • Develop APIs and endpoint services using FastAPI or Flask.
  • Collaborate with offshore teams to drive solution implementation and ensure alignment with project timelines. 
  • Engage with the client for ongoing communication, requirement gathering, and expectation management.
  • Leverage solid knowledge of data structures, algorithms, and distributed systems to optimize solutions.

Skills & Qualifications:

  • Strong experience with Python programming and ML frameworks (PyTorch, TensorFlow). 
  • Hands-on experience with LLMs, embeddings, vector databases, RAG, and prompt engineering.
  • Familiarity with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex. 
  • Proficiency with Docker, Kubernetes, and MLOps pipelines. 
  • Experience in API development (FastAPI, Flask). 
  • Solid understanding of data structures, algorithms, and distributed systems.
  • Excellent communication skills and ability to coordinate with offshore teams and clients.
  • Proven track record of driving projects from conception to delivery in a collaborative environment.