1

Senior Prompt Engineer Jobs in New York (NOW HIRING)

Senior AI Engineer

Piscataway, NJ · On-site

$106K - $146K/yr

Senior AI Engineer Location: Piscataway, NJ (Hybrid from day one) Local to NJ candidates are ... Hands-on experience with LLMs, embeddings, vector databases, RAG, and prompt engineering.

Senior ML Engineer

Manhattan, NY · On-site

$180 - $240/hr

The Forward Deployed Senior Machine Learning Engineer position requires a mix of software ... You prompt-engineer through complex architecture and debug sessions, leverage LLMs across the full ...

Senior Database Engineer

Parsippany, NJ · On-site

$106K - $144K/yr

Job Summary We are seeking a highly experienced Senior Database Engineer to work at the ... Drive prompt-engineering best practices for database-related AI applications. • Drive code ...

Sr Full Stack Engineer

Summit, NJ · On-site

$103.32 - $110.21/hr

Sr Full Stack Engineer Summit, NJ Hybrid Role Compensation: $75 - $80 per hour ABOUT THE ROLE Our ... The role requires hands-on expertise in GenAI prompt engineering to ensure consistent, low ...

As a senior member of our AI engineering team, you'll provide technical leadership, mentor ... Prompt engineering & optimization * Model evaluation & testing frameworks * AI observability ...

As a senior member of our AI engineering team, you'll provide technical leadership, mentor ... Prompt engineering & optimization * Model evaluation & testing frameworks * AI observability ...

Sr. AI/ML Engineer, Platform

Manhattan, NY · On-site

$115K - $158K/yr

They are seeking a highly skilled Sr. AI/ML Software Engineer to contribute to their core Platform ... for prompt engineering, tool use, streaming, and token management. • Distributed Systems ...

AI Engineer Senior Level

Manhattan, NY · On-site

$140 - $180/hr

/AI Engineer Senior Level# AI Engineer Senior LevelJobs via DiceNew York, USFull-time## About the ... Prompt management- Evaluation harnesses- Context orchestration- Structured output validation ...

Senior AI Engineer

Manhattan, NY · On-site

$100K - $120K/yr

Responsibilities Senior AI Engineer Location: Salt Lake City, Utah Type: Full-time Department: BFSI ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

Senior AI Engineer

New York, NY · On-site

$180K - $200K/yr

Responsibilities Senior AI Engineer Location: New York, New Jersey, US Type: Full-time Department ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

Senior AI Engineer ----- Location: Salt Lake City, Utah Type: Full-time Department: BFSI ----- Job ... Optimize cost and latency via prompt engineering, context management, caching, model routing, and ...

Senior AI Engineer

White Plains, NY · On-site

$150 - $210/hr

* Join our AI & Engineering team in transforming technology platforms, driving innovation, and making ... Apply thoughtful prompt and context patterns, tool/function calling, reusable agent skills, and ...

Senior AI Engineer

Manhattan, NY · On-site

$180 - $240/hr

... prompt engineering, and evals.* A track record of taking AI systems into messy, real-world ... a senior team with 40+ years of combined private-market technology experience.You'll work on ...

next page

Showing results 1-20

Senior Prompt Engineer information

What is a senior prompt engineer?

Senior Prompt Engineers are professionals who specialize in designing, refining, and optimizing prompts for AI language models, such as ChatGPT or other generative AI systems. They combine expertise in natural language processing, programming, and domain knowledge to ensure AI outputs are accurate, relevant, and aligned with user goals. Senior Prompt Engineers typically lead teams, develop prompt engineering best practices, and collaborate with product managers, data scientists, and developers to improve AI-driven products. Their work is crucial for organizations leveraging AI to enhance user experiences, automate workflows, or generate content.

How does a senior prompt engineer typically collaborate with cross-functional teams to optimize AI system outputs?

Senior Prompt Engineers frequently work alongside data scientists, machine learning engineers, product managers, and UX designers to fine-tune AI models and ensure prompt effectiveness. Collaboration often involves iterative testing, gathering feedback, and adjusting prompts based on real-world user interactions and business goals. This teamwork helps ensure outputs are accurate, contextually appropriate, and aligned with user expectations. Regular communication and shared documentation are essential to maintain alignment and drive continuous improvement.

What are the key skills and qualifications needed to thrive as a senior prompt engineer, and why are they important?

To thrive as a Senior Prompt Engineer, you need expertise in natural language processing, prompt engineering techniques, and a solid background in computer science or a related field. Familiarity with large language model APIs, AI development platforms, and tools like Python, Jupyter, and version control systems is typically required. Exceptional analytical thinking, creativity, and strong communication skills help you craft effective prompts and work collaboratively with multidisciplinary teams. These skills are essential to optimize model outputs, solve complex user challenges, and drive impactful AI solutions.

What are the most commonly searched types of Prompt Engineer jobs in New York?

The most popular types of Prompt Engineer jobs in New York are:

What are popular job titles related to Senior Prompt Engineer jobs in New York?

For Senior Prompt Engineer jobs in New York, the most frequently searched job titles are:

What cities in New York are hiring for Senior Prompt Engineer jobs?

Cities in New York with the most Senior Prompt Engineer job openings:

Infographic showing various Senior Prompt Engineer job openings in New York as of August 2026, with employment types broken down into 90% Full Time, 6% Part Time, and 4% Contract. Highlights an 87% Physical, 5% Hybrid, and 8% Remote job distribution.

Senior AI Engineer

Piscataway, NJ • On-site

Accord Technologies Inc.
IT Services • 51 - 200 employees

$106K - $146K/yr

Contractor

Re-posted 27 days ago


Job description

Senior AI Engineer
Location: Piscataway, NJ (Hybrid from day one)
Local to NJ candidates are preferred.
Position type: W2 contract.

Requirement:

We are seeking an experienced and proactive Senior AI Engineer to join our team.
The ideal candidate will have a strong background in AI/ML, hands-on experience with large language models, and proven ability to drive innovation and implementation in a collaborative environment.
You will collaborate with offshore teams and liaise directly with the client to ensure project deliverables are met on time and to expectations.

Responsibilities:

  • Develop and deploy machine learning models using Python and frameworks like PyTorch and TensorFlow.
  • Design and implement solutions involving Large Language Models (LLMs), embeddings, vector databases, Retrieval-Augmented Generation (RAG), and prompt engineering. 
  • Work with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex to integrate AI capabilities. 
  • Build and maintain MLOps pipelines using Docker, Kubernetes, and monitoring tools for scalable and reliable deployment. 
  • Develop APIs and endpoint services using FastAPI or Flask.
  • Collaborate with offshore teams to drive solution implementation and ensure alignment with project timelines. 
  • Engage with the client for ongoing communication, requirement gathering, and expectation management.
  • Leverage solid knowledge of data structures, algorithms, and distributed systems to optimize solutions.

Skills & Qualifications:

  • Strong experience with Python programming and ML frameworks (PyTorch, TensorFlow). 
  • Hands-on experience with LLMs, embeddings, vector databases, RAG, and prompt engineering.
  • Familiarity with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex
  • Proficiency with Docker, Kubernetes, and MLOps pipelines
  • Experience in API development (FastAPI, Flask). 
  • Solid understanding of data structures, algorithms, and distributed systems.
  • Excellent communication skills and ability to coordinate with offshore teams and clients.
  • Proven track record of driving projects from conception to delivery in a collaborative environment.