ZipRecruiter

Log In

1

Prompt Engineer Jobs in New Rochelle, NY (NOW HIRING)

Spara, Inc

Staff AI Engineer

New York, NY · On-site

$210K - $260K/yr

You've seen the field evolve, you transitioned into the LLM era with a clear understanding of what changed and what didn't, and you have strong instincts for when to prompt-engineer vs. fine-tune ...

Kanshe Infotech

Senior Gen AI Engineer

Jersey City, NJ · On-site

$109K - $149K/yr

The ideal candidate will have deep expertise in LLM application development, RAG architectures, AI agents, prompt engineering, and cloud-native AI platforms . This is a hands-on technical role ...

David Joseph & Company

AI Agent Engineer

New York, NY · On-site

$200K - $300K/yr

Requirements * 2+ years in voice AI, conversational AI, prompt engineering, speech systems, or related agentic workflows * 3+ years in platform, infrastructure, or backend engineering * Strong ...

Bluefish AI

Customer AI Analyst

New York, NY · Remote

Think of this role as a blend of SEO analyst , AI prompt engineer , and strategic customer advisor . What You'll Be Doing: * Account Setup & Optimization - Configure and optimize customer accounts to ...

Alston & Bird's

Legal AI Solutions Analyst

New York, NY · On-site

$135K - $150K/yr

Experience as a prompt engineer in professional services, consulting, or legal environments; or as a product support specialist/business analyst with exposure to low/no-code automation.

CYNET SYSTEMS

AI Engineer

New York, NY · On-site

$55 - $60/hr

API integration, prompt engineering, fine-tuning/adaptation, and building applications using RAG and tool-using agents (vector retrieval, function calling, secure tool execution). * Understanding of ...

Bluefish AI

Customer AI Analyst

New York, NY · On-site +1

Think of this role as a blend of SEO analyst , AI prompt engineer , and strategic customer advisor . What You'll Be Doing: * Account Setup & Optimization - Configure and optimize customer accounts to ...

Princeton IT Services

Agentic AI Engineer

New York, NY · On-site

Optimize cost and latency via prompt engineering, context management, caching, model routing, and ... distillation; leverage batching, streaming, and parallel tool-calls to meet stringent SLOs under ...

Turing

Principal AI Engineer

New York, NY · On-site

$245K/yr

Lead the design, training, fine-tuning, and deployment of large language models, leveraging techniques like prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures.

Judge Group, Inc.

AI/ML Engineer

Jersey City, NJ · On-site

$70 - $80/hr

Design and implement prompt engineering strategies, agentic workflows, and orchestration frameworks to support advanced AI use cases. * Build and operate scalable ML systems using cloud platforms and ...

Future Secure AI

Sr. AI/ML Engineer, Platform

Manhattan, NY · On-site

$115K - $158K/yr

Build and optimize integrations with large language models (LLMs), utilizing best practices for prompt engineering, tool use, streaming, and token management. • Distributed Systems Architecture:

Valitana LLC

AI Agent Engineer

Stamford, CT · On-site

Develop and maintain prompt engineering and context engineering systems that drive reliable and auditable agent behavior. * Build evaluation pipelines, monitoring, and quality gates for AI agent ...

previous pagenext page

Showing results 21-40

All JobsPrompt Engineer JobsPrompt Engineer Jobs in New Rochelle, NY

Prompt Engineer information

See New Rochelle, NY salary details

$10

$48

$90

How much do prompt engineer jobs pay per hour?

As of Aug 8, 2026, the average hourly pay for prompt engineer in New Rochelle, NY is $48.45, according to ZipRecruiter salary data. Most workers in this role earn between $36.88 and $62.60 per hour, depending on experience, location, and employer.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance.
What cities near New Rochelle, NY are hiring for Prompt Engineer jobs? Cities near New Rochelle, NY with the most Prompt Engineer job openings:
Prompt Engineer jobs near you
Infographic showing various Prompt Engineer job openings in New Rochelle, NY as of August 2026, with employment types broken down into 4% Internship, 66% Full Time, 17% Part Time, and 13% Contract. Highlights an 68% In-person, and 32% Remote job distribution, with an average salary of $100,786 per year, or $48.5 per hour.

Staff AI Engineer

Spara, Inc

New York, NY • On-site

$210K - $260K/yr

Full-time

Medical, Dental, Vision, PTO

Re-posted 19 days ago

Job description

About Spara
Spara is building AI agents that sell. Our agents engage buyers across chat, voice, and email, handling everything from qualifying leads to booking meetings to answering deep product questions. We work with companies ranging from fast-growing startups to large enterprises, and our product is working: customers like Rho are seeing step-change improvements in their sales pipeline within weeks of going live.
Sales technology is a massive market, and the shift to AI-native GTM motions is still early. We're building the company that defines how it plays out. We've raised $15M from Radical Ventures and Inspired Capital, backed by the founders of PyTorch and Google Cloud TPU, and Heads of Sales at Anthropic and OpenAI.
Our founders have done this before: David was co-founder and CEO of Triplemint, which he led to acquisition, and Zander was technical co-founder of Nomad Health (now post-Series D) and most recently led Platform at Hyperscience AI.
We're a 20-person team in downtown Manhattan building something that will be much bigger. Our engineering team is small and senior, and everyone has real influence on what we build and how we build it.
This Role
We're looking for someone who's been in the NLP and ML space long enough to have perspective. You've seen the field evolve, you transitioned into the LLM era with a clear understanding of what changed and what didn't, and you have strong instincts for when to prompt-engineer vs. fine-tune, how to build eval systems that actually scale, and how to make pragmatic architecture decisions under real constraints.
As a Staff AI Engineer at Spara, you will:
  • Go deep on the core engine that powers all of Spara's AI agents: retrieval, ranking, response generation, and the frameworks that tie them together. You'll bring a level of depth and technical judgment here that raises the bar for the whole team.
  • Design and scale the evaluation approach across the platform as we add new agent types and capabilities.
  • Bring depth on fine-tuning and training: when it's worth it, how to do it well, and how to make pragmatic tradeoffs as the platform scales.
  • Make foundational technical decisions that compound. At our stage, the right abstractions and architectural choices have outsized impact.
  • Collaborate closely with leadership to shape the product and technical roadmap. This is a role with real influence, not just execution.
  • Ship to production multiple times a day using a modern stack: FastAPI/Python, React/TypeScript, Postgres + pgvector, multiple foundation models (OpenAI, Anthropic), Google Cloud, Docker, GitHub Actions.
What We're Looking For
  • 7+ years of engineering experience, with significant depth in NLP, search, retrieval, or related ML domains
  • Experience that predates the current LLM wave. You understand the fundamentals underneath the abstractions.
  • Track record of designing and deploying sophisticated ML/AI systems in production
  • Strong opinions on evaluation methodology. You've built eval pipelines before and know what makes them useful vs. theater.
  • Experience with or strong instincts around fine-tuning: when it's worth it, how to do it well, what the tradeoffs are
  • Ability to thrive in an early-stage environment. We're seed stage with real enterprise customers and a senior team, moving fast toward our next phase of growth.
  • Excellent communication skills. You'll be shaping how the team thinks about hard problems, not just solving them alone.
Nice to have:
  • Advanced degree in ML, NLP, or a related field
  • Previous startup experience, especially at companies that scaled from early to growth stage

Location & Work Schedule
Hybrid: 3 days per week in our office in downtown Manhattan (World Trade Center), with the option to work remotely on Wednesdays and Fridays.
Compensation & Benefits
  • Health, dental, and vision insurance
  • Flexible PTO
  • Collaborative environment with experienced engineers solving hard problems together
  • Real ownership over product direction and technical architecture
  • In-office culture in NYC with flexibility for work-life balance

Apply