ZipRecruiter

Log In

1

Prompt Engineer Jobs in New Rochelle, NY (NOW HIRING)

Spara, Inc

Staff AI Engineer

New York, NY · On-site

$210K - $260K/yr

You've seen the field evolve, you transitioned into the LLM era with a clear understanding of what changed and what didn't, and you have strong instincts for when to prompt-engineer vs. fine-tune ...

Bluefish AI

Customer AI Analyst

New York, NY · Remote

Think of this role as a blend of SEO analyst , AI prompt engineer , and strategic customer advisor . What You'll Be Doing: * Account Setup & Optimization - Configure and optimize customer accounts to ...

Flip

Software Engineer

New York, NY · On-site

You are an experienced LLM Prompt Engineer and have fine-tuned or deployed LLMs yourself. * You have experience with Pipecat, or TTS and STT pipelines in general. * You have experience working with ...

Bluefish AI

Customer AI Analyst

New York, NY · On-site +1

Think of this role as a blend of SEO analyst , AI prompt engineer , and strategic customer advisor . What You'll Be Doing: * Account Setup & Optimization - Configure and optimize customer accounts to ...

Princeton IT Services

Agentic AI Engineer

New York, NY · On-site

Optimize cost and latency via prompt engineering, context management, caching, model routing, and ... distillation; leverage batching, streaming, and parallel tool-calls to meet stringent SLOs under ...

Judge Group, Inc.

AI/ML Engineer

Jersey City, NJ · On-site

$70 - $80/hr

Design and implement prompt engineering strategies, agentic workflows, and orchestration frameworks to support advanced AI use cases. * Build and operate scalable ML systems using cloud platforms and ...

JSR Tech Consulting

AI / ML Engineer

Newark, NJ · On-site

Deep understanding of LLMs, GenAI architectures, frameworks like Hugging Face, prompt engineering, and specialized infrastructure for GenAI workloads. * Advanced Techniques: Apply advanced GenAI ...

Valitana LLC

AI Agent Engineer

Stamford, CT · On-site

Develop and maintain prompt engineering and context engineering systems that drive reliable and auditable agent behavior. * Build evaluation pipelines, monitoring, and quality gates for AI agent ...

Tata Consultancy Service Limited

Engineer

Stamford, CT · On-site

$70K - $75K/yr

... AI use cases (prompt engineering, evaluation, or fine-tuning) TCS Employee Benefits Summary: Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision ...

next page

Showing results 1-20

All JobsPrompt Engineer JobsPrompt Engineer Jobs in New Rochelle, NY

Prompt Engineer information

See New Rochelle, NY salary details

$10

$48

$90

How much do prompt engineer jobs pay per hour?

As of Jul 16, 2026, the average hourly pay for prompt engineer in New Rochelle, NY is $48.45, according to ZipRecruiter salary data. Most workers in this role earn between $36.88 and $62.60 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive in the Prompt Engineer position, and why are they important?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a typical day look like for a Prompt Engineer?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What engineer makes $500,000 a year?

Senior software engineers, especially those working in high-demand fields like AI, machine learning, or at major tech companies, can earn $500,000 or more annually through base salary, bonuses, and stock options. Achieving this level typically requires extensive experience, specialized skills, and often leadership roles or equity compensation.

What is a Prompt Engineer job?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

Is prompt engineer still a thing?

Prompt engineering is an emerging role focused on designing effective prompts for AI language models. It is increasingly in demand as organizations seek to optimize AI interactions, often requiring skills in natural language processing and familiarity with tools like GPT. The role continues to grow alongside advancements in AI technology.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance. Skills in programming, data analysis, and familiarity with AI tools are commonly needed.

Is prompt engineer salary?

Prompt engineers typically earn salaries comparable to other AI and machine learning specialists, with average annual pay ranging from $80,000 to $150,000 depending on experience, location, and industry. Skills in natural language processing, prompt design, and familiarity with AI tools like GPT are highly valued and can influence compensation.
What are popular job titles related to Prompt Engineer jobs in New Rochelle, NY? For Prompt Engineer jobs in New Rochelle, NY, the most frequently searched job titles are:
What job categories do people searching Prompt Engineer jobs in New Rochelle, NY look for? The top searched job categories for Prompt Engineer jobs in New Rochelle, NY are:
What cities near New Rochelle, NY are hiring for Prompt Engineer jobs? Cities near New Rochelle, NY with the most Prompt Engineer job openings:
Prompt Engineer jobs near you

Gen AI Engineer

Tata Consultancy Service Limited

Jersey City, NJ • On-site

$70K - $80K/yr

Full-time

Posted 13 days ago

Job description

Key Responsibilities
• Develop object-oriented applications using Python with expert-level software engineering practices.
• Work with Vector Databases for embedding storage and retrieval optimization.
• Design and implement GenAI lifecycle management and RAG pipelines (chunking, embedding, retrieval, re-ranking, summarization) for banking use cases.
• Evaluate and test embedding models and frameworks for performance, latency, memory, and cost optimization.
• Apply prompt engineering, hallucination mitigation, and grounding techniques for AI solutions.
• Build API-driven applications using FastAPI, API Gateway, and integrate with MongoDB, Redis, and front-end frameworks (Angular/React).
• Develop utilities, automation frameworks, and data pipelines to support AI/ML and GenAI initiatives.
• Create monitoring dashboards and automation scripts for system health and performance.
• Collaborate with DevOps teams using enterprise tools (Git/Bitbucket, Jenkins, SonarQube, Artifactory, Ansible).
• Work with large cross-functional teams to deliver secure, compliant, and scalable solutions.
• Explore Agentic architectures for orchestration and multi-step reasoning in AI workflows.
Required Skills & Experience
• Primary Skill: Python
• Secondary Skills: Vector DB, Django, Flask, FastAPI, KAFKA, Containerization (OpenShift, Docker etc.)
• Knowledge in GenAI lifecycle management and RAG pipelines.
• Expertise in prompt engineering and AI safety techniques.
• Hands-on experience with FastAPI, containerization (Docker/Kubernetes), and API integrations.
• Understanding of DevOps practices and enterprise tooling.
• Understanding of Kafka queue integration and configurations.
• Ability to deploy python code on to containers using OpenShift and docker etc.
• Ability to work effectively with large cross-functional teams in a regulated environment.
Salary Range: $70,000 to $80,000 per year

Apply