1

Prompt Engineer Jobs in New Rochelle, NY (NOW HIRING)

Tata Consultancy Services is seeking experienced Prompt Engineers with expertise in Large Language Models (LLMs) to design and optimize prompts for enterprise-grade GenAI solutions. The role involves ...

Prompt Engineer LLM Interaction Design / Prompt Optimization / GenAI Application Quality Role purpose Design, test, govern, and continuously improve prompts, system instructions, conversation flows ...

Prompt Engineer LLM Interaction Design / Prompt Optimization / GenAI Application Quality Role purpose Design, test, govern, and continuously improve prompts, system instructions, conversation flows ...

Prompt Engineer LLM Interaction Design / Prompt Optimization / GenAI Application Quality Role purpose Design, test, govern, and continuously improve prompts, system instructions, conversation flows ...

As a Prompt Engineer, you will be a key member of our AI development team, responsible for designing and developing high-quality prompts that drive our AI models and algorithms. Your expertise in ...

As a Prompt Engineer, you will be a key member of our AI development team, responsible for designing and developing high-quality prompts that drive our AI models and algorithms. Your expertise in ...

The AI Prompt Engineer will design, develop, test, and optimize prompts, workflows, and AI-assisted solutions for enterprise applications and internal business use cases. This role will work closely ...

The AI Prompt Engineer will design, develop, test, and optimize prompts, workflows, and AI-assisted solutions for enterprise applications and internal business use cases. This role will work closely ...

Not a prompt engineer. This is a production-first role. You'll own the AI stack end-to-end -from eval frameworks to fine-tuning pipelines to agent orchestration. But you'll also push the boundaries ...

AI/ ML Engineer

New York, NY · Remote

$60 - $62/hr

The ideal candidate will have hands-on experience with prompt engineering, model fine-tuning, and integrating GenAI capabilities into real-world applications. Key Responsibilities * Design and ...

Engineer

Jersey City, NJ · On-site

$90K - $100K/yr

... Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique - Knowledge in Generative AI tools like LangChain, Hugging Face, Llama Index etc. Good to have ...

Senior AI Engineer

Jersey City, NJ · On-site

$109K - $149K/yr

Develop prompt engineering strategies, embeddings, vector search, and retrieval pipelines. Build scalable AI infrastructure on AWS and automate deployments using Terraform. Implement monitoring ...

Responsibilities : • Build security analysis capabilities using LLM integrations with Azure OpenAI, prompt engineering, retrieval-augmented generation, and vector-based context retrieval. • ...

next page

Showing results 1-20

Prompt Engineer information

See New Rochelle, NY salary details

$10

$48

$90

How much do prompt engineer jobs pay per hour?

As of Jul 13, 2026, the average hourly pay for prompt engineer in New Rochelle, NY is $48.45, according to ZipRecruiter salary data. Most workers in this role earn between $36.88 and $62.60 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive in the Prompt Engineer position, and why are they important?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a typical day look like for a Prompt Engineer?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What engineer makes $500,000 a year?

Senior software engineers, especially those working in high-demand fields like AI, machine learning, or at major tech companies, can earn $500,000 or more annually through base salary, bonuses, and stock options. Achieving this level typically requires extensive experience, specialized skills, and often leadership roles or equity compensation.

What is a Prompt Engineer job?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

Is prompt engineer still a thing?

Prompt engineering is an emerging role focused on designing effective prompts for AI language models. It is increasingly in demand as organizations seek to optimize AI interactions, often requiring skills in natural language processing and familiarity with tools like GPT. The role continues to grow alongside advancements in AI technology.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance. Skills in programming, data analysis, and familiarity with AI tools are commonly needed.

Is prompt engineer salary?

Prompt engineers typically earn salaries comparable to other AI and machine learning specialists, with average annual pay ranging from $80,000 to $150,000 depending on experience, location, and industry. Skills in natural language processing, prompt design, and familiarity with AI tools like GPT are highly valued and can influence compensation.
What are popular job titles related to Prompt Engineer jobs in New Rochelle, NY? For Prompt Engineer jobs in New Rochelle, NY, the most frequently searched job titles are:
What job categories do people searching Prompt Engineer jobs in New Rochelle, NY look for? The top searched job categories for Prompt Engineer jobs in New Rochelle, NY are:
What cities near New Rochelle, NY are hiring for Prompt Engineer jobs? Cities near New Rochelle, NY with the most Prompt Engineer job openings:
Prompt Engineer

Full-time

Posted 11 days ago


Tata Consultancy Services rating

6.5

Company rating: 6.5 out of 10

Based on 21 frontline employees who took The Breakroom Quiz

159th of 210 rated it services


Job description

Job Summary:
Tata Consultancy Services is seeking experienced Prompt Engineers with expertise in Large Language Models (LLMs) to design and optimize prompts for enterprise-grade GenAI solutions. The role involves collaborating with various teams to integrate prompts into AI workflows and ensuring the effectiveness of model outputs.
Responsibilities:
• Design, test, and optimize advanced prompts (zero-shot, few-shot, chain-of-thought, tool calling, RAG-based prompts) for LLM-driven applications
• Analyze model outputs and continuously refine prompts to ensure accuracy, consistency, and business relevance
• Collaborate with Data Scientists, ML Engineers, and Product teams to integrate prompts into end to end AI workflows
• Support RAG architectures by crafting effective prompts leveraging vector search, embeddings, and enterprise knowledge sources
• Implement guardrails, validation strategies, and hallucination mitigation techniques
• Fine tune prompt strategies based on domain-specific use cases (knowledge extraction, summarization, classification, Q&A, reasoning tasks)
• Document prompt patterns, best practices, and reusable templates for enterprise adoption
• Support client demos, POCs, and pilot rollouts of GenAI solutions
Qualifications:
Required:
• BACHELOR OF COMPUTER SCIENCE
• 4–7+ years overall experience, with 2–3+ years hands-on Prompt Engineering / GenAI work
• Strong experience with LLMs (GPT 4 / GPT 4o / Gemini / Claude / LLaMA or equivalent)
• Hands-on knowledge of RAG frameworks, embeddings, vector databases, and semantic search
• Experience with Azure OpenAI / OpenAI APIs / Google Vertex AI / Hugging Face
• Strong NLP fundamentals and ability to interpret LLM behavior
• Strong analytical skills to evaluate and improve model output quality
Preferred:
• Programming experience in Python (FastAPI / Flask exposure preferred)
• Experience using LangChain / LlamaIndex or similar orchestration frameworks
Company:
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. Founded in 1968, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.

What Tata Consultancy Services employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Tata Consultancy Services logo

About Tata Consultancy Services

Sourced by ZipRecruiter

Tata Consultancy Services is an IT services, consulting and business solutions organization that delivers real results to global business, ensuring a level of certainty no other firm can match. TCS offers a consulting-led, integrated portfolio of IT, BPO, infrastructure, engineering, and assurance services. This is delivered through its unique Global Network Delivery Model™, recognized as the benchmark of excellence in software development. TCS delivers a level of certainty that no other firm can match--to our clients and to our employees. Come join us and experience certainty in your career. TCS a global Consulting and IT Services firm that is ranked in the top quartile by industry analysts. Our 2021 fiscal revenues topped $25 B and our market capitalization is over $170+B, yet we have a deep and large history of philanthropy and corporate social responsibility. Now approaching 600K of the best IT professionals and consultants, we are a trusted advisor, guiding our clients' enterprises through growth and transformation journeys - helping them to become agile, intelligent, automated and on the cloud. We are devoted to DEI and are recognized as a top employer and place to work.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Edison, NJ, US