1

Prompt Engineering Jobs in New York (NOW HIRING)

Senior Gen AI Engineer

Jersey City, NJ · On-site

$109K - $149K/yr

The ideal candidate will have deep expertise in LLM application development, RAG architectures, AI agents, prompt engineering, and cloud-native AI platforms . This is a hands-on technical role ...

Knowledge of Generative AI, prompt engineering, data governance, and enterprise security practices. Key Responsibilities * Lead the architecture, development, and implementation of AI-driven ...

Responsibilities : • Build security analysis capabilities using LLM integrations with Azure OpenAI, prompt engineering, retrieval-augmented generation, and vector-based context retrieval. • ...

GenAI Developer / Python

Manhattan, NY · On-site

$55.50 - $76.25/hr

Prompt Engineering, Workflow Design, and GenAI Optimization. Key Responsibilities: Develop and orchestrate sophisticated AI workflows using LangGraph and multi-agent architectures. Build and maintain ...

New

Senior Database Engineer

Parsippany, NJ · On-site

$106K - $144K/yr

... prompt-engineering best practices for database-related AI applications. • Drive code quality, AI governance, and database AI engineering practices. • Collaborate with database engineers, Product ...

Senior AI Engineer

Piscataway, NJ · On-site

$106K - $146K/yr

Design and implement solutions involving Large Language Models (LLMs), embeddings, vector databases, Retrieval-Augmented Generation (RAG), and prompt engineering. * Work with cloud AI services such ...

Implement hallucination reduction, prompt engineering strategies, and model evaluation methods. * Integrate LLMs with enterprise applications, APIs, and automation workflows. * Work with vector ...

Prompt Engineering, NL2SQL, Text-to-SQL systems Education / Experience / Certification Bachelor's degree in computer science or related field (required) 10+ years of experience as a Database ...

Design and implement Retrieval-Augmented Generation (RAG) architectures and prompt engineering strategies. * Develop and maintain backend services and APIs using Python and JavaScript. * Support ...

Showing results 21-40

Prompt Engineering information

See New York salary details

$35.6K

$68.9K

$104.5K

How much do prompt engineering jobs pay per year?

As of Aug 8, 2026, the average yearly pay for prompt engineering in New York is $68,899.00, according to ZipRecruiter salary data. Most workers in this role earn between $51,400.00 and $78,800.00 per year, depending on experience, location, and employer.

What is prompt engineering?

A Prompt Engineering job involves designing, refining, and optimizing prompts to improve the performance of AI language models. Prompt engineers work with large language models (LLMs) to generate accurate, relevant, and high-quality responses. They experiment with different phrasing techniques, fine-tune AI outputs, and collaborate with developers to enhance model capabilities. This role is essential in ensuring AI systems provide reliable and useful responses for various applications.

What skills and qualifications are needed for prompt engineering?

To excel in Prompt Engineering, a strong grasp of natural language processing (NLP), machine learning concepts, and analytical thinking is essential, often supported by a degree in computer science or a related field. Familiarity with AI platforms, code repositories (such as GitHub), and prompt development tools is typically required. Excellent problem-solving, creativity, and cross-functional communication skills help Prompt Engineers effectively collaborate and refine model outputs. These capabilities enable the creation of precise, effective prompts driving high-quality AI responses in rapidly evolving technical environments.

What do you do as a prompt engineer?

A prompt engineer designs and refines prompts to improve the performance of AI language models. They analyze model responses, experiment with prompt structures, and use tools like AI development platforms to ensure accurate and relevant outputs, often requiring skills in programming and understanding of AI behavior.

What are the most common challenges faced by prompt engineers in their daily work?

Prompt Engineers frequently encounter challenges such as ensuring the clarity and relevance of prompts to achieve accurate AI responses, troubleshooting inconsistent model behavior, and staying updated with evolving AI technologies. Balancing experimentation with efficiency is often essential, as iterative testing and refinement are core parts of the workflow. Collaboration with data scientists, product managers, and other engineers is common, requiring adaptability and strong communication skills. These challenges make the role dynamic and rewarding for professionals who enjoy problem-solving and innovation.

What are the most commonly searched types of Prompt Engineering jobs in New York? The most popular types of Prompt Engineering jobs in New York are:
What cities in New York are hiring for Prompt Engineering jobs? Cities in New York with the most Prompt Engineering job openings:
Infographic showing various Prompt Engineering job openings in New York as of August 2026, with employment types broken down into 88% Full Time, 7% Part Time, 4% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution, with an average salary of $68,899 per year, or $33.1 per hour.

Database Engineer

Advanced Tech Placement

Parsippany Troy Hills, NJ • On-site

Other

Posted 14 days ago


Job description

We are looking for a Database Engineer for a contract opportunity. If you are a passionate database engineer who would love to sit at the intersection of traditional enterprise database engineering and the emerging Gen AI revolution — building next-generation, AI-powered data solutions that transform how tens of thousands of users interact with an HCM system then we have a perfect role for you and we would like to have a discussion with you.

Responsibilities

  • Core Database Engineering
  • Design and build scalable database services and solutions to complex business problems
  • Debug critical database issues and provide root-cause analysis with long-term solutions
  • Research, Design, Develop, and/or modify applications using SQL, PL/SQL, Python, and AI-assisted development tools
  • Prototype solutions and recommend adoption of new technologies including Generative AI and LLM-powered database tooling
  • Development and Deployment of application database changes/releases across production and non-production environments
  • Build and maintain LLM-powered database assistants using frameworks such as LangChain, LlamaIndex, or similar
  • Develop Retrieval-Augmented Generation (RAG) solutions using structured/unstructured data from Oracle and PostgreSQL databases
  • Integrate AI-powered query optimization tools to enhance database performance tuning workflows
  • Leverage GitHub Copilot, Amazon Q, or similar AI coding assistants to accelerate PL/SQL and Python development
  • Build vector database integrations (pgvector, Oracle AI Vector Search) for semantic search capabilities
  • Evaluate and adopt AI/ML model serving patterns (batch vs. real-time inference) for database-adjacent workloads
  • Drive prompt engineering best practices for database-related AI applications

Quality & Leadership

  • Self-reliant, hands-on technical leader driving code quality, AI governance, and database AI practices
  • Collaborate with database peers, product owners, UX/UI, and globally distributed teams on AI-enhanced database solutions
  • Define engineering best practices including AI-assisted Test-Driven Development (TDD) and automated unit testing for database development
  • Mentor teams on AI tool adoption, prompt engineering, and AI use in data engineering
  • Develop specifications for new database services incorporating AI-native design patterns
  • Meet deadlines and manage multiple, dynamic priorities in an agile environment

Education / Experience / Certification

  • Bachelor''s degree in computer science or related field (required)
  • Master''s degree in computer science, Data Science, or AI/ML (preferred)
  • 10+ years of experience as a Database Developer/DBA in a fast-paced agile environment
  • 7+ years as an Oracle Developer/DBA with expert-level PL/SQL and SQL skills
  • 2+ years of hands-on experience with Generative AI, LLMs, or ML pipelines in a production environment (preferred)
  • Deep expertise in database internals, expert-level PL/SQL, SQL, and Python/Shell programming
  • Oracle Certified Professional (OCP) (huge plus)
  • AWS Certified Machine Learning Specialty (plus)

Required Technical Skills

  • Databases: Oracle, MSSQL, PL/SQL, SQL
  • Programming: Python, Shell scripting
  • DevOps: Git, Jenkins, Ansible, Artifactory
  • Cloud: AWS
  • OS: Linux/RedHat
  • Oracle Features: VPD, Partitioning, Expert-level Performance Tuning, JSON data in databases
  • AI/ML: Prompt Engineering, NL2SQL, Text-to-SQL systems

Preferred Technical Skills

  • Databases: RDS Oracle, RDS PostgreSQL
  • AI/ML: LangChain, LlamaIndex, RAG pipelines, Vector stores(pgVector)
  • LLM Platforms: OpenAI API, Azure OpenAI, AWS Bedrock
  • DevOps: Bitbucket, CI/CD for AI model deployment
  • Cloud AI Services: AWS SageMaker, Azure ML
  • Oracle Advanced Features: Golden Gate, Cloud Control, Golden Gate BDA