ZipRecruiter

Log In

2

Remote Prompt Engineer Jobs in New York (NOW HIRING)

Motorola

Senior AI Engineer (US Remote)

New York, NY · Remote

$180K - $210K/yr

Prompt engineering & optimization * Model evaluation & testing frameworks * AI observability ... REMOTE Basic Requirements * 8+ years experience in software development * AND 2+ years with AI ...

Soda Data

Growth Engineer (Remote)

New York, NY · On-site +1

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

Soda Data

Growth Engineer (Remote)

New York, NY · Remote

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

Soda Data

Growth Engineer (Remote)

New York, NY · Remote

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

Mondo

AI Engineer

Manhattan, NY · Remote

$85 - $110/hr

Remote (U.S. candidates working EST hours) Start Date Is: ASAP Duration: 6 Month Contract ... Strong prompt engineering skills. * Backend or full-stack software development experience (backend ...

Impiricus

Software Engineer (Full-stack)

New York, NY · On-site +1

$110K - $135K/yr

Atlanta, GA | NYC, NY | Remote, USA Employment Type: Full-time, Salaried Who We Are Impiricus is ... Integrate and refine LLM workflows including prompt engineering, model orchestration, and backend/U ...

Vercel

Software Engineer, Agent

New York, NY · On-site +1

... remote. For location-specific details, please connect with our recruiting team. What you will do ... Collaborate with other engineers on prompt engineering, model evaluation, and retrieval-augmented ...

next page

Showing results 1-20

All JobsPrompt Engineer JobsRemote Prompt Engineer JobsRemote Prompt Engineer Jobs in New York

Remote Prompt Engineer information

See New York salary details

$14

$61

$88

How much do remote prompt engineer jobs pay per hour?

As of Aug 9, 2026, the average hourly pay for remote prompt engineer in New York is $61.26, according to ZipRecruiter salary data. Most workers in this role earn between $43.94 and $81.54 per hour, depending on experience, location, and employer.

What is a remote prompt engineer?

A Remote Prompt Engineer designs, refines, and optimizes prompts to improve interactions between users and AI models. They work with natural language processing (NLP) systems to enhance response accuracy and relevance. This role often involves testing different prompts, analyzing AI outputs, and collaborating with developers or researchers to fine-tune language models. Since the position is remote, engineers use online tools and communication platforms to collaborate with teams and stay updated on AI advancements.

What does a typical workday look like for a remote prompt engineer?

As a Remote Prompt Engineer, your workday often involves designing and testing prompts for various AI models, collaborating with product managers and developers, and analyzing model outputs to refine interactions. You may also participate in virtual team meetings to discuss project goals, provide feedback on AI performance, and stay updated on new advancements in prompt engineering. Routine responsibilities include documenting prompt structures, troubleshooting model behavior, and integrating feedback from client or user testing. This dynamic and collaborative environment enables you to contribute creative solutions and drive continuous improvement in AI-driven applications.

What are the key skills and qualifications needed to thrive as a remote prompt engineer?

To thrive as a Remote Prompt Engineer, you need expertise in natural language processing, prompt design, and a background in computer science or a related field. Familiarity with AI platforms (such as OpenAI or Anthropic APIs), programming languages like Python, and prompt engineering tools is highly valuable. Outstanding communication, collaboration, and problem-solving skills help remote team members excel in optimizing AI performance. These competencies ensure tailored, effective AI solutions and smooth, results-driven teamwork from a remote environment.

What are the most commonly searched types of Prompt Engineer jobs in New York? The most popular types of Prompt Engineer jobs in New York are:
What are popular job titles related to Remote Prompt Engineer jobs in New York? For Remote Prompt Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Remote Prompt Engineer jobs in New York look for? The top searched job categories for Remote Prompt Engineer jobs in New York are:
What cities in New York are hiring for Remote Prompt Engineer jobs? Cities in New York with the most Remote Prompt Engineer job openings:
Remote Prompt Engineer jobs near you
Infographic showing various Remote Prompt Engineer job openings in New York as of August 2026, with employment types broken down into 21% Internship, 57% Full Time, and 22% Contract. Highlights an 100% Remote job distribution, with an average salary of $127,415 per year, or $61.3 per hour.

Machine Learning Operations Engineer - Remote

NAVA Software Solutions

Jersey City, NJ • On-site, Remote

$76K - $102K/yr

Full-time

Re-posted 7 days ago

Job description

NAVA Software solutions is looking for a Machine Learning Operations Engineer
Details:
Machine Learning Operations (MLOps) Engineer - AWS (with LLM Focus)
Location: Remote work
Duration: 12 months
Responsibilities:
  • LLM-Optimized MLOps Infrastructure: Design and implement MLOps infrastructure on AWS tailored for LLMs, leveraging services like SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and more.
  • LLM Deployment Pipelines: Build and manage CI/CD pipelines specifically for LLM deployment, addressing unique challenges like model size, inference optimization, and versioning.
  • LLMOps Practices: Implement LLMOps best practices for monitoring model performance, drift detection, prompt management, and feedback loops for continuous improvement.
  • RESTful API Development: Design and develop RESTful APIs to expose LLM capabilities to other applications and services, ensuring scalability, security, and optimal performance.
  • Model Optimization: Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient inference on AWS infrastructure.
  • Monitoring and Observability: Establish comprehensive monitoring and alerting mechanisms to track LLM performance, latency, resource utilization, and potential biases.
  • Prompt Engineering and Management: Develop strategies for prompt engineering and management to enhance LLM outputs and ensure consistency and safety.
  • Collaboration: Work closely with data scientists, researchers, and software engineers to integrate LLM models into production systems effectively.
  • Cost Optimization: Continuously optimize LLMOps processes and infrastructure for cost-efficiency while maintaining high performance and reliability.

Qualifications:
  • Experience: 3+ years of experience in MLOps or a related field, with hands-on experience in deploying and managing LLMs.
  • AWS Expertise: Strong proficiency in AWS services relevant to MLOps and LLMs, including SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and API Gateway.
  • LLM Knowledge: Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference optimization strategies.
  • Programming Skills: Proficiency in Python and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation), REST API frameworks (e.g., Flask, FastAPI), and LLM libraries (e.g., Hugging Face Transformers).
  • Monitoring: Familiarity with monitoring and logging tools for LLMs, such as Prometheus, Grafana, and CloudWatch.
  • Containerization: Experience with Docker and container orchestration (e.g., Kubernetes, ECS) for LLM deployment.
  • Problem Solving: Excellent problem-solving and troubleshooting skills in the context of LLMs and MLOps.
  • Communication: Strong communication and collaboration skills to effectively work with cross-functional teams
NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media

Facebook

View All NAVA Software Solutions Jobs

Apply