ZipRecruiter

Log In

2

Llm Engineer Remote Jobs in Secaucus, NJ (NOW HIRING)

Soda Data

Growth Engineer (Remote)

New York, NY · Remote

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

Soda Data

Growth Engineer (Remote)

New York, NY · Remote

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

Soda Data

Growth Engineer (Remote)

New York, NY · On-site +1

$120K - $130K/yr

Serious prompt engineering: multi-step LLM pipelines with structured outputs and evals, not ... Fully remote (US-based), with our Brooklyn office available if you want one. * All the tokens you ...

YO AI Labs

GPU Programmer - Remote

New York, NY · Remote

$60 - $85/hr

Remote Job Overview We are seeking experienced GPU Programmers / Software Engineers to design and optimize GPU-based tasks for AI and LLM applications. You will apply your expertise in GPU ...

Unframe

Support Engineer (Remote)

New York, NY · Remote

About Unframe Unframe is an AI-first startup helping the world's largest enterprises bring LLM ... About the role We're looking for a Support Engineer to join our team and support large global ...

Unframe

Support Engineer (Remote)

New York, NY · Remote

About Unframe Unframe is an AI-first startup helping the world's largest enterprises bring LLM ... About the role We're looking for a Support Engineer to join our team and support large global ...

Unframe

Support Engineer (Remote)

New York, NY · On-site +1

About Unframe Unframe is an AI-first startup helping the world's largest enterprises bring LLM ... About the role We're looking for a Support Engineer to join our team and support large global ...

Mercor

LLM Agent Engineer - Specialist

New York, NY · Remote

$100 - $500/hr

Agent Engineer Type: Contract Compensation: $100-$500/hour Location ... Remote Role Responsibilities * Build and operate LLM agents in production environments. * Ensure ...

New

next page

Showing results 1-20

All JobsLlm Engineer JobsLlm Engineer Remote JobsLlm Engineer Remote Jobs in Secaucus, NJ

Llm Engineer Remote information

See Secaucus, NJ salary details

$25

$54

$77

How much do llm engineer remote jobs pay per hour?

As of Aug 24, 2026, the average hourly pay for llm engineer remote in Secaucus, NJ is $54.53, according to ZipRecruiter salary data. Most workers in this role earn between $43.99 and $63.32 per hour, depending on experience, location, and employer.

What is an LLM engineer?

An LLM Engineer, or Large Language Model Engineer, is a professional who designs, develops, and optimizes applications using advanced AI language models such as GPT-4 or similar technologies. Working remotely, they are responsible for integrating these models into products, fine-tuning them for specific tasks, and ensuring their performance and reliability. LLM Engineers often collaborate with data scientists, software developers, and product managers to create solutions in areas like chatbots, content generation, and natural language processing. Their work requires a strong background in machine learning, programming, and cloud computing.

What are the key skills and qualifications needed to thrive as an LLM engineer in a remote role?

To thrive as an LLM Engineer remotely, you need strong expertise in machine learning, natural language processing, and proficiency with programming languages such as Python, often supported by a degree in computer science or related fields. Familiarity with frameworks like PyTorch or TensorFlow, experience with cloud platforms (AWS, GCP), and knowledge of large language model architectures are commonly required. Excellent problem-solving skills, self-motivation, and effective remote communication make candidates stand out. These capabilities are crucial for developing, deploying, and maintaining advanced language models while collaborating efficiently with distributed teams.

What are some typical challenges faced by remote LLM engineers when collaborating with cross-functional teams?

Remote LLM Engineers often work closely with data scientists, product managers, and software engineers to develop and deploy large language models. One common challenge is ensuring clear and consistent communication across different time zones and technical backgrounds, which can sometimes lead to misaligned project goals or delays. To overcome this, many teams rely on detailed documentation, regular virtual meetings, and collaborative project management tools. Building strong relationships remotely and proactively sharing updates can make collaboration smoother and more productive.

What is the difference between Llm Engineer Remote vs Data Scientist Remote?

AspectLlm Engineer RemoteData Scientist Remote
Required CredentialsAdvanced degree in CS, ML, or related field; experience with NLP and deep learningDegree in CS, Statistics, or related; experience with data analysis and machine learning
Work EnvironmentCollaborative teams, research-focused, often in tech or AI companiesData analysis, model development, reporting; across various industries
Employer & Industry UsageTech companies, AI startups, research institutionsFinance, healthcare, tech, e-commerce, and more

While both roles involve machine learning, Llm Engineers focus on developing large language models and NLP applications, often requiring deep expertise in AI research. Data Scientists analyze data to inform business decisions, with broader industry applications. The roles share some credentials but differ in focus and daily tasks.

What are popular job titles related to Llm Engineer Remote jobs in Secaucus, NJ?

For Llm Engineer Remote jobs in Secaucus, NJ, the most frequently searched job titles are:

What job categories do people searching Llm Engineer Remote jobs in Secaucus, NJ look for?

The top searched job categories for Llm Engineer Remote jobs in Secaucus, NJ are:

What cities near Secaucus, NJ are hiring for Llm Engineer Remote jobs?

Cities near Secaucus, NJ with the most Llm Engineer Remote job openings:

Llm Engineer Remote jobs near you
Infographic showing various Llm Engineer Remote job openings in Secaucus, NJ as of August 2026, with employment types broken down into 87% Full Time, 6% Part Time, 1% Temporary, and 6% Contract. Highlights an 85% Physical, 6% Hybrid, and 9% Remote job distribution, with an average salary of $113,413 per year, or $54.5 per hour.

Machine Learning Operations Engineer - Remote

NAVA Software Solutions

Jersey City, NJ • On-site, Remote

$76K - $102K/yr

Full-time

Re-posted 22 days ago

Job description

NAVA Software solutions is looking for a Machine Learning Operations Engineer
Details:
Machine Learning Operations (MLOps) Engineer - AWS (with LLM Focus)
Location: Remote work
Duration: 12 months
Responsibilities:
  • LLM-Optimized MLOps Infrastructure: Design and implement MLOps infrastructure on AWS tailored for LLMs, leveraging services like SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and more.
  • LLM Deployment Pipelines: Build and manage CI/CD pipelines specifically for LLM deployment, addressing unique challenges like model size, inference optimization, and versioning.
  • LLMOps Practices: Implement LLMOps best practices for monitoring model performance, drift detection, prompt management, and feedback loops for continuous improvement.
  • RESTful API Development: Design and develop RESTful APIs to expose LLM capabilities to other applications and services, ensuring scalability, security, and optimal performance.
  • Model Optimization: Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient inference on AWS infrastructure.
  • Monitoring and Observability: Establish comprehensive monitoring and alerting mechanisms to track LLM performance, latency, resource utilization, and potential biases.
  • Prompt Engineering and Management: Develop strategies for prompt engineering and management to enhance LLM outputs and ensure consistency and safety.
  • Collaboration: Work closely with data scientists, researchers, and software engineers to integrate LLM models into production systems effectively.
  • Cost Optimization: Continuously optimize LLMOps processes and infrastructure for cost-efficiency while maintaining high performance and reliability.

Qualifications:
  • Experience: 3+ years of experience in MLOps or a related field, with hands-on experience in deploying and managing LLMs.
  • AWS Expertise: Strong proficiency in AWS services relevant to MLOps and LLMs, including SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and API Gateway.
  • LLM Knowledge: Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference optimization strategies.
  • Programming Skills: Proficiency in Python and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation), REST API frameworks (e.g., Flask, FastAPI), and LLM libraries (e.g., Hugging Face Transformers).
  • Monitoring: Familiarity with monitoring and logging tools for LLMs, such as Prometheus, Grafana, and CloudWatch.
  • Containerization: Experience with Docker and container orchestration (e.g., Kubernetes, ECS) for LLM deployment.
  • Problem Solving: Excellent problem-solving and troubleshooting skills in the context of LLMs and MLOps.
  • Communication: Strong communication and collaboration skills to effectively work with cross-functional teams
NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media

Facebook

View All NAVA Software Solutions Jobs

Apply