1

Machine Learning Software Engineer Jobs in New Jersey

$111K - $145K/yr

Job Requisition ID # 26WD98377 Senior Machine Learning Test Engineer Location: United States East ... Your skills span test strategy, automation, and a little MLOps, with a strong software engineering ...

We are seeking an AI/ML Software Engineer for a contract position with a Global Financial ... Work closely with cross functional teams to build scalable applications, develop machine learning ...

Software Engineer READ: This position is 100% on-site at the FAA William J. Hughes Technical Center ... Explore artificial intelligence and machine learning applications in simulation and training ...

Lead, Machine Learning Engineer

Newark, NJ ยท On-site

$107K - $141K/yr

Operationalize ML software models and components that solve real-world business problems, while ... programming concepts * Machine Learning and Deep Learning: Good understanding of: ML algorithms ...

As a Machine Learning Engineer, you will design and scale deep generative models for biology. You'll collaborate closely with experienced founders and domain experts to push the boundaries of how AI ...

Software Engineer

Edgewater Park, NJ ยท On-site

$80K - $105K/yr

The Software Engineer contributes to the development of analytics solutions, supports the ... AI & Machine Learning: LLM integration, prompt engineering, embeddings, model evaluation ...

Showing results 21-40

Machine Learning Software Engineer information

See New Jersey salary details

$64.5K

$149.8K

$208.6K

How much do machine learning software engineer jobs pay per year?

As of Aug 16, 2026, the average yearly pay for machine learning software engineer in New Jersey is $149,771.00, according to ZipRecruiter salary data. Most workers in this role earn between $121,800.00 and $175,600.00 per year, depending on experience, location, and employer.

Is machine learning software engineer a high paying job?

Machine learning software engineers typically earn high salaries due to the specialized skills required, such as proficiency in programming languages like Python and experience with frameworks like TensorFlow. Salaries vary based on experience, location, and industry, but generally rank above average compared to other software engineering roles.

What does a machine learning software engineer do?

A Machine Learning Software Engineer designs, develops, and deploys machine learning models within software applications. They work on data preprocessing, model training, optimization, and integration into production systems. Their role requires expertise in programming (Python, Java, or C++), machine learning frameworks (TensorFlow, PyTorch, or Scikit-learn), and cloud platforms. They collaborate with data scientists and software engineers to build scalable ML solutions.

What are the key skills and qualifications needed to thrive as a machine learning software engineer?

To thrive as a Machine Learning Software Engineer, you need a solid understanding of programming (especially Python), algorithms, data structures, and mathematics, ideally backed by a degree in computer science, engineering, or a related field. Experience with frameworks such as TensorFlow or PyTorch, familiarity with cloud platforms (AWS, Azure, or GCP), and relevant certifications in data science or machine learning are highly valuable. Strong problem-solving skills, effective communication, and the ability to work collaboratively with cross-functional teams set outstanding candidates apart. These competencies are crucial for building deployable, scalable, and maintainable machine learning solutions that address real business challenges.

What are the most commonly searched types of Machine Learning Software Engineer jobs in New Jersey?

The most popular types of Machine Learning Software Engineer jobs in New Jersey are:

What are popular job titles related to Machine Learning Software Engineer jobs in NJ?

For Machine Learning Software Engineer jobs in NJ, the most frequently searched job titles are:

Infographic showing various Machine Learning Software Engineer job openings in New Jersey as of August 2026, with employment types broken down into 1% As Needed, 75% Full Time, 21% Part Time, 1% Temporary, and 2% Contract. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution, with an average salary of $149,771 per year, or $72 per hour.

Machine Learning Operations Engineer - Remote

NAVA Software Solutions

Jersey City, NJ โ€ข On-site, Remote

$76K - $102K/yr

Full-time

Re-posted 14 days ago


Job description

NAVA Software solutions is looking for a Machine Learning Operations Engineer
Details:
Machine Learning Operations (MLOps) Engineer - AWS (with LLM Focus)
Location: Remote work
Duration: 12 months

Responsibilities:
  • LLM-Optimized MLOps Infrastructure: Design and implement MLOps infrastructure on AWS tailored for LLMs, leveraging services like SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and more.
  • LLM Deployment Pipelines: Build and manage CI/CD pipelines specifically for LLM deployment, addressing unique challenges like model size, inference optimization, and versioning.
  • LLMOps Practices: Implement LLMOps best practices for monitoring model performance, drift detection, prompt management, and feedback loops for continuous improvement.
  • RESTful API Development: Design and develop RESTful APIs to expose LLM capabilities to other applications and services, ensuring scalability, security, and optimal performance.
  • Model Optimization: Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient inference on AWS infrastructure.
  • Monitoring and Observability: Establish comprehensive monitoring and alerting mechanisms to track LLM performance, latency, resource utilization, and potential biases.
  • Prompt Engineering and Management: Develop strategies for prompt engineering and management to enhance LLM outputs and ensure consistency and safety.
  • Collaboration: Work closely with data scientists, researchers, and software engineers to integrate LLM models into production systems effectively.
  • Cost Optimization: Continuously optimize LLMOps processes and infrastructure for cost-efficiency while maintaining high performance and reliability.

Qualifications:
  • Experience: 3+ years of experience in MLOps or a related field, with hands-on experience in deploying and managing LLMs.
  • AWS Expertise: Strong proficiency in AWS services relevant to MLOps and LLMs, including SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and API Gateway.
  • LLM Knowledge: Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference optimization strategies.
  • Programming Skills: Proficiency in Python and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation), REST API frameworks (e.g., Flask, FastAPI), and LLM libraries (e.g., Hugging Face Transformers).
  • Monitoring: Familiarity with monitoring and logging tools for LLMs, such as Prometheus, Grafana, and CloudWatch.
  • Containerization: Experience with Docker and container orchestration (e.g., Kubernetes, ECS) for LLM deployment.
  • Problem Solving: Excellent problem-solving and troubleshooting skills in the context of LLMs and MLOps.
  • Communication: Strong communication and collaboration skills to effectively work with cross-functional teams

NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media