1

Ml Inference Jobs in Newark, NJ (NOW HIRING)

... inference, and monitoring in production environments. • Participate in continuous improvement of the ML infrastructure and processes for scalability and performance. Qualifications : Required : • ...

... inference, and monitoring in production environments. • Participate in continuous improvement of the ML infrastructure and processes for scalability and performance. Qualifications : Required : • ...

Showing results 21-40

Ml Inference information

See Newark, NJ salary details

$39.2K

$128.4K

$205.5K

How much do ml inference jobs pay per year?

As of Aug 12, 2026, the average yearly pay for ml inference in Newark, NJ is $128,351.00, according to ZipRecruiter salary data. Most workers in this role earn between $103,000.00 and $142,200.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.
What are popular job titles related to Ml Inference jobs in Newark, NJ? For Ml Inference jobs in Newark, NJ, the most frequently searched job titles are:
What job categories do people searching Ml Inference jobs in Newark, NJ look for? The top searched job categories for Ml Inference jobs in Newark, NJ are:
What cities near Newark, NJ are hiring for Ml Inference jobs? Cities near Newark, NJ with the most Ml Inference job openings:
Infographic showing various Ml Inference job openings in Newark, NJ as of July 2026, with employment types broken down into 96% Full Time, 2% Part Time, and 2% Contract. Highlights an 81% Physical, 5% Hybrid, and 14% Remote job distribution, with an average salary of $128,351 per year, or $61.7 per hour.

Senior/Staff/Principal AI/ML Engineer - Threat Detection Engineering

AppGate Cybersecurity, Inc.

New York, NY

Full-time

Re-posted 2 days ago


Job description

About AppGate

AppGate secures and protects an organization's most valuable assets with its high performance Zero Trust Network Access (ZTNA) solution. AppGate is the only direct-routed ZTNA solution built for peak performance, superior protection and seamless interoperability. AppGate safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com. 

About the Role

We're looking for a AI/ML Engineer (Senior/Staff/Principal) - Threat Detection who will design, build, and operationalize the detection algorithms, ML inference pipelines, and risk aggregation systems that power our autonomous threat detection platform.

You'll work at the intersection of identity security, behavioral analytics, and applied machine learning - building production systems that analyze ZTNA audit logs in near real-time, surface high-fidelity threat signals, and feed into our Risk Sentinel enforcement engine to continuously harden access decisions.

Key Responsibilities

       Your engineering work will directly enable next-generation capabilities, including:

       Threat Detection Engine: Build advanced detections to identify threats early, including identity compromise, privilege escalation, impossible travel, and data exfiltration across identity, network, device, and session telemetry.

       ML Anomaly Detection: Production models using Isolation Forest, One-Class SVM, and Autoencoder neural networks to surface behavioral outliers that rules miss.

       Risk Aggregation & Enforcement: Design/develop accurate and explainable risk scoring systems that continuously normalize and correlate detection signals into dynamic user, device, and session risk scores that directly drive adaptive access enforcement decisions.

       Real-Time Detection Pipeline: Build scalable, low-latency streaming pipelines that process ZTNA events in near real time, enabling resilient, high-throughput security analytics.

       AI Agent Security: Define and implement security controls for autonomous AI agents, including detection of agent drift, unauthorized resource access, prompt injection attacks, privilege escalation, data leakage, and other emerging threats in Agentic AI systems.

       Autonomous Remediation (Roadmap): Leverage agentic AI to automate threat investigation, contextual analysis, and remediation workflows, enabling intelligent containment and response for high-confidence security incidents.

       Design and implement detection algorithms spanning authentication, authorization, network/location, data access, session management, and temporal behavioral domains.

       Train, evaluate, and deploy ML models on real-world identity and network telemetry; tune for production precision and recall targets.

       Architect and operate the detection pipeline - from audit log ingestion through risk aggregation and Risk Sentinel integration.

       Define the detection taxonomy - categorizing, prioritizing, and lifecycle-managing the full detection library using a scalable detection family model.

       Instrument and improve signal quality - measuring MTTD, false positive rates, and MITRE ATT&CK coverage; partnering with red teams to validate detections against real attack scenarios.

       Collaborate cross-functionally with security, product, and platform engineering to align detection coverage with customer threat models and roadmap priorities.

Required Qualifications

        7+ years of production AI/ML engineering experience, with a strong preference for candidates who have built threat detection, UEBA, ITDR, or identity security platforms at leading security or cloud companies.

        Detection algorithm expertise: Hands-on experience designing detections for identity-based threats - credential compromise, privilege escalation, insider activity, behavioral anomalies, and data exfiltration.

        MLOps & Productionization: Experience building and operating scalable MLOps platforms for AI/ML systems, including model lifecycle management, CI/CD for ML pipelines, feature stores, automated retraining, model monitoring/drift detection, experiment tracking, and deployment orchestration using Kubernetes, MLflow, Kubeflow, SageMaker, or equivalent tooling in high-throughput production environments.

        ML proficiency: Experience building AI-powered security systems using large language models, deep learning, and agentic AI techniques for threat detection, anomaly analysis, contextual investigation, and intelligent remediation.

        Data & streaming engineering: Real-time or near-real-time pipeline experience (Kafka, Flink, Spark Streaming, or equivalent); familiarity with lakehouse formats (Apache Iceberg, Parquet).

        Security domain knowledge: MITRE ATT&CK, identity threat kill chains, ZTNA or network access control systems, and audit log analysis.

        Bonus: Experience with detection-as-code frameworks (Sigma, YARA), ZTNA platforms, LLMs or GNNs applied to security, or publications at USENIX, CCS, NeurIPS, or ICML.

        Mindset: Mission-driven, production-focused, signal-obsessed. You measure precision and recall, you eliminate alert fatigue, and you care that your work protects real systems.

This is your chance to build the AI systems that detect, prevent, and auto-remediate threats across networks, users, and autonomous AI agents.

If you are an experienced AI/ML Engineer who has built identity or network threat detection platforms at scale and wants your next platform to protect the people and infrastructure the world depends on - we want to hear from you.

AppGate is An Equal Opportunity/Affirmative Action Employer and a federal contractor subject to the Rehabilitation Act of 1973 and the Vietnam Era Veterans Readjustment Assistance Act of 1974 as amended, and their corresponding regulations. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.  Further, AppGate is an affirmative action employer committed to taking positive steps to employ, advance in employment and otherwise afford equal employment opportunity to protected veterans and individuals with disabilities.  In furtherance of AppGate's policy regarding affirmative action and equal employment opportunity, AppGate has developed a written affirmative action program. This program is available for review upon request by any applicant or employee during normal business hours by contacting the company's EEO Coordinator.