Manhattan, NY · On-site
$112K - $148K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Manhattan, NY · On-site
$112K - $148K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Manhattan, NY · On-site
$112K - $148K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Manhattan, NY · On-site
$112K - $148K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Manhattan, NY · On-site
$164K - $260K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Manhattan, NY · On-site
$164K - $260K/yr
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency ... Deep knowledge and passion for data science fundamentals, training and deploying models
Jersey City, NJ · On-site +1
$76K - $102K/yr
Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient ... Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference ...
Jersey City, NJ · On-site +1
$76K - $102K/yr
Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient ... Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference ...
Manhattan, NY · On-site
$115K - $157K/yr
Tune vector quantization strategies (PQ, SQ, Binary Quantization) to reduce memory footprint and ... Deep knowledge of vector embedding generation, storage and retrieval, with preference for hands-on ...
Manhattan, NY · On-site
$115K - $157K/yr
Tune vector quantization strategies (PQ, SQ, Binary Quantization) to reduce memory footprint and ... Deep knowledge of vector embedding generation, storage and retrieval, with preference for hands-on ...
Manhattan, NY · Hybrid
$115K - $157K/yr
Tune vector quantization strategies (PQ, SQ, Binary Quantization) to reduce memory footprint and ... Deep knowledge of vector embedding generation, storage and retrieval, with preference for hands-on ...
Manhattan, NY · Hybrid
$115K - $157K/yr
Tune vector quantization strategies (PQ, SQ, Binary Quantization) to reduce memory footprint and ... Deep knowledge of vector embedding generation, storage and retrieval, with preference for hands-on ...
New York, NY · On-site
$175K - $275K/yr
Implement techniques such as distillation, quantization, and pruning to aggressively accelerate ... Strong experience in deep learning systems and infrastructure * Expertise in PyTorch, CUDA, Triton ...
New York, NY · On-site
$175K - $275K/yr
Implement techniques such as distillation, quantization, and pruning to aggressively accelerate ... Strong experience in deep learning systems and infrastructure * Expertise in PyTorch, CUDA, Triton ...
$175K - $250K/yr
Prior experience in the domains of LLMs, foundation models, or large-scale deep learning systems, with a complete understanding of modern training, fine-tuning, quantization, and model evaluation.
$175K - $250K/yr
Prior experience in the domains of LLMs, foundation models, or large-scale deep learning systems, with a complete understanding of modern training, fine-tuning, quantization, and model evaluation.
New York, NY · On-site
$175K - $250K/yr
Prior experience in the domains of LLMs, foundation models, or large-scale deep learning systems, with a complete understanding of modern training, fine-tuning, quantization, and model evaluation.
New York, NY · On-site
$175K - $250K/yr
Prior experience in the domains of LLMs, foundation models, or large-scale deep learning systems, with a complete understanding of modern training, fine-tuning, quantization, and model evaluation.
New York, NY · On-site
$175K - $275K/yr
Implement techniques such as distillation, quantization, and pruning to aggressively accelerate ... Strong experience in deep learning systems and infrastructure * Expertise in PyTorch, CUDA, Triton ...
Quick apply
New York, NY · On-site
$175K - $275K/yr
Implement techniques such as distillation, quantization, and pruning to aggressively accelerate ... Strong experience in deep learning systems and infrastructure * Expertise in PyTorch, CUDA, Triton ...
... quantization, compression, and resource-efficient AI, to drive performance improvements and ... Research experience in machine learning, deep learning, natural language processing, and/or ...
... quantization, compression, and resource-efficient AI, to drive performance improvements and ... Research experience in machine learning, deep learning, natural language processing, and/or ...
Melville, NY · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
Melville, NY · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
Florham Park, NJ · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
Florham Park, NJ · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
Stamford, CT · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
Stamford, CT · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
New York, NY · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
New York, NY · On-site
$50K - $112K/yr
... networks and deep learning methods for advanced AI applications - Managing data quality and ... using quantization, inference acceleration, and model-routing techniques - Designing agent ...
New York, NY · On-site
$180K - $360K/yr
Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and ... Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous ...
New York, NY · On-site
$180K - $360K/yr
Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and ... Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous ...
Manhattan, NY · Remote
$114K - $157K/yr
Optimize inference performance and cost efficiency through techniques such as model quantization ... learning, and deep learning 5. Experience with AI platforms like PyTorch or TensorFlow 6. ...
Manhattan, NY · Remote
$114K - $157K/yr
Optimize inference performance and cost efficiency through techniques such as model quantization ... learning, and deep learning 5. Experience with AI platforms like PyTorch or TensorFlow 6. ...
$196K - $253K/yr
Strong foundation in machine learning algorithms, including deep learning architectures (e.g ... quantization, pruning, and knowledge distillation. * Experience with model interpretability ...
$196K - $253K/yr
Strong foundation in machine learning algorithms, including deep learning architectures (e.g ... quantization, pruning, and knowledge distillation. * Experience with model interpretability ...
Manhattan, NY · On-site
$164K - $260K/yr
... quantization to meet production constraints such as latency, memory, and cost. * Apply ... Strong foundation in ML, deep learning, statistical modeling, and experimental design. * Experience ...
Manhattan, NY · On-site
$164K - $260K/yr
... quantization to meet production constraints such as latency, memory, and cost. * Apply ... Strong foundation in ML, deep learning, statistical modeling, and experimental design. * Experience ...
New York, NY · On-site
$196K - $253K/yr
Strong foundation in machine learning algorithms, including deep learning architectures (e.g ... quantization, pruning, and knowledge distillation. * Experience with model interpretability ...
New York, NY · On-site
$196K - $253K/yr
Strong foundation in machine learning algorithms, including deep learning architectures (e.g ... quantization, pruning, and knowledge distillation. * Experience with model interpretability ...
| Aspect | Deep Learning Quantization | Machine Learning Engineer |
|---|---|---|
| Required Credentials | Advanced degrees in AI, Computer Science, or related fields; knowledge of neural networks | Bachelor's or Master's in CS, Data Science, or related fields; programming skills |
| Work Environment | Research labs, AI development teams, hardware optimization settings | Software development teams, data-driven projects, product-focused environments |
| Industry Usage | AI hardware optimization, model deployment, edge computing | Model development, data analysis, software solutions across industries |
Deep Learning Quantization focuses on reducing model size and improving inference speed through techniques like weight and activation quantization, often in hardware or embedded systems. Machine Learning Engineers develop, implement, and optimize machine learning models for various applications. While both roles require knowledge of AI and programming, Deep Learning Quantization is more specialized in model optimization techniques, whereas Machine Learning Engineers work broadly on model development and deployment.
$112K - $148K/yr
Full-time
Medical, Retirement
Re-posted 26 days ago
8.0
Based on 493 frontline employees who took The Breakroom Quiz
73rd of 170 rated banks
We are looking for a Senior MLOps engineer to work closely with Data Scientists to build and deploy ML models on a modern MLOps stack.
As Lead Machine Learning Engineer on the Recommendation Engine team, you'll build and maintain pipelines for distributed model training on large compute clusters, batch/real-time model serving, hyperparameter tuning at scale, model monitoring, production validation and other activities vital for model development, testing and deployment in a well-managed, controlled environment.
Our product, Personalization and Insights, builds and supports high throughput, low latency applications which leverage state of the art machine learning architectures, and which are deployed in AWS. These applications power personalized experiences across Chase Consumer & Community Banking channels, to help weave a user experience that includes traditional banking services with other services in the Travel, Merchant Offer Shopping, and Dining spaces.
Job responsibilities
Build, deploy, and maintain robust pipelines for distributed training on GPU-enabled clusters to support scalable machine learning workflows.
Develop and manage pipelines for high-throughput, real-time inference as well as batch inference, ensuring optimal performance and reliability.
Implement quantization techniques and deploy large language models (LLMs) to maximize efficiency and resource utilization.
Oversee the management and optimization of vector databases to support advanced AI and machine learning applications.
Establish and maintain comprehensive monitoring and observability pipelines to ensure system health, performance, and rapid issue resolution.
Collaborate with cross-functional teams to integrate new technologies and continuously improve existing infrastructure.
Partner with product, architecture, and other engineering teams to define scalable and performant technical solutions.
Required qualifications, capabilities, and skills
BS in Computer Science or related Engineering field with 6+ years of experience Or MS degree in Computer Science or related Engineering field with 4+ years experience.
Solid knowledge and extensive experience in Python and in cloud computing, preferably AWS
Understanding of quantization techniques such as PTQ, AWQ etc. used to quantize LLMs for accelerating inference on specific GPU architectures
Experience in systems engineering fundamentals: caching, CUDA, autoscaling, high throughput, low latency, x-region resilient applications
Deep knowledge and passion for data science fundamentals, training and deploying models
Experience in monitoring and observability tools to monitor model input/output and features stats
Operational experience in big data/ML tools such as Ray, DuckDB, Spark and in training/inference systems such as Ray, vllm/SGLang
Solid grounding in engineering fundamentals and analytical mindset
Preferred qualifications, capabilities, and skills
Experience with recommendation and personalization systems is a plus.
CUDA experience is a big plus
Solid fundamentals and experience in containers (docker ecosystem), container orchestration systems [Kubernetes, ECS], DAG orchestration [Airflow, Kubeflow etc]
Good knowledge of Databases
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Get the full story on Breakroom
Sourced by ZipRecruiter
Finance and insurance and banking and credit intermediation
10,000+ Employees
New York, NY, US
