Guides the team in implementing prompt engineering, retrieval strategies, model evaluation, and inference optimization techniques. * Drives technical innovation and adoption of AI/ML best practices ...
Guides the team in implementing prompt engineering, retrieval strategies, model evaluation, and inference optimization techniques. * Drives technical innovation and adoption of AI/ML best practices ...
Feature Lead - Technology, AI/ML
Plano, TX · On-site +1
Guides the team in implementing prompt engineering, retrieval strategies, model evaluation, and inference optimization techniques. * Drives technical innovation and adoption of AI/ML best practices ...
Feature Lead - Technology, AI/ML
Plano, TX · On-site +1
Guides the team in implementing prompt engineering, retrieval strategies, model evaluation, and inference optimization techniques. * Drives technical innovation and adoption of AI/ML best practices ...
Sr AI/ML Engineer
Irving, TX · On-site
$102K - $179K/yr
Own AI/ML solutions end to end, from scoping and design through implementation, deployment, and ... Experience optimizing cost and performance for large-scale inference workloads preferred.
Sr AI/ML Engineer
Irving, TX · On-site
$102K - $179K/yr
Own AI/ML solutions end to end, from scoping and design through implementation, deployment, and ... Experience optimizing cost and performance for large-scale inference workloads preferred.
Sr AI/ML Engineer
Irving, TX · On-site
$102K - $179K/yr
Own AI/ML solutions end to end, from scoping and design through implementation, deployment, and ... Experience optimizing cost and performance for large-scale inference workloads preferred.
Sr AI/ML Engineer
Irving, TX · On-site
$102K - $179K/yr
Own AI/ML solutions end to end, from scoping and design through implementation, deployment, and ... Experience optimizing cost and performance for large-scale inference workloads preferred.
Develops solution, data, and AI/ML architecture and resolves complex issues across a variety of ... and inference services) where appropriate. Establishes and enforces best practices for data ...
Develops solution, data, and AI/ML architecture and resolves complex issues across a variety of ... and inference services) where appropriate. Establishes and enforces best practices for data ...
Enable and optimize ML workloads including training, inference, and LLM deployment pipelines on Kubernetes * Build platform extensions using Kubernetes controllers, operators, CRDs, and Golang-based ...
Enable and optimize ML workloads including training, inference, and LLM deployment pipelines on Kubernetes * Build platform extensions using Kubernetes controllers, operators, CRDs, and Golang-based ...
AI/ML Senior Principal Software Engineer
Richardson, TX · On-site
$171 - $296/hr
Experience with AI/ML acceleration on edge devices--NPUs, dedicated inference accelerators, DSP‑based pipelines--and the HW/SW co‑design challenges involved. * Familiarity with model quantization ...
New
AI/ML Senior Principal Software Engineer
Richardson, TX · On-site
$171 - $296/hr
Experience with AI/ML acceleration on edge devices--NPUs, dedicated inference accelerators, DSP‑based pipelines--and the HW/SW co‑design challenges involved. * Familiarity with model quantization ...
New
Senior AI/ML Engineer - Hybrid
Irving, TX · On-site +1
$87K - $151K/yr
Build scalable, secure, end‑to‑end ML pipelines for data ingestion, model training, evaluation, and real‑time inference. * Automate model deployment, monitoring, and drift detection across ...
Senior AI/ML Engineer - Hybrid
Irving, TX · On-site +1
$87K - $151K/yr
Build scalable, secure, end‑to‑end ML pipelines for data ingestion, model training, evaluation, and real‑time inference. * Automate model deployment, monitoring, and drift detection across ...
AI/ML Senior Principal Software Engineer
Richardson, TX · On-site
$114K - $157K/yr
Experience with AI/ML acceleration on edge devices - NPUs, dedicated inference accelerators, DSP-based pipelines - and the HW/SW co-design challenges involved. Familiarity with model quantization ...
AI/ML Senior Principal Software Engineer
Richardson, TX · On-site
$114K - $157K/yr
Experience with AI/ML acceleration on edge devices - NPUs, dedicated inference accelerators, DSP-based pipelines - and the HW/SW co-design challenges involved. Familiarity with model quantization ...
Architect and implement AI/ML pipelines leveraging large language models, small language models ... inference, and intelligent automation. * Provide technical leadership and collaborate across ...
Architect and implement AI/ML pipelines leveraging large language models, small language models ... inference, and intelligent automation. * Provide technical leadership and collaborate across ...
... ML systems at scale. • Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. • Inference & Training: Has ...
... ML systems at scale. • Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. • Inference & Training: Has ...
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Quick apply
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Staff Machine Learning Engineer - Leasing
$15.25 - $18/hr
... ML systems at scale. * Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. * Inference & Training: Has ...
Staff Machine Learning Engineer - Leasing
$15.25 - $18/hr
... ML systems at scale. * Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. * Inference & Training: Has ...
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Quick apply
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Gen AI Lead
Dallas, TX · On-site
$138K - $170K/yr
Design, develop, and deploy AI/ML and Generative AI models for enterprise and telecom use cases. * Build and optimize data pipelines for training, validation, and inference processes. * Develop web ...
Quick apply
Gen AI Lead
Dallas, TX · On-site
$138K - $170K/yr
Design, develop, and deploy AI/ML and Generative AI models for enterprise and telecom use cases. * Build and optimize data pipelines for training, validation, and inference processes. * Develop web ...
Staff Machine Learning Engineer - Leasing
Richardson, TX · On-site
$15.25 - $18/hr
... ML systems at scale. * Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. * Inference & Training: Has ...
Quick apply
Staff Machine Learning Engineer - Leasing
Richardson, TX · On-site
$15.25 - $18/hr
... ML systems at scale. * Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. * Inference & Training: Has ...
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Quick apply
AI/ML Engineer
Dallas, TX · On-site
$113K - $136K/yr
About the Role:- We are seeking a talented and innovative AI/ML Engineer to design, develop, and ... Build and maintain scalable data pipelines for model training and inference. Develop AI-powered ...
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Quick apply
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Senior / Staff ML Training Optimization Engineer
Dallas, TX · On-site +1
$141K - $249K/yr
Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal ...
Ml Inference information
See Forney, TX salary details
$33.8K - $46.8K
2% of jobs
$46.8K - $59.8K
3% of jobs
$59.8K - $72.8K
6% of jobs
$72.8K - $85.9K
9% of jobs
$90.1K is the 25th percentile. Wages below this are outliers.
$85.9K - $98.9K
15% of jobs
The median wage is $107.6K / yr.
$98.9K - $111.9K
22% of jobs
$119.1K is the 75th percentile. Wages above this are outliers.
$111.9K - $124.9K
32% of jobs
$124.9K - $138K
3% of jobs
$138K - $151K
4% of jobs
$151K - $164K
1% of jobs
$164K - $177K
2% of jobs
$33.8K
$110.6K
$177K
How much do ml inference jobs pay per year?
What is a $900000 AI job?
What is ML inference?
What is the difference between Ml Inference vs Data Scientist?
| Aspect | ML Inference | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of machine learning models, programming skills | Degree in data science, statistics, or related fields |
| Work Environment | Deploying models in production, real-time data processing | Data analysis, model development, research |
| Industry Usage | AI product deployment, software companies | Research institutions, tech firms, consulting |
ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.
What engineer makes $500,000 a year?
Which 3 jobs will survive AI?
What are some common challenges faced by ML Inference Engineers when deploying models to production?
Will MLE be replaced by AI?
What are the key skills and qualifications needed to thrive in ML Inference, and why are they important?
Bank Of America rating
8.2
Based on 520 frontline employees who took The Breakroom Quiz
44th of 149 rated banks
Job description
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.
Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates' physical, emotional, and financial wellness through affordable, competitive and flexible benefits.
We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.
Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.
At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!
Job Description:
This job is responsible for providing leadership, technical direction and oversight to a team delivering technology solutions. Key responsibilities of the job are to provide oversight of the design, implementation, and maintenance of complex computer programs, align technical solutions to business objectives, and ensure that coding practices/quality comply with software development standards. Job expectations include conducting multiple software implementations and applying both depth and breadth in knowledge of several technical competencies.
Position Summary:
This is a Lead position in Bank of America's Erica, Chat, and Voice Technology organization. The Team builds next generation AI and Search platforms to enable virtual financial assistant / AI and search capabilities across multiple channels.
Responsibilities:
- Designs, develops and is accountable for feature delivery
- Applies enterprise standards for solution design, coding and quality
- Ensures solution meets product acceptance criteria with minimal technical debt
- Guides the team on work breakdown and execution
- Works with the Product Owner to ensure that product backlog/requirements are healthy, with clear acceptance criteria
- Plays a team lead role (as an individual contributor) and mentors the team
- Guides team members with skills and practices (planning and estimation, peer reviews, and other engineering practices)
- Guides the team on solution design, AI/ML model integration, work breakdown, and execution.
- Evaluates and applies emerging AI technologies, frameworks, and models to solve business problems.
- Leads the deployment and optimization of AI workloads across CPU/GPU infrastructures and cloud platforms.
- Ensures AI solutions meet enterprise standards for security, governance, observability, performance, and responsible AI practices.
- Guides the team in implementing prompt engineering, retrieval strategies, model evaluation, and inference optimization techniques.
- Drives technical innovation and adoption of AI/ML best practices across the organization.
Required Qualifications:
- 5+ years of hands-on software development experience using Java, Python, or related technologies.
- Strong software engineering skills with proficiency in Python and Java.
- Experience building AI/ML-powered applications using machine learning and Generative AI techniques.
- Knowledge of modern AI technologies including Transformers, Large Language Models (LLMs), Agentic AI, and Generative AI frameworks.
- Experience implementing Retrieval Augmented Generation (RAG) pipelines and related retrieval techniques.
- Experience deploying and optimizing AI applications on CPU/GPU infrastructure using technologies such as CUDA, vLLM, Triton, or equivalent inference platforms.
- Understanding of supervised, unsupervised, and reinforcement learning methodologies.
- Good understanding of source control systems such as Git and modern collaborative development practices.
- Good interpersonal communication skills for technical and business conversations
- Good analytical skills to break down requirements and solve complex problems
- Proven task management and leadership skills
- Experience building restful web services
Desired Qualifications:
- Experience in performance tuning with good understanding of JVM internals
- Experience with NoSQL databases like Cassandra
- Experience in distributed caching frameworks like hazelcast, ignite, redis
- Experience in modern JVM languages like groovy, scala
- Experience with Full-stack development, especially including Angular
- Experience with Generative AI
- Spring MVC
- Experience with Container technologies, such as Kubernetes and Docker
- Experience working with NLP and Machine learning
- Prior open source contributions
- Background in mathematics or statistics
- Proven task management and leadership skills
- Experience working in agile teams
- Experience building chatbot, conversational AI, or virtual assistant platforms.
- Experience with Azure, AWS, or cloud-native AI platforms.
- Experience with vector databases, embeddings, semantic search, and AI retrieval systems.
- Experience with Elasticsearch, SOLR, OpenSearch, or related search technologies.
- Experience with MLOps, model deployment, monitoring, and AI observability.
- Experience with inference optimization frameworks, GPU acceleration, and distributed model serving.
- Experience with prompt engineering, model evaluation, and AI safety/governance practices.
Skills:
- Automation
- Influence
- Result Orientation
- Stakeholder Management
- Technical Strategy Development
- Architecture
- Business Acumen
- Risk Management
- Solution Delivery Process
- Solution Design
- Agile Practices
- Analytical Thinking
- Collaboration
- Data Management
- DevOps Practices
Bachelors or Master's Degree in Computer Science or related field
Shift:
1st shift (United States of America)
Hours Per Week:
40
What Bank Of America employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Bank Of America
Sourced by ZipRecruiter
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work for our teammates around the world. We're devoted to being a diverse and inclusive workplace for everyone. We hire individuals with a broad range of backgrounds and experiences and invest heavily in our teammates and their families by offering competitive benefits to support their physical, emotional, and financial well-being.
Industry
Finance and insurance
Company size
10,000+ Employees
Headquarters location
Charlotte, NC, US
Year founded
1998