ZipRecruiter

Log In

1

Manager Tensor Jobs (NOW HIRING)

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

Integrate advanced optimization techniques such as KV-cache management, tensor/model parallelism, quantization, and memory-efficient execution into production inference systems. * Partner with system ...

NIO

AI Infrastructure Engineer

San Jose, CA

$126K - $165K/yr

Integrate advanced optimization techniques such as KV-cache management, tensor/model parallelism, quantization, and memory-efficient execution into production inference systems. * Partner with system ...

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

Integrate advanced optimization techniques such as KV-cache management, tensor/model parallelism, quantization, and memory-efficient execution into production inference systems. * Partner with system ...

iFlow Inc

Program Manager

Austin, TX · On-site

Job Title: Program Manager Location : Austin,TX Duration: 6 Months Experience: 5-15 Years ... Integrate SGLang with the Run:ai Model Streamer to enable concurrent tensor streaming directly to ...

Rivian

Principal NPU Microarchitect

Palo Alto, CA · On-site

$218 - $312/hr

Lead the definition of mechanisms for efficient movement of tensor activations, weights, and ... bandwidth management, and latency hiding techniques. * Experience working across the ...

Rivian

Principal NPU Microarchitect

Palo Alto, CA · On-site

Lead the definition of mechanisms for efficient movement of tensor activations, weights, and ... managed scheduling, numerical formats, quantization, and microarchitectural performance ...

Rivian

Principal NPU Microarchitect

Palo Alto, CA

Lead the definition of mechanisms for efficient movement of tensor activations, weights, and ... managed scheduling, numerical formats, quantization, and microarchitectural performance ...

next page

Showing results 1-20

All JobsTensor JobsManager Tensor Jobs

Manager Tensor information

See salary details

$33.5K

$106.6K

$181K

How much do manager tensor jobs pay per year?

As of Jul 31, 2026, the average yearly pay for manager tensor in the United States is $106,639.00, according to ZipRecruiter salary data. Most workers in this role earn between $75,000.00 and $132,500.00 per year, depending on experience, location, and employer.

What is the difference between Manager Tensor vs Data Scientist?

AspectManager TensorData Scientist
Required CredentialsBachelor's or Master's in Computer Science, Data Analytics, or related fields; certifications like TensorFlow Developer are commonBachelor's or Master's in Data Science, Statistics, Computer Science; certifications like Certified Data Scientist are common
Work EnvironmentLeads teams, manages projects, collaborates with stakeholders in tech or AI-focused companiesAnalyzes data, builds models, reports insights in tech, finance, healthcare industries
Employer & Industry UsageUsed in AI, machine learning, and tech companies for managing TensorFlow projectsUsed across industries for data analysis, predictive modeling, and research

The main difference is that a Manager Tensor oversees AI projects involving TensorFlow, focusing on team management and project delivery, while a Data Scientist primarily analyzes data and builds models. Both roles require technical knowledge, but the Manager Tensor role emphasizes leadership and project management within AI initiatives.

What are the key skills and qualifications needed to thrive as a Manager Tensor, and why are they important?

To thrive as a Manager Tensor (commonly referred to as a TensorFlow Manager or Machine Learning Manager), you need a solid background in machine learning, deep learning frameworks (especially TensorFlow), and experience leading technical teams, typically backed by a relevant degree. Proficiency with TensorFlow, Python, data engineering tools, and cloud platforms, along with certifications in machine learning, are highly valued. Leadership, strong communication, and project management skills help you effectively guide teams and collaborate with stakeholders. These skills ensure successful project delivery, innovation, and alignment with organizational goals in complex AI-driven environments.

What are some common challenges faced by a Manager Tensor when leading AI and machine learning teams?

A Manager Tensor often encounters challenges such as balancing technical leadership with strategic oversight, managing projects that involve complex and evolving technologies, and ensuring effective communication among data scientists, engineers, and stakeholders. Additionally, staying current with rapid advancements in AI frameworks and guiding the team through best practices can be demanding. Collaboration across multidisciplinary teams and aligning projects with business objectives are also key aspects of the role.

What is a Manager Tensor?

A Manager Tensor is typically a managerial position responsible for overseeing teams that develop and implement machine learning models using TensorFlow or similar tensor-based frameworks. This role involves coordinating data science and engineering teams, ensuring project goals align with business objectives, and facilitating the deployment of scalable AI solutions. Additionally, a Manager Tensor may be tasked with mentoring staff, managing resources, and staying updated with the latest advancements in artificial intelligence. The position requires strong leadership, technical expertise in machine learning, and experience with deep learning platforms.
What cities are hiring for Manager Tensor jobs? Cities with the most Manager Tensor job openings:
What are the most commonly searched types of Tensor jobs? The most popular types of Tensor jobs are:
What states have the most Manager Tensor jobs? States with the most job openings for Manager Tensor jobs include:
Manager Tensor jobs near you

AI Infrastructure Engineer

NIO

San Jose, CA • On-site

$126K - $165K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 7 days ago

Job description

JOB DESCRIPTION
About NIO
NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO's mission is to shape a joyful lifestyle. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.
NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.
NIO's product portfolio consists of the ES8, a six-seater smart electric flagship SUV, the ES7 (or the EL7), a mid-large five-seater smart electric SUV, the ES6, a five-seater all-round smart electric SUV, the EC7, a five-seater smart electric flagship coupe SUV, the EC6, a five-seater smart electric coupe SUV, the ET7, a smart electric flagship sedan, and the ET5, a mid-size smart electric sedan.
About the Position
We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference systems. This position is focused on designing, implementing, and delivering production-grade software that powers real-world applications of Large Language Models (LLMs) and Vision-Language Models (VLMs).
This is an exciting opportunity for an engineer who thrives at the intersection of AI systems, hardware acceleration, and large-scale robust deployment, and who wants to see their contributions ship in production, at scale.
In this role, you will directly shape the architecture, roadmap and performance of AI capabilities of our AIOS platform, driving innovations that make LLM/VLM systems fast, efficient, and scalable across cloud, edge, and hybrid edge-cloud environments. You will work closely with system, hardware, and product teams to deliver high-performance inference kernels for hardware accelerators, design scalable inference serving systems, and integrate optimizations such tensor parallelism and custom kernels into production pipelines. Your work will have immediate impact, powering intelligent automotive systems in the next generation of electric vehicles.
Roles and Responsibilities:
  • Design and implement high-performance, scalable inference systems for LLMs and VLMs across cloud, edge, and edge-cloud hybrid platforms.
  • Develop and optimize custom kernels and operators for specific hardware accelerators (GPU, NPU, DSP, etc.), improving throughput, latency, and memory efficiency.
  • Integrate advanced optimization techniques such as KV-cache management, tensor/model parallelism, quantization, and memory-efficient execution into production inference systems.
  • Partner with system and hardware teams to ensure tight hardware-software integration and optimal performance across diverse compute environments.
  • Translate architectural requirements into robust, maintainable, production-ready software that meets performance, safety, and reliability standards.
  • Define and drive the evolution roadmap for LLM/VLM inference in the AIOS stack, ensuring scalability and adaptability to new workloads.
  • Stay ahead of industry trends and competitor solutions, applying best practices from both AI and large-scale systems engineering.

Must Qualifications:
  • 5+ years of hands-on software development experience in building and optimizing AI inference systems at scale.
  • Direct experience in LLM/VLM model internals, including Transformer-based architectures, inference bottlenecks, and optimization techniques.
  • Strong expertise in performance engineering: kernel development, parallelism strategies, memory optimization, and distributed inference systems.
  • Proficiency with GPU/NPU programming (CUDA, or vendor-specific SDKs), compiler toolchains, and deep learning frameworks (PyTorch, or TensorFlow).
  • Strong programming skills in C/C++, with a track record of delivering high-performance, production-grade software.
  • Solid foundation in computer architecture, systems programming (CPU/GPU pipelines, memory hierarchy, scheduling), and embedded systems.
  • BS/MS in Computer Science, Computer Engineering, or related technical field.
  • Excellent communication and collaboration skills, with the ability to work across cross-functional teams.

Preferred Qualifications:
  • Master's or PhD degree in Computer Science, Electrical/Computer Engineering, or related fields, plus 5 years industry experience
  • Experience building inference serving systems for large models, including batching, scheduling, caching, and load balancing.
  • Expertise in hardware-aware model optimization (e.g., kernel fusion, mixed precision, quantization, pruning).
  • Familiarity with edge and embedded AI, including real-time constraints and limited-resource optimization.
  • Contributions to widely used AI frameworks, libraries, or performance-critical software (open source or proprietary).

Compensation:
The US base salary range for this full-time position is $192,100.00 - $249,600.00.
  • Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
  • Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.

Benefits:
Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:
  • Anthem Blue Cross, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
  • Dental (including orthodontic coverage) and vision plan. Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
  • Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible Anthem Blue Cross medical plan
  • Healthcare and Dependent Care Flexible Spending Accounts (FSA)
  • 401(k) with Brokerage Link option
  • Company paid Basic Life, AD&D, short-term and long-term disability insurance
  • Employee Assistance Program
  • Sick and Vacation time
  • 13 Paid Holidays a year
  • Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
  • Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
  • Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
  • Commuter benefits
  • Mobile Cell Phone Credit
  • Free lunch and snacks
  • Onsite gym
  • Employee discounts and perks program

Apply