2 Ampere Devops Engineer Jobs Hiring Near You

Job Summary:
Ampere is a semiconductor design company focused on high-performance, energy efficient AI compute. As an AI Accelerator Software Principal Engineer, you will lead the design and delivery of deep learning inference solutions, optimizing frameworks for efficient execution across various environments.
Responsibilities:
• Framework integration for accelerator backends Integrate and optimize deep learning frameworks—such as PyTorch, ONNX, and llama.cpp—for the Ampere deep learning accelerator backend, enabling efficient and correct execution across a wide set of model types.
• End-to-end deep learning performance acceleration Go deep into the full software/hardware execution stack, including:
• inference serving and orchestration
• framework integration layers
• compiler and graph/runtime support
• runtime libraries and user-mode execution paths
• compute kernel development
• profiling, benchmarking, and performance tuning
• Model enablement with quality and speed Improve both performance and accuracy for models using popular frameworks, and ensure compatibility with serving ecosystems such as vLLM and SGLang—helping deliver production-ready inference behavior.
• Hardware/software co-design and optimization Partner with hardware and platform teams to co-optimize AI execution for better outcomes:
• increased throughput
• reduced latency
• improved scalability
• better resource utilization (compute/memory/IO)
• higher sustained performance under realistic workloads
• Build state-of-the-art AI software components Contribute to the development of software and hardware AI co-processors/accelerators, delivering reusable libraries, optimized execution paths, and robust integration with existing tooling.
• Cross-functional collaboration Work closely with cross-functional teams (compiler/runtime, kernels, platform, and product engineering) to integrate AI capabilities into Ampere’s cloud-native processor platforms and accelerators.
Qualifications:
Required:
• BS Computer Science, Computer Engineering, Electrical Engineering, or Software Engineering or related technical field & 8 years of related experience; or MS degree & 6 years; or PhD & 3 years
• Strong experience building with or integrating AI frameworks such as PyTorch, llama.cpp, and ONNX.
• Expert in Python and C/C++
• Strong background in performance profiling and tuning (latency/throughput, memory behavior, kernel efficiency).
• Solid understanding of AI/ML concepts including neural networks and data processing frameworks.
Preferred:
• Experience with developing user-mode drivers, runtime libraries, or low-level integration for GPUs or deep learning accelerators in Linux is a plus.
• Experience with modern deep model architectures such as Transformers and Diffusion models is preferred.
• Fluent with modern AI programming tools such as Codex or Claude Code, and comfortable accelerating development workflows.
Company:
A semiconductor design company leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute. Founded in 2017, the company is headquartered in Santa Clara, USA, with a team of 1001-5000 employees. The company is currently Late Stage.