ZipRecruiter

Log In

1

Senior Data Center Infrastructure Engineer Jobs (NOW HIRING)

Oracle

Senior Data Center MEP PM

Abilene, TX · On-site

$50 - $67.75/hr

Oracle Cloud Infrastructure (OCI) - Data Center Infrastructure Delivery Location: Abilene ... Work closely with construction teams, developer representatives, QA/QC oversight teams, general ...

next page

Showing results 1-20

All JobsSenior Data Center Infrastructure Engineer Jobs

Senior Data Center Infrastructure Engineer information

See salary details

$22.5K

$127K

$175.5K

How much do senior data center infrastructure engineer jobs pay per year?

As of Jun 26, 2026, the average yearly pay for senior data center infrastructure engineer in the United States is $126,969.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,500.00 and $147,500.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Senior Data Center Infrastructure Engineer, and why are they important?

To thrive as a Senior Data Center Infrastructure Engineer, you need deep knowledge of server, storage, and network architecture, along with a relevant degree and substantial experience in data center operations. Expertise with virtualization platforms (such as VMware), monitoring systems, and certifications like Cisco CCNP or CompTIA Server+ are typically required. Strong problem-solving abilities, project management skills, and effective communication help you lead teams and coordinate across departments. These competencies ensure reliable, secure, and scalable data center environments that support critical business operations.

What are some of the most common challenges faced by Senior Data Center Infrastructure Engineers, and how can they be addressed?

Senior Data Center Infrastructure Engineers often encounter challenges such as ensuring continuous uptime, managing large-scale hardware deployments, and adapting to rapidly evolving technologies. Balancing the need for high availability with cost-efficiency requires strategic planning and proactive maintenance. Collaboration with network, security, and facilities teams is essential to address issues like power distribution, cooling, and disaster recovery. Staying updated on industry best practices and pursuing ongoing training can help engineers effectively manage these challenges.

What does a Senior Data Center Infrastructure Engineer do?

A Senior Data Center Infrastructure Engineer is responsible for designing, implementing, and maintaining the physical and virtual infrastructure of data centers. This includes overseeing server hardware, networking equipment, power and cooling systems, and ensuring optimal performance, security, and reliability. They often lead projects to upgrade or expand data center capabilities, troubleshoot complex issues, and ensure compliance with industry standards. Additionally, they may mentor junior engineers and collaborate with other IT teams to support business operations.
More about Senior Data Center Infrastructure Engineer jobs
What cities are hiring for Senior Data Center Infrastructure Engineer jobs? Cities with the most Senior Data Center Infrastructure Engineer job openings:
What are the most commonly searched types of Data Center Infrastructure Engineer jobs? The most popular types of Data Center Infrastructure Engineer jobs are:
What states have the most Senior Data Center Infrastructure Engineer jobs? States with the most job openings for Senior Data Center Infrastructure Engineer jobs include:
What job categories do people searching Senior Data Center Infrastructure Engineer jobs look for? The top searched job categories for Senior Data Center Infrastructure Engineer jobs are:
Senior Data Center Infrastructure Engineer jobs near you
Infographic showing various Senior Data Center Infrastructure Engineer job openings in the United States as of June 2026, with employment types broken down into 100% Full Time. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $126,969 per year, or $61 per hour.
Senior Data Center Systems Engineer -- AI Infrastructure & Performance Optimization

Senior Data Center Systems Engineer -- AI Infrastructure & Performance Optimization

Johnson Controls

New Freedom, PA • On-site

$99K - $135K/yr

Full-time

Posted 27 days ago

Johnson Controls rating

8.0

Company rating: 8.0 out of 10

Based on 388 frontline employees who took The Breakroom Quiz

132nd of 520 rated manufacturers

Job description

Senior Data Center Systems Engineer -- AI Infrastructure & Performance Optimization
Job Description
Position Summary
Johnson Controls' Data Center Thermal Solutions team is seeking a Senior Data Center Systems Engineer for the Advanced Technology & Innovation group. This role bridges AI/HPC computing systems with data center infrastructure, focusing on optimizing the interdependencies between computing workloads and cooling efficiency. The ideal candidate will be highly self-driven, able to work independently with limited supervision, and bring deep expertise in GPU-based AI workloads combined with comprehensive understanding of data center infrastructure systems.
Key Responsibilities
  • Deploy, configure, and manage AI/HPC compute clusters running diverse workloads including LLM training and inference, VLM applications, HPC simulations, and stress testing scenarios.
  • Deploy and commission liquid cooling hardware including direct-to-chip cold plates, CDUs, immersion systems, and hybrid cooling solutions for high-density AI infrastructure.
  • Design and execute workload management strategies to evaluate thermal and power characteristics across CPU and GPU-based AI nodes under varied operational conditions.
  • Develop system-level digital twin simulations integrating IT telemetry with mechanical and electrical infrastructure data to model cooling and computing efficiency interdependencies.
  • Extract and analyze telemetry data from IT nodes, GPUs, CPUs, and thermal systems including chillers, cooling towers, pumps, and CDUs to optimize performance and energy efficiency.
  • Collaborate with thermal engineers and controls teams to validate cooling system performance under real-world AI/HPC workloads and support NPI development initiatives.
  • Integrate and leverage DCIM and BAS platforms for holistic infrastructure monitoring, predictive analytics, and operational optimization.
  • Author technical reports and industry white papers documenting research findings, best practices, and performance benchmarks for AI data center infrastructure.
  • Represent Johnson Controls at industry conferences, technical forums, and customer engagements to share innovations and establish thought leadership in AI infrastructure optimization.
  • Interface with hyperscalers, OEMs, and technology partners to align infrastructure solutions with evolving AI hardware and workload requirements.
  • Contribute to technical publications, patent filings, and industry standards related to data center systems optimization.

Qualifications
  • PhD or Master's degree in Electrical Engineering, Mechanical Engineering, or Computer Science.
  • 5-7 years of professional experience in AI/HPC infrastructure, data center operations, or related technical roles.
  • Prior experience working in data center environments strongly preferred.
  • Proven hands-on experience deploying and managing LLM, VLM, training, inference, and HPC simulation workloads on GPU-based AI infrastructure.
  • Deep understanding of AI hardware architectures (NVIDIA H100/H200, AMD MI300, etc.) and their thermal/power characteristics across diverse workloads.
  • Strong knowledge of data center mechanical systems (cooling distribution, heat rejection), electrical systems (power distribution, UPS), and networking architectures (InfiniBand, Ethernet fabrics).
  • Proficiency with DCIM platforms, BAS integration, and digital twin modeling tools for infrastructure simulation and optimization.
  • Experience with stress testing tools, workload orchestration platforms (Kubernetes, Slurm, etc.), and telemetry collection frameworks.
  • Demonstrated ability to work independently, manage complex projects, and deliver results with minimal supervision.
  • Track record of innovation and cross-functional collaboration in data center or AI infrastructure environments.
  • Strong technical communication and presentation skills for conference participation and white paper authorship.

Johnson Controls International plc. is an equal employment opportunity and affirmative action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, protected veteran status, genetic information, sexual orientation, gender identity, status as a qualified individual with a disability or any other characteristic protected by law. To view more information about your equal opportunity and non-discrimination rights as a candidate, visit EEO is the Law. If you are an individual with a disability and you require an accommodation during the application process, please visit here.

What Johnson Controls employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Johnson Controls logo

About Johnson Controls

Sourced by ZipRecruiter

Johnson Controls is a world leader in smart buildings, creating safe, healthy and sustainable spaces. For nearly 140 years, we’ve made buildings better and now we’re transforming them again with our award-winning digital technologies and services. We’re using artificial intelligence and data driven solutions to give you deeper insight into your building’s health, sustainability and performance. It’s changing the way we design, operate and maintain indoor environments and driving to a new era of autonomous buildings. We deliver the blueprint of the future for industries such as healthcare, schools, data centers, airports, stadiums, hotels, manufacturing and beyond through OpenBlue, our comprehensive suite of connected solutions. Johnson Controls offers the world’s largest portfolio of building technology, software and services. Supported by a team of more than 100,000 dedicated employees working across 150 countries, we’re helping customers achieve their sustainability goals and power their mission.

Industry

Machinery manufacturing, water transportation, public safety statistics centers and offices and manufacturing

Company size

10,000+ Employees

Headquarters location

Milwaukee, WI, US

View All Johnson Controls Jobs

Apply