1

Infra Engineer Jobs in Tennessee (NOW HIRING)

Work you'll do As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team, you will be responsible for: * Leading architecture for pursuits and active opportunities, including discovery ...

Software Engineer: III (Senior) - NA

Nashville, TN · Remote

$118K - $156K/yr

Educate Infra, App, and DevOps teams on Datadog's capabilities and best practices. Ability to collaboratively train and document supporting long-term dashboard ownership. Required Skills & Experience:

About Us Infra Pipe Solutions is a leader in engineered polyethylene piping systems, committed to quality, innovation, and customer satisfaction. Our teams work collaboratively to deliver reliable ...

Extruder Operator

Greeneville, TN · On-site

$16 - $17/hr

About Us Infra Pipe Solutions is a leader in engineered polyethylene piping systems, committed to quality, innovation, and customer satisfaction. Our teams work collaboratively to deliver reliable ...

Data Engineer III

Knoxville, TN · On-site

$109K - $131K/yr

The Data Engineer III will lead the design and development of scalable data solutions, ensuring ... API, data, infra). • Operate effectively with high ambiguity and business context. • Deep ...

Data Engineer III

Knoxville, TN · On-site

$109K - $131K/yr

A Data Engineer III leads the design and development of complex, scalable data solutions that ... Designs components that integrate across domains (e.g., API, data, infra). * Operate effectively ...

... SRE framework. They will lead the post-mortem reviews and the timely production of RCAs. They ... You will ensure that everything is IAC, and that your team's infra can be rebuilt from the ground ...

... SRE framework. They will lead the post-mortem reviews and the timely production of RCAs. They ... You will ensure that everything is IAC, and that your team's infra can be rebuilt from the ground ...

next page

Showing results 1-20

Infra Engineer information

See Tennessee salary details

$42.2K

$115.3K

$165.2K

How much do infra engineer jobs pay per year?

As of Jun 14, 2026, the average yearly pay for infra engineer in Tennessee is $115,327.00, according to ZipRecruiter salary data. Most workers in this role earn between $97,600.00 and $128,000.00 per year, depending on experience, location, and employer.

What engineers make $500,000?

Senior engineers in specialized fields such as software engineering, data engineering, or infrastructure engineering can earn $500,000 or more annually, especially with experience, advanced skills, and in high-demand industries like technology or finance. Compensation often includes base salary, bonuses, and stock options, particularly at senior or executive levels.

What do you do as an infra engineer?

An infrastructure engineer designs, implements, and maintains the hardware, software, and network systems that support an organization's IT environment. They work with servers, cloud platforms, networking equipment, and automation tools to ensure system reliability, security, and performance. Strong knowledge of operating systems, scripting, and certifications like Cisco or AWS can be beneficial in this role.

What is the difference between Infra Engineer vs Network Engineer?

AspectInfra EngineerNetwork Engineer
CertificationsCCNA, CompTIA Network+CCNA, CCNP, CompTIA Network+
Work EnvironmentData centers, cloud infrastructure, serversNetwork hardware, routers, switches, LAN/WAN
Industry UsageIT infrastructure, cloud providers, enterpriseTelecommunications, enterprise networks, ISPs

Infra Engineers focus on overall IT infrastructure, including servers and cloud systems, while Network Engineers specialize in designing and maintaining network hardware and connectivity. Both roles require similar certifications and often work in overlapping environments, but their core responsibilities differ in scope and focus.

What engineers make $300,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, and infrastructure engineering can earn $300,000 or more annually, especially with extensive experience, advanced skills, and in high-demand industries. Roles involving leadership, complex systems, or working in competitive markets often command higher salaries, particularly with additional certifications or expertise in cloud platforms and large-scale infrastructure.

What jobs pay $500,000 a year in the US?

In the US, high-paying roles such as senior infrastructure engineers, cloud architects, and IT directors can reach or exceed $500,000 annually, especially with bonuses and stock options. These positions typically require advanced skills, certifications, and extensive experience in areas like cloud computing, cybersecurity, or large-scale network management.
HPC AI Solution Architect (S2S)

HPC AI Solution Architect (S2S)

Deloitte

Nashville, TN • On-site

Other

Posted 24 days ago


Deloitte rating

8.1

Company rating: 8.1 out of 10

Based on 86 frontline employees who took The Breakroom Quiz

58th of 138 rated financial services


Job description

Lead Cloud HPC- AI Infrastructure Architect(S2S)

As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team in Deloitte's AI & Engineering practice, you will design and drive deployment of fully integrated architectures for GPU-accelerated AI factories and high-performance computing infrastructure in close partnership with Deloitte AI specialists and our ecosystem partners. You will shape end-to-end solutions-from discovery and reference architecture mapping through sizing and implementation.  You will partner with Sales Executives, AI application specialists, delivery engineering, and managed services to help clients achieve measurable outcomes from private AI assets. You will lead technical solution strategy for pursuits and active opportunities and translate complex client needs into clear, complete solutions and delivery requirements.

Recruiting for this role ends on 6/26/2026.


Work you'll do
As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team, you will be responsible for:

  • Leading architecture for pursuits and active opportunities, including discovery, requirements, constraints, and target-state design
  • Creatively defining reference architectures for on-premises, cloud, and hybrid GPU platforms across compute, network, storage, security, software and operations
  • Driving architecture trade-offs and decisions across performance, scalability, reliability, locality, total cost of ownership, time-to-value, and risk
  • Owning the technical solution strategy in proposals and RFPs, including architecture narrative, assumptions, dependencies, sizing guidance, and delivery approach
  • Facilitating client workshops and technical reviews and translating engineering detail into executive-ready communications
  • Architecting complex, innovative technology solutions with a focus on business outcomes, cost of quality, and long-term scalability and sustainability.
  • Engaging with C-Suite client leadership during sales and delivery, including leading technical pre-sales discussions, shaping proposals, and supporting the closing of new business opportunities
  •  Supporting go-to-market strategies, including participation in industry events, conferences, and client briefings

The Team

The Silicon to Service team at Deloitte delivers end-to-end AI factories and advanced technology services that help organizations build, deploy, and operate large-scale, private AI and data platforms. We enable the next phase of enterprise AI adoption through private AI economics with cloud-like ese of use.  Join this unique opportunity to work on innovative AI platforms and emerging technologies in the rapidly evolving AI market while solving complex enterprise problems for some of the world's largest organizations.


Qualifications

Required:

  • 10+ years of experience in infrastructure architecture or engineering for large-scale platforms including design, implementation, operations, and optimization.
  • 4+ years designing or delivering GPU-accelerated platforms for AI, ML, or high-performance computing
  • 3+ years Linux system administration in production environments
  • 3+ years designing or operating distributed compute clusters for AI/HPC in hybrid cloud setups, including multi-GPU topologies, partitioning, scheduler integration, and scalability for edge-to-cloud workloads.
  • 2+ years with high-performance networking or storage for AI/HPC
  • 2+ years building containerized platforms using Kubernetes or Red Hat OpenShift, including GPU operators/drivers, CUDA container runtime, and cluster lifecycle automation
  • 2+ years automating infrastructure as code(IaC) with tools like Terraform and Ansible
  • At least 2 end-to-end deployments of reference architectures in the cloud or on-prem, including variants with security controls, network segmentation, operational runbooks, and validation testing
  • Experience in pre-sales or sales engineering, including discovery, solution demonstrations, and proposal/RFP contributions
  • Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Limited immigration sponsorship may be available.

Preferred:

  • 2+ years implementing AI/HPC cluster scheduling  (Slurm and Kubernetes), including multi-tenant queues, quotas, and GPU-aware policies
  • 2+ years supporting generative AI infrastructure patterns, including multi-node distributed training
  • Experience with AI agents and frameworks
  • Experience with high-throughput storage for AI/HPC
  • Experience executing NVIDIA co-sell motions with OEMS (Dell, HPC, Lenovo), CSPs ( AWS, Azure, Google Cloud), or independent software vendors ( Run:ai, OpenShift, Weights & Biases)

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $141,200 to $278,300.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Qualifications:

Lead Cloud HPC- AI Infrastructure Architect(S2S)

As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team in Deloitte's AI & Engineering practice, you will design and drive deployment of fully integrated architectures for GPU-accelerated AI factories and high-performance computing infrastructure in close partnership with Deloitte AI specialists and our ecosystem partners. You will shape end-to-end solutions-from discovery and reference architecture mapping through sizing and implementation.  You will partner with Sales Executives, AI application specialists, delivery engineering, and managed services to help clients achieve measurable outcomes from private AI assets. You will lead technical solution strategy for pursuits and active opportunities and translate complex client needs into clear, complete solutions and delivery requirements.

Recruiting for this role ends on 6/26/2026.


Work you'll do
As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team, you will be responsible for:

  • Leading architecture for pursuits and active opportunities, including discovery, requirements, constraints, and target-state design
  • Creatively defining reference architectures for on-premises, cloud, and hybrid GPU platforms across compute, network, storage, security, software and operations
  • Driving architecture trade-offs and decisions across performance, scalability, reliability, locality, total cost of ownership, time-to-value, and risk
  • Owning the technical solution strategy in proposals and RFPs, including architecture narrative, assumptions, dependencies, sizing guidance, and delivery approach
  • Facilitating client workshops and technical reviews and translating engineering detail into executive-ready communications
  • Architecting complex, innovative technology solutions with a focus on business outcomes, cost of quality, and long-term scalability and sustainability.
  • Engaging with C-Suite client leadership during sales and delivery, including leading technical pre-sales discussions, shaping proposals, and supporting the closing of new business opportunities
  •  Supporting go-to-market strategies, including participation in industry events, conferences, and client briefings

The Team

The Silicon to Service team at Deloitte delivers end-to-end AI factories and advanced technology services that help organizations build, deploy, and operate large-scale, private AI and data platforms. We enable the next phase of enterprise AI adoption through private AI economics with cloud-like ese of use.  Join this unique opportunity to work on innovative AI platforms and emerging technologies in the rapidly evolving AI market while solving complex enterprise problems for some of the world's largest organizations.


Qualifications

Required:

  • 10+ years of experience in infrastructure architecture or engineering for large-scale platforms including design, implementation, operations, and optimization.
  • 4+ years designing or delivering GPU-accelerated platforms for AI, ML, or high-performance computing
  • 3+ years Linux system administration in production environments
  • 3+ years designing or operating distributed compute clusters for AI/HPC in hybrid cloud setups, including multi-GPU topologies, partitioning, scheduler integration, and scalability for edge-to-cloud workloads.
  • 2+ years with high-performance networking or storage for AI/HPC
  • 2+ years building containerized platforms using Kubernetes or Red Hat OpenShift, including GPU operators/drivers, CUDA container runtime, and cluster lifecycle automation
  • 2+ years automating infrastructure as code(IaC) with tools like Terraform and Ansible
  • At least 2 end-to-end deployments of reference architectures in the cloud or on-prem, including variants with security controls, network segmentation, operational runbooks, and validation testing
  • Experience in pre-sales or sales engineering, including discovery, solution demonstrations, and proposal/RFP contributions
  • Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Limited immigration sponsorship may be available.

Preferred:

  • 2+ years implementing AI/HPC cluster scheduling  (Slurm and Kubernetes), including multi-tenant queues, quotas, and GPU-aware policies
  • 2+ years supporting generative AI infrastructure patterns, including multi-node distributed training
  • Experience with AI agents and frameworks
  • Experience with high-throughput storage for AI/HPC
  • Experience executing NVIDIA co-sell motions with OEMS (Dell, HPC, Lenovo), CSPs ( AWS, Azure, Google Cloud), or independent software vendors ( Run:ai, OpenShift, Weights & Biases)

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $141,200 to $278,300.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Education:Bachelor's DegreeEmployment Type:

What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom