1

Ai Infrastructure Jobs in Tennessee (NOW HIRING)

AI Implementation Architect

Germantown, TN · On-site

$74K - $99K/yr

The role involves building AI infrastructure systems, integrating solutions with existing business systems, and collaborating with stakeholders to deploy AI models. Responsibilities : • Design and ...

next page

Showing results 1-20

Ai Infrastructure information

See Tennessee salary details

$25

$53

$79

How much do ai infrastructure jobs pay per hour?

As of Sep 1, 2026, the average hourly pay for ai infrastructure in Tennessee is $53.72, according to ZipRecruiter salary data. Most workers in this role earn between $43.65 and $62.60 per hour, depending on experience, location, and employer.

What is AI infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.

What are the key skills and qualifications needed to thrive in AI infrastructure?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, building, and maintaining the hardware, software, and network systems necessary to support artificial intelligence applications. These roles often require knowledge of cloud computing, data centers, machine learning frameworks, and system optimization to ensure reliable and efficient AI model deployment and operation.

What are popular job titles related to Ai Infrastructure jobs in Tennessee?

For Ai Infrastructure jobs in Tennessee, the most frequently searched job titles are:

What cities in Tennessee are hiring for Ai Infrastructure jobs?

Cities in Tennessee with the most Ai Infrastructure job openings:

Infographic showing various Ai Infrastructure job openings in Tennessee as of August 2026, with employment types broken down into 76% Full Time, 19% Part Time, 4% Contract, and 1% Nights. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution, with an average salary of $111,731 per year, or $53.7 per hour.

AI Systems Engineer (OCI/AI Infrastructure)

Nashville, TN • On-site


Oracle
IT Services • 10K+ employees

8.7

Company rating: 8.7 out of 10

Based on 152 frontline employees who took The Breakroom Quiz

56th of 247 rated software companies

People enjoy working here

Good employer

Recommended by students


$103K - $136K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 6 days ago


Job description


Oracle Hardware Platform Development Engineering is seeking a highly driven AI Systems Engineer to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure (OCI). This is a hands-on engineering role focused on bringing up new hardware platforms, enabling AI training and inference software stacks, running representative workloads, and analyzing system performance under real operating conditions.
The engineer will identify whether workloads are HBM/memory-bandwidth, compute, scale-up, or scale-out bound, while characterizing power, thermals, memory behavior, utilization, scaling, and performance efficiency. Working directly in the lab, you will debug hardware/software integration issues, design and execute experiments, and develop data-driven insights that explain system behavior beyond benchmark results.
A key part of the role is comparative architecture analysis across GPUs and emerging AI accelerators. You will evaluate architectural tradeoffs and translate performance findings into clear, actionable recommendations on which platforms are best suited for specific AI training and inference workloads. You will work closely with internal hardware and software teams as well as technology partners to help shape Oracle's next generation of high-performance AI infrastructure.
Position Overview:
This position is ideal for someone who loves deep systems engineering, debugging complex hardware-software interactions, and optimizing performance at every layer of the ML stack. You will play a pivotal role in enabling the training and deployment of next-generation LLMs and generative AI models.
Responsibilities
Required Qualifications
  • Solid knowledge of AI / GPU or/and AI/CPU platform architecture and their capabilities.
  • Experience with the architecture, design, and implementation of modern server platforms consisting of multiple architectures and vendors, including x86 and ARM server architectures.
  • Strong communications skills and ability to clearly communicate complex technical issue across engineering disciplines as well as clearly and succinctly articulate issues for executives.
  • Experience and understanding of the latest high-speed busses and interconnect used in modern Compute and AI platforms. Familiarity with their startup connectivity and operational robustness as well as performance metrics.
  • Debugging & Reliability: Troubleshoot complex hardware-software interaction issues, including vLLM compilation failures on ROCm, CUDA memory leaks, distributed runtime failures, and kernel-level inconsistencies.
  • Profiling & Performance Analysis: Conduct detailed profiling of compilation graphs, training workloads, and runtime execution to optimize performance and eliminate bottlenecks.

Preferred Qualifications
  • Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems.
  • Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
  • Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level.
  • Hands-on experience maintaining or building ML training stacks involving CUDA, ROCm, NCCL, XLA, or similar technologies.
  • Experience in benchmarking AI workloads across different architectures.
  • Background in working with the large scale clusters
  • Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray

Qualifications
Disclaimer:
Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $96,800 to $306,400 per annum. May be eligible for bonus, equity, and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
Career Level - IC5
About Us
Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.
True innovation starts when everyone is empowered to contribute. That's why we're committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.
We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States.
Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Oracle logo

About Oracle

Sourced by ZipRecruiter

An Oracle career can span industries, roles, Countries and cultures, giving you the opportunity to flourish in new roles and innovate, while blending work life in. Oracle has thrived through 40+ years of change by innovating and operating with integrity while delivering for the top companies in almost every industry. In order to nurture the talent that makes this happen, we are committed to an inclusive culture that celebrates and values diverse insights and perspectives, a workforce that inspires thought leadership and innovation. Oracle offers a highly competitive suite of Employee Benefits designed on the principles of parity, consistency, and affordability. The overall package includes certain core elements such as Medical, Life Insurance, access to Retirement Planning, and much more. We also encourage our employees to engage in the culture of giving back to the communities where we live and do business. At Oracle, we believe that innovation starts with diversity and inclusion and to create the future we need talent from various backgrounds, perspectives, and abilities. We ensure that individuals with disabilities are provided reasonable accommodation to successfully participate in the job application, interview process, and in potential roles. to perform crucial job functions. That's why we're committed to creating a workforce where all individuals can do their best work. It's when everyone's voice is heard and valued that we're inspired to go beyond what's been done before.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Redwood City, CA, US

Year founded

1977

Social media


What Oracle employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom