1

Executive Ai Infrastructure Engineer Jobs (NOW HIRING)

AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

Hi, Job Title : AI Infrastructure Engineer Location : Austin, TX or Fort mill, SC Duration: Fulltime or Contract Candidates must demonstrate strong hands-on expertise in Python, live coding ...

AI Infrastructure Engineer

Sunnyvale, CA

$126K - $165K/yr

Founder and CEO Yuanming (Ethan) Hu earned his Ph.D. in graphics and AI from MIT, where he ... along with core engineering infrastructure. The team operates a conventional production ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV, you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our compute ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

AI Infrastructure Engineer IV

Mendon, UT · On-site

$93K - $122K/yr

As an AI Infrastructure Engineer IV, you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our compute ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

next page

Showing results 1-20

Executive Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do executive ai infrastructure engineer jobs pay per year?

As of Aug 10, 2026, the average yearly pay for executive ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What is the difference between Executive Ai Infrastructure Engineer vs Data Engineer?

AspectExecutive Ai Infrastructure EngineerData Engineer
Required CredentialsBachelor's/Master's in Computer Science, AI, or related fields; certifications in cloud platforms and AI toolsBachelor's in Computer Science, Data Science, or related; certifications in data management and cloud platforms
Work EnvironmentDesigning and overseeing AI infrastructure, collaborating with AI teams, managing cloud resourcesBuilding data pipelines, managing databases, ensuring data quality and accessibility
Employer & Industry UsageTech companies, AI startups, enterprises deploying AI solutionsData-driven companies, analytics firms, tech organizations handling large datasets

The Executive Ai Infrastructure Engineer focuses on designing and managing AI-specific infrastructure, ensuring optimal performance for AI applications. In contrast, a Data Engineer primarily builds and maintains data pipelines and databases to support analytics and machine learning. Both roles require technical expertise and often collaborate, but their core responsibilities differ in scope and focus.

What cities are hiring for Executive Ai Infrastructure Engineer jobs? Cities with the most Executive Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Executive Ai Infrastructure Engineer jobs? States with the most job openings for Executive Ai Infrastructure Engineer jobs include:

AI Infrastructure Engineer

Bright Vision Technologies

Lexington, MA • On-site, Remote

$100K - $160K/yr

Full-time

Posted 6 days ago


Job description

AI Infrastructure Engineer – Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: AI Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$160,000 Annually
Experience Required: 10+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Ten or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider’s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.