1

Flex Ai Infrastructure Engineer Jobs (NOW HIRING)

AI Infrastructure Engineer

Los Altos, CA · On-site

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

AI Infrastructure Engineer

New York, NY · On-site

$117K - $154K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

AI Infrastructure Engineer

New York, NY · On-site

$117K - $154K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

AI Infrastructure Engineer

New York, NY · On-site

$117K - $154K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

AI Infrastructure Engineer

Los Altos, CA · On-site

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

Hi, Job Title : AI Infrastructure Engineer Location : Austin, TX or Fort mill, SC Duration: Fulltime or Contract Candidates must demonstrate strong hands-on expertise in Python, live coding ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

next page

Showing results 1-20

Flex Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do flex ai infrastructure engineer jobs pay per year?

As of Aug 14, 2026, the average yearly pay for flex ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What is the difference between Flex Ai Infrastructure Engineer vs Data Center Technician?

AspectFlex Ai Infrastructure EngineerData Center Technician
Required CredentialsBachelor's in Computer Science or related field, certifications like Cisco CCNA or CompTIA Network+High school diploma or equivalent, technical certifications preferred
Work EnvironmentDesigning, deploying, and maintaining AI infrastructure in data centers or cloud environmentsMaintaining and troubleshooting physical data center hardware and network equipment
Industry UsageUsed in AI-focused companies, cloud providers, and tech firmsCommon in data centers, telecom, and enterprise IT facilities
Common Search/ComparisonOften compared for infrastructure roles supporting AI systemsCompared for hardware and network support roles in data centers

The Flex Ai Infrastructure Engineer focuses on designing and maintaining AI infrastructure, often involving cloud and data center environments, while the Data Center Technician handles physical hardware and network troubleshooting within data centers. Both roles require technical skills but differ in scope and responsibilities.

What cities are hiring for Flex Ai Infrastructure Engineer jobs?

Cities with the most Flex Ai Infrastructure Engineer job openings:

What are the most commonly searched types of Ai Infrastructure Engineer jobs?

The most popular types of Ai Infrastructure Engineer jobs are:

What states have the most Flex Ai Infrastructure Engineer jobs?

States with the most job openings for Flex Ai Infrastructure Engineer jobs include:

AI Infrastructure Engineer

Bright Vision Technologies

Andover, MA • On-site, Remote

$160K/yr

Full-time

Posted 3 days ago

New


Job description

AI Infrastructure Engineer – Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: AI Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$160,000 Annually
Experience Required: 10+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Ten or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider’s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.