1

Ai Infrastructure Jobs in Silver Spring, MD (NOW HIRING)

In this role, you will support the AI infrastructure team by building and maintaining the platform that serves as the foundation for the customer's AI capabilities. You will focus on inference ...

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

Showing results 41-60

Ai Infrastructure information

See Silver Spring, MD salary details

$29

$61

$90

How much do ai infrastructure jobs pay per hour?

As of Aug 7, 2026, the average hourly pay for ai infrastructure in Silver Spring, MD is $61.18, according to ZipRecruiter salary data. Most workers in this role earn between $49.71 and $71.30 per hour, depending on experience, location, and employer.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, building, and maintaining the hardware, software, and network systems necessary to support artificial intelligence applications. These roles often require knowledge of cloud computing, data centers, machine learning frameworks, and system optimization to ensure reliable and efficient AI model deployment and operation.

What are the key skills and qualifications needed to thrive in AI infrastructure?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is AI infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.
What job categories do people searching Ai Infrastructure jobs in Silver Spring, MD look for? The top searched job categories for Ai Infrastructure jobs in Silver Spring, MD are:
What cities near Silver Spring, MD are hiring for Ai Infrastructure jobs? Cities near Silver Spring, MD with the most Ai Infrastructure job openings:
Infographic showing various Ai Infrastructure job openings in Silver Spring, MD as of August 2026, with employment types broken down into 14% Internship, 72% Full Time, and 14% Part Time. Highlights an 79% In-person, 7% Hybrid, and 14% Remote job distribution, with an average salary of $127,261 per year, or $61.2 per hour.

Intelligent Infrastructure Engineer

Bright Vision Technologies

Sterling, VA • Remote

$100K - $150K/yr

Full-time

Posted 6 days ago


Job description

Intelligent Infrastructure Engineer – Remote
 
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. 
 
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. 
Job Title: Intelligent Infrastructure Engineer
Location: 100% Remote (United States)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$150,000 Annually
Experience: 6+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. 
Job Summary
We are seeking an Intelligent Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
 
Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Six or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider’s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to boon@bvteck.com or contact us at (908) 650-6699. Learn more about Bright Vision Technologies at www.bvteck.com. 
 
Bright Vision Technologies is an Equal Opportunity Employer. 
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.