ZipRecruiter

Log In

1

Ai Infrastructure Jobs in Silver Spring, MD (NOW HIRING)

BigBear.ai

Full Stack Software Engineer

Columbia, MD · On-site

In this role, you will support the AI infrastructure team by building and maintaining the platform that serves as the foundation for the customer's AI capabilities. You will focus on inference ...

Bigbear.ai

Full Stack Software Engineer

Columbia, MD · On-site

$114K/yr

In this role, you will support the AI infrastructure team by building and maintaining the platform that serves as the foundation for the customer's AI capabilities. You will focus on inference ...

NCyber

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

NCyber

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

NCyber

Platform Infrastructure Engineer

Columbia, MD · On-site

$116K - $154K/yr

AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting * Highly subsidized Health, Dental, and Vision insurance * Legal Resources Plan * Flexible Time Off ...

Rumble

Senior Infrastructure Engineer - CDN

Washington, DC · On-site

$132K - $158K/yr

RUM Group Inc. is an AI infrastructure and video company. Its Quake AI business delivers AI compute as a service, operating AI data centers including GPU and CPU compute, storage, and networking at ...

previous page

Showing results 41-60

All JobsAi Infrastructure JobsAi Infrastructure Jobs in Silver Spring, MD

Ai Infrastructure information

See Silver Spring, MD salary details

$29

$61

$90

How much do ai infrastructure jobs pay per hour?

As of Sep 3, 2026, the average hourly pay for ai infrastructure in Silver Spring, MD is $61.18, according to ZipRecruiter salary data. Most workers in this role earn between $49.71 and $71.30 per hour, depending on experience, location, and employer.

What is AI infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.

What are the key skills and qualifications needed to thrive in AI infrastructure?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, building, and maintaining the hardware, software, and network systems necessary to support artificial intelligence applications. These roles often require knowledge of cloud computing, data centers, machine learning frameworks, and system optimization to ensure reliable and efficient AI model deployment and operation.

What are popular job titles related to Ai Infrastructure jobs in Silver Spring, MD?

For Ai Infrastructure jobs in Silver Spring, MD, the most frequently searched job titles are:

What job categories do people searching Ai Infrastructure jobs in Silver Spring, MD look for?

The top searched job categories for Ai Infrastructure jobs in Silver Spring, MD are:

What cities near Silver Spring, MD are hiring for Ai Infrastructure jobs?

Cities near Silver Spring, MD with the most Ai Infrastructure job openings:

Ai Infrastructure jobs near you
Infographic showing various Ai Infrastructure job openings in Silver Spring, MD as of August 2026, with employment types broken down into 78% Full Time, 18% Part Time, and 4% Contract. Highlights an 71% Physical, 4% Hybrid, and 25% Remote job distribution, with an average salary of $127,261 per year, or $61.2 per hour.

Full Stack Software Engineer

BigBear.ai

Columbia, MD • On-site

Other

Re-posted 14 days ago

Job description

Residency
All applicants must reside in the United States at the time of application.
Overview
BigBear.ai is seeking a Full Stack Software Engineer to help build the next generation of AI infrastructure that will drive innovation across the customer organization. In this role, you will support the AI infrastructure team by building and maintaining the platform that serves as the foundation for the customer's AI capabilities. You will focus on inference services while supporting the broader ecosystem of AI-enabled applications. This position is ideal for experienced engineers who can independently design, implement, and operate scalable AI infrastructure components. If you are passionate about cutting-edge AI technologies and building robust systems, this is the opportunity for you.
What you will do
  • Infrastructure Design: Design, implement, and optimize infrastructure for AI model inference at scale
  • AI Services Development: Support the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies
  • Problem Solving: Navigate ambiguity and define solutions for underspecified systems and requirements
  • Technology Adoption: Drive adoption of new technologies and practices across engineering teams
  • Monitoring & Observability: Implement monitoring, logging, and observability solutions for AI services
  • Automation: Automate infrastructure provisioning and configuration using Infrastructure as Code (IaC) principles
  • Reliability: Ensure high availability, reliability, and performance of AI platform components
  • Security: Contribute to security best practices for AI systems and data
  • Mentorship: Provide technical guidance and informal mentorship to junior engineers

What you need to have
  • Clearance: Must possess and maintain an active TS/SCI w/Polygraph
  • Education & Experience:
    • 8 years of experience with a B.S. in a technical discipline or 4 additional years of experience in place of a degree
  • Technical Expertise:
    • proficiency in Java and Python.
    • Proven experience building and maintaining production systems at scale
    • Experience with high-volume web application architecture and performance optimization
    • Strong background in systems integration across diverse technologies and platforms
    • Hands-on experience with cloud engineering in AWS
    • Proficiency with Kubernetes administration and deployment patterns
    • Strong Python programming skills
    • Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus)
    • Familiarity with CI/CD pipelines and DevOps practices
    • Strong change management and organizational influence skills
    • Ability to thrive in ambiguous environments and create structure where needed
    • Excellent communication and collaboration skills

What we'd like you to have
  • AI Inference Expertise: Experience with AI inference serving technologies (e.g., vLLM, LiteLLM)
  • Agentic Frameworks: Previous experience with agentic frameworks (e.g., LangChain)
  • Vector Databases: Knowledge of vector databases and embedding systems
  • Distributed Systems: Experience with high-performance computing or distributed systems

Pay transparency
Please note the targeted compensation range is provided as an estimate, and any actual compensation offer may vary depending on the needs of the company, or an applicant's skillset, competencies, experience, education, certifications, location, or other factors. The estimated range does not include the value of any benefits offered.
About BigBear.ai
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on Bigbear.ai's predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in McLean, Virginia, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
BigBear.ai is an Equal opportunity employer all protected groups, including protected veterans and individuals with disabilities.

Apply