ZipRecruiter

Log In

1

Server Architect Jobs (NOW HIRING)

Phononic

Platform Architect, Server Infrastructure

$175K - $225K/yr

Define end-to-end thermal architecture strategies for GPU servers, optical interconnects, and CPO-based systems * Develop system-level approaches to balance performance, heat dissipation, reliability ...

Purple Drive

Azure Cloud Architect

Chicago, IL · On-site

$67 - $85.25/hr

Understanding of Windows Server architecture -Windows 2016, Windows 2019 and IIS; Understanding of Linux Server architecture - RHEL, Oracle Linux, Amazon Linux, etc. Experience with containers ...

Spruce Infotech

Tableau Architect

King Of Prussia, PA · On-site

Tableau Server * Architecture Design (Primary/Secondary setup) * Deployment * Monitoring/Maintenance * Cluster Setup * Common gateway setup and configuration * Extract maintenance Tableau Server ...

Qualcomm

Server Platform Architect

Santa Clara, CA · On-site

Server Platform Architect As a Staff or Sr. Staff Server Platform Architect, you will own hands-on design and technical execution of high-performance server platforms, working in close collaboration ...

Sealing Technologies

Solutions Architect

Columbia, MD · On-site

$105K - $135K/yr

This role is ideal for someone who understands server architecture at a low level CPU, memory, storage, networking, power, and thermal constraints and can translate that knowledge into real-world ...

NVIDIA

WI · On-site

$61.50 - $82.50/hr

A leading technology company in the United States seeks a Senior Software Architect to lead the design and development of innovative server systems for deep learning applications. This role requires ...

Saxon Global

Cloud Database Architect

Westlake Village, CA · On-site

$67 - $86.25/hr

AWS & SQL Server Architecture * Communication & Stakeholder Engagement Preferred Skills ... Experience with event streaming technologies (Kafka, Kinesis, etc.) * Experience with NoSQL ...

NVIDIA

Senior Architect, Data Center Modeling

Hillsboro, OR · On-site

$73.25 - $98/hr

... server architecture design and deployment, especially up to hyperscale. • Background in parallel computing, server architecture, or datacenter design. • An excitement and curiosity about the ...

NVIDIA

Senior Architect, Data Center Modeling

Santa Clara, CA · On-site

$79 - $105.75/hr

... server architecture design and deployment, especially up to hyperscale. • Background in parallel computing, server architecture, or datacenter design. • An excitement and curiosity about the ...

widenet

ServiceNow Architect

Seatac, WA · On-site +1

$140/hr

We have an opening for a ServiceNow Architect. They are responsible for designing, implementing ... Design integrations using REST, SOAP, MID Server, IntegrationHub, APIs * Define data models, CMDB ...

NVIDIA

Senior Architect, Data Center Modeling

Austin, TX · On-site

$66.75 - $89.25/hr

... server architecture design and deployment, especially up to hyperscale. • Background in parallel computing, server architecture, or datacenter design. • An excitement and curiosity about the ...

NVIDIA

Senior Architect, Data Center Modeling

Durham, NC · On-site

$65 - $87/hr

... server architecture design and deployment, especially up to hyperscale. • Background in parallel computing, server architecture, or datacenter design. • An excitement and curiosity about the ...

NVIDIA

Senior Architect, Data Center Modeling

Boulder, CO · On-site

$70.75 - $94.75/hr

... server architecture design and deployment, especially up to hyperscale. • Background in parallel computing, server architecture, or datacenter design. • An excitement and curiosity about the ...

next page

Showing results 1-20

All JobsServer Architect Jobs

Server Architect information

See salary details

$5

$72

How much do server architect jobs pay per hour?

As of Jul 5, 2026, the average hourly pay for server architect in the United States is $72.12, according to ZipRecruiter salary data. Most workers in this role earn between $72.12 and $72.12 per hour, depending on experience, location, and employer.

What are server architects?

Server architects are IT professionals who design, implement, and manage server infrastructure within an organization. They are responsible for planning server environments that support business applications, ensuring reliability, performance, and scalability. Their work involves selecting appropriate hardware and software, configuring servers, and developing strategies for data security and disaster recovery. Server architects collaborate closely with other IT teams to align server solutions with organizational goals.

Will AI replace Solution Architect?

AI is unlikely to fully replace Solution Architects, as their role involves complex problem-solving, designing systems, and understanding client needs that require human judgment. AI tools can assist in automating routine tasks and analyzing data, but the strategic and interpersonal aspects of the role remain essential. Solution Architects need skills in cloud platforms, architecture design, and communication, which are difficult for AI to replicate entirely.

What are the key skills and qualifications needed to thrive as a Server Architect, and why are they important?

To thrive as a Server Architect, you need deep expertise in server infrastructure design, network architecture, and systems integration, typically backed by a degree in computer science or a related field. Familiarity with virtualization platforms (like VMware or Hyper-V), cloud services (such as AWS or Azure), and certifications like Microsoft Certified: Azure Solutions Architect or AWS Certified Solutions Architect is highly valuable. Strong analytical thinking, problem-solving abilities, and effective communication are essential soft skills for collaborating with teams and stakeholders. These skills and qualifications enable Server Architects to design robust, scalable, and secure server environments that support organizational goals.

What are some common challenges faced by Server Architects when designing scalable infrastructure?

Server Architects often encounter challenges related to balancing performance, security, and cost-effectiveness while designing scalable systems. Ensuring that the chosen architecture can accommodate future growth without sacrificing reliability or maintainability is a key concern. Additionally, they must collaborate closely with network engineers, software developers, and IT operations to integrate new solutions seamlessly into existing environments. Staying current with evolving technologies and best practices is also essential for long-term success in this role.

What is the highest paid architect job?

The highest paid architect roles are often senior or specialized positions such as enterprise or solutions architects in the technology sector, with salaries exceeding $150,000 annually. These roles typically require extensive experience, advanced certifications, and expertise in cloud platforms, systems design, or enterprise architecture frameworks.

What does a server architect do?

A server architect designs and plans the structure of server systems to ensure they meet organizational needs for performance, security, and scalability. They evaluate hardware and software options, develop architecture diagrams, and often work with cloud platforms and virtualization tools to optimize server environments.

How to become a server architect?

To become a server architect, you typically need a bachelor's degree in computer science, information technology, or a related field, along with extensive experience in server administration, network infrastructure, and system design. Gaining certifications such as Cisco CCNP, Microsoft Certified: Azure Solutions Architect, or VMware Certified Professional can enhance your qualifications. Strong knowledge of server hardware, virtualization, security, and cloud platforms is essential for designing and managing complex server environments.
More about Server Architect jobs
What states have the most Server Architect jobs? States with the most job openings for Server Architect jobs include:
What job categories do people searching Server Architect jobs look for? The top searched job categories for Server Architect jobs are:
Server Architect jobs near you
Infographic showing various Server Architect job openings in the United States as of June 2026, with employment types broken down into 65% Full Time, 31% Part Time, 1% Temporary, and 3% Contract. Highlights an 96% Physical, 1% Hybrid, and 3% Remote job distribution, with an average salary of $150,000 per year, or $72.1 per hour.
Platform Architect, Server Infrastructure

Platform Architect, Server Infrastructure

Phononic

Remote

$175K - $225K/yr

Full-time

Posted 28 days ago

Job description

Ready to revolutionize AI datacenter thermal control solutions and deployments? Phononic is the place for you. We are seeking a results-oriented individual to join our Infrastructure Solutions organization to deliver industry leading innovative products in support of revolutionizing cooling solutions for AI datacenters.
We are seeking a highly experienced Platform Architect to lead the design and optimization of next-generation AI infrastructure platforms, with a core focus on thermal management and cooling technologies for optical interconnects, co-packaged optics (CPO), and GPU-based servers.
In this role, you will drive system-level innovation to address one of the most critical challenges in modern AI systems: managing heat and power density while delivering extreme bandwidth and compute performance. You will work at the intersection of thermodynamics, photonics, silicon, and server architecture, enabling scalable, efficient, and reliable AI deployments.
Thermal Architecture & System Design
  • Define end-to-end thermal architecture strategies for GPU servers, optical interconnects, and CPO-based systems
  • Develop system-level approaches to balance performance, heat dissipation, reliability, and energy efficiency
  • Design and optimize solutions for:
  1. High-power GPUs and accelerators
  2. Dense optical I/O (pluggable and co-packaged optics)
  3. Rack- and cluster-level thermal constraints

Cooling Technology Innovation
  • Optimize cooling strategies for high-density AI workloads and optical bandwidth scaling
  • Analyze and improve thermal resistance, junction temperatures, and cooling efficiency
  • Lead design and evaluation of advanced cooling approaches, including:
  1. Air cooling (high-performance heatsinks, airflow optimization)
  2. Liquid cooling (direct-to-chip, cold plates)
  3. Immersion cooling and emerging techniques

Optical & CPO Thermal Integration
  • Architect thermal solutions for:
  1. High-speed optical transceivers (400G/800G/1.6T+)
  2. Co-packaged optics (CPO) integrated with switch or GPU ASICs
  • Address key challenges such as:
  1. Heat dissipation in tightly integrated photonics + silicon environments
  2. Thermal impact on optical performance and signal integrity
  3. Reliability and lifetime of photonic components under thermal stress
  • Collaborate with silicon photonics teams to co-design thermal-aware optical packaging architectures

GPU Server & Rack-Level Thermal Design
  • Design GPU server platforms optimized for thermal efficiency, including:
  1. Multi-GPU configurations and interconnect density
  2. Power delivery and cooling integration
  3. Airflow and liquid loop design
  • Drive innovations in rack-level and data center-level cooling, including:
  1. High-density rack (>50-100kW) thermal strategies
  2. Integration with facility cooling systems
  3. Optimization for power usage effectiveness (PUE)

Interconnect & System Optimization
  • Optimize system performance under thermal constraints, including thermal throttling behavior and workload efficiency
  • Ensure thermal considerations are integrated into interconnect design decisions, including:
  1. Optical vs. electrical tradeoffs
  2. Placement of optics (pluggable vs. co-packaged)

Cross-Functional Leadership
  • Drive alignment between thermal design, system architecture, and product roadmap
  • Influence vendor selection across cooling systems, optics, and server platforms
  • Partner with teams across:
  1. Silicon and ASIC design
  2. Photonics engineering
  3. Mechanical and thermal engineering
  4. Data center infrastructure

Technology Strategy & Innovation
  • Contribute to long-term innovation in sustainable and energy-efficient AI infrastructure
  • Stay ahead of trends in:
  1. Thermal management for AI infrastructure
  2. Co-packaged optics and optical I/O scaling
  3. High-density GPU clusters and exascale AI systems

Requirements
Required
  • Bachelor's or Master's degree in Mechanical Engineering, Electrical Engineering, Physics, or related field
  • 8-12+ years of experience in system architecture, thermal engineering, or hardware platform design
  • Deep expertise in:
  1. Thermal management and cooling technologies for high-performance systems
  2. GPU servers, AI/HPC infrastructure, or data center platforms
  3. Optical interconnects and high-speed systems (1.6T+)
  • Strong understanding of:
  1. Heat transfer (conduction, convection, liquid cooling systems)
  2. Power density and thermal constraints in modern compute systems
  3. Tradeoffs across performance, cooling, cost, and reliability

Preferred
  • Experience working with hyperscalers or large-scale AI deployments
  • Experience with co-packaged optics (CPO) and silicon photonics thermal challenges
  • Hands-on design experience with:
  1. Liquid cooling systems and cold plate design
  2. High-density rack and cluster cooling
  • Knowledge of:
  1. Optical module thermal constraints and reliability
  2. Data center infrastructure (HVAC, liquid loops, facility integration)

Key Skills
  • Deep expertise in thermal systems and heat management
  • System-level thinking across compute, optics, and cooling
  • Ability to integrate thermal constraints into architecture decisions
  • Cross-disciplinary collaboration (mechanical, electrical, photonics)
  • Strong problem-solving in high-density, high-power environments

Salary Description
$175,000 - $225,000

Apply