1

Ai System Architect Jobs (NOW HIRING)

AI/HPC System Architect Office Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing ...

AI/HPC System Architect

San Jose, CA · On-site

$155K - $255K/yr

AI/HPC System Architect Office Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing ...

$104 - $139/hr

Uns ist wichtig, in cross-funktionalen Teams einzigartige Legal AI-Produkte zu entwickeln und den ... mit in Form von KI-Systemen * Fachliche Konzeption von Prompting-, Retrieval- und ...

System Architect

Santa Monica, CA · On-site

$140K - $160K/yr

System Architect Application Deadline: 30 September 2026 Department: Recruiting Done Employment ... Collaborate with software, hardware, AI/ML, robotics, and product teams throughout the development ...

System Architect

Santa Monica, CA · On-site

$140 - $160/hr

System Architect Application Deadline: 30 September 2026 Department: Recruiting Done Employment ... Collaborate with software, hardware, AI/ML, robotics, and product teams throughout the development ...

From generative AI and cloud-native technologies to peer-led learning and hackathons, our tech ... The Lead Systems Architect - Agentic AI holds a critical role at the intersection of enterprise ...

Collaborate with software, hardware, AI/ML, robotics, and product teams throughout the development ... in Systems Architecture, Software Architecture, or a technical leadership role. * Strong ...

System Architect

Santa Clara, CA · On-site

$150 - $200/hr

Our mission is to democratise AI by significantly reducing the Total Cost of Ownership (TCO) of ... We are actively seeking a System Architect based in US (Bay Area or Austin preferred), EU ...

System Architect

Santa Clara, CA · On-site

$287K/yr

Our mission is to democratise AI by signicantly reducing the Total Cost of Ownership (TCO) of ... We are actively seeking a System Architect based in US (Bay Area or Austin preferred), EU ...

System Architect

Santa Clara, CA · On-site

$287K/yr

Our mission is to democratise AI by significantly reducing the Total Cost of Ownership (TCO) of ... We are actively seeking a System Architect based in US (Bay Area or Austin preferred), EU ...

Systems architecture expertise across distributed systems, cloud-native patterns, APIs/service-based design, event-driven architecture, and scalable workflow solutions. * Applied AI / GenAI depth ...

Systems architecture expertise across distributed systems, cloud-native patterns, APIs/service-based design, event-driven architecture, and scalable workflow solutions. * Applied AI / GenAI depth ...

System Architect

Santa Clara, CA · On-site

$120 - $160/hr

Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE We are seeking a hands‑on System Architect to lead the end‑to‑end architecture for our ...

Perform the full AI/ML lifecycle hands-on, including: * Use-case evaluation and problem definition * Feature engineering and data preparation * Model selection, experimentation, training, and tuning

System Architect

Palo Alto, CA · On-site

$285K/yr

... AI can design and create beyond human cognitive limits. About the Team Backed by Silicon Valley ... About this Role You will define the architecture for advanced compute and hardware systems ...

Perform the full AI/ML lifecycle hands-on, including: * Use-case evaluation and problem definition * Feature engineering and data preparation * Model selection, experimentation, training, and tuning

Showing results 21-40

Ai System Architect information

See salary details

$86.5K

$224.3K

$243.5K

How much do ai system architect jobs pay per year?

As of Aug 16, 2026, the average yearly pay for ai system architect in the United States is $224,334.00, according to ZipRecruiter salary data. Most workers in this role earn between $243,000.00 and $243,000.00 per year, depending on experience, location, and employer.

What is the difference between Ai System Architect vs Data Scientist?

AspectAi System ArchitectData Scientist
Required CredentialsBachelor's or master's in CS, AI, or related fields; certifications in AI/MLBachelor's or master's in CS, Statistics, or related fields; certifications in data analysis or ML
Work EnvironmentDesigning AI systems, collaborating with engineers, focusing on architectureAnalyzing data, building models, interpreting results
Employer & Industry UsageTech companies, AI-focused firms, R&D departmentsTech, finance, healthcare, marketing, research organizations

While both roles require knowledge of AI and ML, an Ai System Architect primarily designs and oversees AI system architecture, ensuring integration and scalability. In contrast, a Data Scientist focuses on analyzing data, building models, and deriving insights. The roles often collaborate but differ in their core responsibilities and focus areas.

What is an AI system architect?

AI System Architects are professionals who design, plan, and oversee the development of artificial intelligence systems within organizations. They are responsible for creating the overall architecture for AI solutions, ensuring that different technologies, algorithms, and data sources work together seamlessly. AI System Architects collaborate with data scientists, engineers, and business stakeholders to implement scalable and effective AI-driven products and services. Their role often includes evaluating new technologies, setting best practices, and ensuring the security and scalability of AI systems.

What are the key skills and qualifications needed to thrive as an AI system architect, and why are they important?

To thrive as an AI System Architect, you need a deep understanding of machine learning, distributed systems, data engineering, and typically a degree in computer science or a related field. Familiarity with cloud platforms (like AWS, GCP, or Azure), AI frameworks (such as TensorFlow or PyTorch), and experience with system design are essential, along with relevant certifications. Strong problem-solving skills, strategic thinking, and effective communication set top candidates apart. These skills ensure the architect can design scalable, efficient, and robust AI solutions that align with business objectives and technical requirements.

How does an AI system architect typically collaborate with data scientists and engineers during a project?

An AI System Architect works closely with data scientists to understand the requirements and constraints of AI models and ensures that system infrastructure supports their needs. They collaborate with engineers to design scalable, robust architectures and oversee the integration of AI components into existing systems. Regular communication and joint problem-solving are essential, as architects bridge the gap between high-level AI goals and practical implementation, often facilitating technical discussions and making critical design decisions.
More about Ai System Architect jobs

What cities are hiring for Ai System Architect jobs?

Cities with the most Ai System Architect job openings:

What states have the most Ai System Architect jobs?

States with the most job openings for Ai System Architect jobs include:

Infographic showing various Ai System Architect job openings in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution, with an average salary of $224,334 per year, or $107.9 per hour.

$284K/yr

Full-time

Medical, Retirement, PTO

Re-posted 21 hours ago


Job description

Job Title: AI/HPC System Architect
Office Location: San Jose, CA
Job Type: Full-Time
Work Model: Onsite 
About SK hynix America
At SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM and NAND flash technologies, we drive the evolution of advancing mobile technology, empowering cloud computing, and pioneering future technologies. Our cutting-edge memory technologies are essential in today's most advanced electronic devices and IT infrastructure, enabling enhanced performance and user experiences across the digital landscape.

We're looking for innovative minds to join our mission of shaping the future of technology. At SK hynix America, you'll be part of a team that's pioneering breakthrough memory solutions while maintaining a strong commitment to sustainability. We're not just adapting to technological change - we're driving it, with significant investments in artificial intelligence, machine learning, and eco-friendly solutions and operational practices. As we continue to expand our market presence and push the boundaries of what's possible in semiconductor technology, we invite you to be part of our journey to creating the next generation of memory solutions that will define the future of computing.

Job Summary:

As an AI/HPC System Architect, your primary responsibility will be to conceptualize the architecture of next-generation AI and HPC system. This involves leveraging advanced memory to create efficient and high-performance systems. Drawing from your extensive experience in AI and HPC infrastructure design, you will derive design requirements, guide the direction of advanced memory solutions, and continuously monitor industry trends. Additionally, you will foster collaborations with cloud service providers, OEMs, national labs, and other stakeholders to facilitate on-site proof-of-concept initiatives aligned with the proposed infrastructure architecture.

Responsibilities:

  • Design next-generation AI and HPC infrastructure that utilizes advanced memory solutions to optimize performance and power efficiency.
  • Derive design requirements for advanced memory solutions based on your extensive experience in AI and HPC infrastructure design.
  • Continuously monitor industry trends and emerging technologies related to AI and HPC infrastructure from sources such as cloud service providers, OEMs, and national labs.
  • Promote and establish collaborative partnerships with customers for on-site proof-of-concept initiatives involving advanced memory solutions, aligning with the proposed infrastructure architecture.
  • Provide strategic direction and recommendations for the adoption and integration of advanced memory solutions within the infrastructure.

Qualification:   

  •  Ph.D in Electrical and Computer Engineering, or related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Deep expertise in AI system design, and knowledge in LLMs, GNN, DLRMs, and other representative AI workloads.
  • Background in hardware/software co-design for AI or HPC systems
  • Effective collaboration and partnership-building skills for engaging with customers and stakeholders.
  • Experience in planning and executing on-site proof-of-concept initiatives to validate infrastructure solutions.
  • Excellent communication skills to convey architectural concepts and influence stakeholders.

Benefits:       

  • Top-tier health insurance at no employee cost
  • Paid day offs: Paid Time Off, Company Holidays, Parental Leave, Happy Fridays
  • 401k Matching
  • Flexible Spending Account (FSA) for Health Care & Dependent Care
  • Educational reimbursement up to $10,000 per year
  • Donation Matching and volunteering opportunities
  • Corporate discount programs
  • Free Breakfast/Lunch/Dinner provided to employees

Equal Employment Opportunity:

SKHYA is an Equal Employment Opportunity Employer. We provide equal employment opportunities to all qualified applicants and employees and prohibit discrimination and harassment of any type without regard to race, sex, pregnancy, sexual orientation, religion, age, gender identity, national origin, color, protected veteran or disability status, genetic information or any other status protected under federal, state, or local applicable laws. 

Compensation:


SK Hynix America logo

About SK Hynix America

Sourced by ZipRecruiter

Industry

Semiconductor and electronic component manufacturing

Company size

201 - 500 Employees

Headquarters location

San Jose, CA, US

Year founded

1983