2

Entry Level Ai Infrastructure Engineer Jobs in California

AI Infrastructure Engineer

Sunnyvale, CA ยท On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

AI Infrastructure Engineer

Sunnyvale, CA ยท On-site

$126K - $165K/yr

The function owns the reliability, scalability, and operability of Meshy\'s AI model serving stack, along with core engineering infrastructure. The team operates a conventional production ...

AI Infrastructure Engineer

San Francisco, CA ยท On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind nijiใƒปjourney , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AI Infrastructure Engineer

San Francisco, CA ยท On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind nijiใƒปjourney , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AI Infra Resident (1-Year Program)

Palo Alto, CA ยท On-site

$116K - $148K/yr

RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. The role involves rotating across various aspects of AI infrastructure, working on real ...

AI Infra Resident (1-Year Program)

Palo Alto, CA ยท On-site

$116K - $148K/yr

RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. The role involves rotating across various domains such as inference and training, working ...

AI Infrastructure Software Engineer

San Diego, CA ยท On-site

$183K - $217K/yr

Qualcomm's AI Infrastructure Software team is seeking a highly motivated and versatile software engineer to develop cutting-edge embedded software across the full system stack on Qualcomm Snapdragon ...

AI/ML Infrastructure Engineer

San Francisco, CA ยท On-site

$126K - $166K/yr

Collaborating closely with AI research and platform engineering teams to optimize core parallel algorithms and influence the design of our next-generation inference infrastructure. * Model ...

About Us Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing ... About the Role As a Senior Infrastructure Engineer, you will help design and scale the core systems ...

next page

Showing results 1-20

Entry Level Ai Infrastructure Engineer information

What is a $900000 AI job?

A $900,000 AI job typically refers to high-level positions in artificial intelligence, such as senior AI engineers, research directors, or executive roles, which offer compensation in that range including salary, bonuses, and stock options. Entry-level AI infrastructure engineers usually earn significantly less, with salaries often starting in the low six figures depending on experience and location.

Can you become an AI engineer with no experience?

Becoming an AI infrastructure engineer typically requires some background in programming, data structures, and machine learning concepts. While prior experience is helpful, entry-level roles often accept candidates who demonstrate strong technical skills, a willingness to learn, and relevant certifications or coursework in AI and cloud platforms. Building a portfolio through projects and gaining familiarity with tools like Python, TensorFlow, or cloud services can improve chances of entry without prior professional experience.

What engineer makes $500,000 a year?

While most entry-level AI infrastructure engineers do not earn that level of salary, senior AI or machine learning engineers with extensive experience, specialized skills, and advanced certifications can reach or exceed $500,000 annually, especially in high-demand industries or companies with competitive compensation packages. Such roles often require expertise in cloud platforms, large-scale data processing, and deep learning frameworks.

What is the difference between Entry Level Ai Infrastructure Engineer vs Data Engineer?

AspectEntry Level Ai Infrastructure EngineerData Engineer
Required CredentialsBachelor's in CS, EE, or related; familiarity with AI toolsBachelor's in CS, Data Science, or related; experience with databases
Work EnvironmentAI/ML teams, cloud platforms, infrastructure setupData pipelines, database management, cloud services
Industry UsageTech companies, AI startups, research labsFinance, healthcare, tech firms, data-driven industries

Entry Level Ai Infrastructure Engineers focus on building and maintaining AI infrastructure, including cloud and hardware setups, while Data Engineers primarily develop data pipelines and manage data storage. Both roles require technical skills and often overlap in cloud environments, but they serve different core functions within data and AI projects.

How to become an AI infrastructure engineer?

To become an AI infrastructure engineer, you should have a strong foundation in computer science, including knowledge of cloud platforms, networking, and hardware systems. Gaining skills in programming languages like Python and understanding AI frameworks, along with certifications in cloud services such as AWS or Azure, can enhance your qualifications. Practical experience with deploying and managing AI models and infrastructure is also essential.
What are the most commonly searched types of Ai Infrastructure Engineer jobs in California? The most popular types of Ai Infrastructure Engineer jobs in California are:
What are popular job titles related to Entry Level Ai Infrastructure Engineer jobs in California? For Entry Level Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:
What cities in California are hiring for Entry Level Ai Infrastructure Engineer jobs? Cities in California with the most Entry Level Ai Infrastructure Engineer job openings:
Infographic showing various Entry Level Ai Infrastructure Engineer job openings in California as of July 2026, with employment types broken down into 83% Full Time, and 17% Contract. Highlights an 71% In-person, 7% Hybrid, and 22% Remote job distribution.

AI Infrastructure Engineer

MeshyAI

Sunnyvale, CA โ€ข On-site

$125K - $164K/yr

Full-time

Posted 12 days ago


Job description

Job Summary:
MeshyAI is a leading 3D generative AI company headquartered in Silicon Valley, focused on transforming the content creation pipeline. The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product systems.
Responsibilities:
โ€ข Responsible for the design, development, and optimization of core capabilities for the AI inference platform, including key modules such as inference services, task scheduling, service orchestration, elastic scaling, and release governance.
โ€ข Participate in the development of CPU/GPU resource management systems to optimize stability, resource utilization, and cost efficiency in scenarios where online inference and training tasks are run on the same cluster.
โ€ข Drive the unified management and scheduling of GPU resources, and explore the practical implementation of capabilities such as MIG, MPS, time-sharing, and virtualization in real-world business operations.
โ€ข Continuously optimize the throughput, latency, and availability of the inference pipeline, refining engineering quality in complex inference pipelines, multi-model collaboration, and high-concurrency scenarios.
โ€ข Focus on R&D efficiency, resource and cost management, online stability, and disaster recovery architecture design to drive the companyโ€™s continuous evolution in performance, reliability, and maintainability.
โ€ข Explore AI-native infrastructure and automated operations to make infrastructure smarter and more user-friendly, supporting the companyโ€™s rapid expansion during its startup phase.
Qualifications:
Required:
โ€ข Bachelorโ€™s degree or higher; majors in Computer Science, Software Engineering, Artificial Intelligence, Telecommunications, or related fields are preferred.
โ€ข 1 to 3 years of experience in backend development, infrastructure, cloud-native platforms, machine learning platforms, or AI platforms.
โ€ข Proficiency in at least one of Go or Python, with solid software engineering skills and a strong commitment to code quality.
โ€ข Understanding of fundamental principles in Linux, operating systems, computer networks, and distributed systems; ability to independently identify and resolve complex engineering issues.
โ€ข Practical development experience with Kubernetes, Docker, microservices, or distributed systems, with a basic understanding of production system stability.
โ€ข Real-world project experience in areas such as model inference, task orchestration, resource scheduling, and service stabilityโ€”beyond mere conceptual understanding.
โ€ข Self-motivated, curious, and a fast learner; willing to take on greater ownership and broader responsibilities in a startup environment, while continuously learning and quickly adopting new technologies.
Preferred:
โ€ข Experience with GPU inference platforms, Kubernetes schedulers, Device Plugins, or related platform development.
โ€ข Familiarity with frameworks such as Ray and Ray Serve, or experience in developing and optimizing model serving, distributed inference, and task orchestration frameworks.
โ€ข Familiarity with solutions related to MIG, MPS, vGPU, partitioned GPUs, or GPU resource reuse, and experience balancing performance and stability.
โ€ข Engineering experience in observability, SRE, capacity planning, cost governance, canary deployments, and automated rollbacks.
โ€ข Open-source projects, technical blogs, personal projects (side projects), or other achievements that demonstrate learning agility and growth potential.
โ€ข Ongoing interest and hands-on experience in emerging areas such as AI infrastructure (AI Infra), inference systems, and AI agent toolchains.
Company:
Meet the world's most popular and intuitive free AI 3D model generator. Founded in 2021, the company is headquartered in Sunnyvale, USA, with a team of 51-200 employees. The company is currently Growth Stage.