1

Back End Architect Jobs (NOW HIRING)

Senior Backend Engineer

San Jose, CA · On-site

$180K - $225K/yr

Architect and develop high-performance Golang services for FlexAI's AI PaaS and infrastructure ... Drive long-term roadmap for backend infrastructure and AI platform capabilities * Partner with ...

The role involves leading backend architecture and technical design for personalization platform services, building cloud-native backend APIs, and mentoring engineers while driving high-quality ...

Lead backend architecture and technical design for personalization platform services. * Design and build cloud-native backend APIs using TypeScript, Node.js, AWS Lambda, and API Gateway. * Work on ...

Establish and promote best practices for backend architecture, security, and code quality at scale. * Build systems that are reliable, observable, and capable of supporting a rapidly growing codebase ...

They are seeking a Backend Engineer to architect and scale their logistics and operations platforms, focusing on backend systems that support real-time operations. Responsibilities : • Write high ...

Backend Engineer II We are looking for a highly motivated Backend Engineer II to design, build, and ... Participate in system design discussions, code reviews, and architecture decisions * Troubleshoot ...

This role offers the opportunity to take ownership of the backend architecture powering a globally used visual storytelling platform. You will lead the design and evolution of scalable, secure, and ...

next page

Showing results 1-20

Back End Architect information

See salary details

$66

$69

$71

How much do back end architect jobs pay per hour?

As of Jun 23, 2026, the average hourly pay for back end architect in the United States is $69.71, according to ZipRecruiter salary data. Most workers in this role earn between $68.51 and $70.91 per hour, depending on experience, location, and employer.

What are Back End Architects?

Back End Architects are specialized software professionals responsible for designing and overseeing the core server-side structure of web applications or systems. They ensure the architecture is scalable, secure, and efficient, often making decisions about databases, APIs, and server frameworks. Back End Architects collaborate closely with developers, DevOps, and front-end teams to create systems that support business goals and handle high volumes of data or user activity. They also set best practices, review code, and troubleshoot complex technical issues.

What is the difference between Back End Architect vs Back End Developer?

AspectBack End ArchitectBack End Developer
Required CredentialsBachelor's in CS or related, often certifications in cloud or architectureBachelor's in CS or related, programming certifications
Work EnvironmentDesigning system architecture, high-level planningImplementing features, coding, debugging
Employer & Industry UsageUsed in enterprise, large-scale systemsUsed across startups, companies, and tech firms
Search & Comparison IntentUnderstanding architecture roles, planningLearning coding, development tasks

The Back End Architect focuses on designing and planning the overall system architecture, ensuring scalability and performance. In contrast, the Back End Developer implements the architecture through coding and development tasks. Both roles require similar educational backgrounds but differ in scope and responsibilities, with architects taking a higher-level strategic role and developers focusing on building and maintaining backend systems.

How does a Back End Architect typically collaborate with front-end teams during a project?

A Back End Architect works closely with front-end developers to ensure seamless integration between the server-side logic and the user-facing parts of an application. This collaboration often involves designing and documenting APIs, establishing data contracts, and participating in regular meetings to align on technical requirements and timelines. Effective communication is key, as the architect must translate complex back-end processes into clear, actionable tasks for the front-end team. This teamwork helps ensure that the final product is robust, scalable, and delivers a consistent user experience.

What are the key skills and qualifications needed to thrive as a Back End Architect, and why are they important?

To thrive as a Back End Architect, you need deep expertise in server-side programming, system architecture, database design, and a strong understanding of software engineering principles, usually backed by a degree in computer science or related experience. Proficiency with backend languages (like Java, Python, or Node.js), experience with cloud platforms (such as AWS or Azure), and knowledge of containerization and orchestration tools (like Docker and Kubernetes) are typically required. Strong problem-solving, leadership, and communication skills help in effectively collaborating with cross-functional teams and guiding technical decisions. These capabilities are crucial for designing scalable, reliable systems that meet business needs and support long-term growth.
More about Back End Architect jobs
What are popular job titles related to Back End Architect jobs? For Back End Architect jobs, the most frequently searched job titles are:

Senior Backend Engineer

FlexAI

San Jose, CA • On-site

$180K - $225K/yr

Full-time

Posted 2 days ago


Job description

About FlexAI
Build and Deploy AI the right way, anywhere.
The FlexAI Compute Infrastructure Platform provides an "end-to-end AI compute layer" for running and managing workloads across any cloud, any GPU, and any deployment model (public, hybrid, or on-prem). It brings together "1-click simplicity" for users with "enterprise-grade orchestration, security, and automation" under the hood.
Founded by Brijesh Tripathi, who bring experience from Nvidia, Apple, Tesla, Intel and Zoox, FlexAI is not just building a product - we're shaping the future of AI. Our teams are strategically distributed across Silicon Valley and Bengaluru, united by a shared mission: to deliver more compute with less complexity.
If you're passionate about shaping the future of artificial intelligence, driving innovation, and contributing to a sustainable and inclusive AI ecosystem, FlexAI is the place for you !
Role Overview
FlexAI is looking for a Senior Backend Engineer (Infrastructure & AI Platform) with deep Golang expertise to architect and build the core backend systems powering our next-generation AI compute and PaaS platform. This role sits at the intersection of distributed systems, cloud infrastructure, and AI platform engineering - enabling large-scale model training, inference, and orchestration across heterogeneous compute. This is not a traditional backend role; you will be building platform-grade systems that support AI runtimes, scheduling, resource orchestration, and multi-tenant cloud infrastructure.
As a Senior Backend Engineer, you'll drive backend architecture, scale platform services, and build high-performance infrastructure components that power AI workloads in production environments - influencing how the platform evolves from Beta to enterprise-grade deployment. Expect high ownership and technical autonomy in a research-driven, deep-tech environment - not SaaS CRUD apps.
This position is In-Person and located at our San Jose, CA Office.
What You'll Do
Core Platform & Infrastructure Backend:
  • Architect and develop high-performance Golang services for FlexAI's AI PaaS and infrastructure platform
  • Build internal APIs powering model deployment, job scheduling, and compute lifecycle management
  • Develop components interfacing with GPU/compute infrastructure and AI runtimes

Distributed Systems & Scalability:
  • Design and scale microservices and event-driven systems for high-throughput AI workloads
  • Optimize for low latency, high concurrency, and fault tolerance
  • Implement service-to-service communication (gRPC/REST, message queues, async pipelines)
  • Drive reliability, observability, and resilience across services

AI Platform Integration:
  • Collaborate with AI/ML and Runtime teams to integrate systems with training pipelines, inference infrastructure, experimentation workflows, and dataset/artifact management
  • Enable orchestration across cloud and on-prem environments
  • Build abstractions that simplify AI infrastructure consumption

Cloud-Native & Platform Engineering:
  • Design cloud-native, Kubernetes-native services
  • Work with DevOps/SRE on CI/CD, deployment automation, and scalability
  • Contribute to architecture decisions for multi-region, multi-cloud infrastructure
  • Improve monitoring, logging, and diagnostics

Technical Leadership:
  • Lead architecture reviews and set engineering standards
  • Mentor engineers and guide complex problem-solving
  • Drive long-term roadmap for backend infrastructure and AI platform capabilities
  • Partner with Product, Runtime, and Infra leadership to translate requirements into scalable systems
Tech Stack (Indicative):
  • Languages: Golang (Primary), Python (Secondary)
  • Infrastructure: Kubernetes, Docker, Cloud (AWS/GCP/Azure)
  • Architecture: Microservices, gRPC, Event-driven systems
  • Data: SQL + NoSQL databases, caching, streaming systems
  • Observability: Prometheus, Grafana, OpenTelemetry (or similar)
What You'll Need to Be Successful
Core Engineering:
  • 5+ years of Backend or Infrastructure Engineering experience
  • Expert-level proficiency in Golang (must-have, heavy hands-on)
  • Strong experience building production-grade distributed systems
  • Proven track record on infrastructure platforms, PaaS, or deep-tech systems

Infrastructure & Systems:
  • Deep understanding of cloud-native architectures and containerized environments
  • Strong experience with Kubernetes, Docker, and cluster orchestration
  • Familiarity with compute scheduling, resource management, or platform runtimes is a strong plus

Databases & Data Systems:
  • Experience with distributed databases (PostgreSQL, Cassandra, DynamoDB, etc.)
  • Strong understanding of caching, queues, and streaming systems (Redis, Kafka, etc.)

AI / Platform Exposure (Highly Preferred):
  • Experience on AI/ML platforms, model infrastructure, or data platforms
  • Familiarity with ML pipelines, inference systems, or GPU-backed workloads
  • Exposure to PyTorch, TensorFlow infrastructure, or model serving systems is a plus

Ideal Candidate Profile (Who Will Thrive Here)
  • Infra-first backend engineers (not just API developers)
  • Background in AI infra, cloud platforms, developer platforms, or deep-tech systems
  • Strong systems thinkers who enjoy low-level performance, scalability, and architecture challenges
  • Startup-minded builders comfortable in ambiguous, high-ownership environments

What We Offer
  • Competitive salary and benefits package
  • Work on cutting-edge AI infrastructure
  • Build products used by developers and enterprises
  • High ownership, fast execution, real impact
  • Collaborative, high-caliber team

The pay range for this role is:
180,000 - 225,000 USD per year (US)