1

Generative Ai Architect Jobs (NOW HIRING)

WI · On-site

Own end‑to‑end architecture for enterprise Generative AI and Agentic AI solutions, from concept through production. * Lead rapid POC and MVP development to validate AI use cases and de‑risk ...

AI Technical Architect

Orlando, FL · Hybrid

$61.75 - $74.75/hr

Generative AI Architect Location: New York, NY & Orlando, FL | Practice Area: Technology & Engineering | Type: Permanent Shape the architecture of enterprise-scale generative AI solutions at the ...

Own end‑to‑end architecture for enterprise Generative AI and Agentic AI solutions, from concept through production. * Lead rapid POC and MVP development to validate AI use cases and de‑risk ...

New

AI Technical Architect

Charlotte, NC · Hybrid

$64.75 - $78.25/hr

Generative AI Architect Location: Charlotte, NC | Practice Area: Technology & Engineering | Type: Permanent Shape the architecture of enterprise-scale generative AI solutions at the forefront of ...

Agentic AI Technical Architect

Tulsa, OK · On-site

$57.50 - $69.25/hr

We are seeking an AI / Generative AI Architect with deep experience in LLMs, RAG, semantic search, and agentic AI systems to design and deliver enterprise-grade, compliant AI platforms . This role ...

AI Architect Location : Houston, TX Technical Skills: Strong expertise in AI/ML technologies ... Generative AI (LLMs, prompt engineering, RAG) * Machine learning model development and deployment

AI Technical Architect

New York, NY · On-site

$146K - $183K/yr

Generative AI Architect Location: New York, NY & Orlando, FL | Practice Area: Technology & Engineering | Type: Permanent Shape the architecture of enterprise-scale generative AI solutions at the ...

AI Architect

Milford, MA · On-site

$69 - $91/hr

... AI architecture, creating the standards, patterns, and guardrails needed to scale AI solutions ... This includes generative AI, machine learning, automation, and future agent-based capabilities.

The Principal AI Architect role provides enterprise leadership for the design and delivery of end-to-end AI, Generative AI, and agentic AI solutions, while also contributing hands-on technical ...

... AI architecture, creating the standards, patterns, and guardrails needed to scale AI solutions ... This includes generative AI, machine learning, automation, and future agent-based capabilities.

Enterprise AI Architect

Dallas, TX · On-site

$150 - $200/hr

Design and deliver production-ready Generative AI and Agentic AI solutions. * Architect scalable AI platforms leveraging cloud-native technologies and modern data ecosystems. * Lead AI solution ...

The Principal AI Architect role provides enterprise leadership for the design and delivery of end-to-end AI, Generative AI, and agentic AI solutions, while also contributing hands-on technical ...

WI · On-site

$150 - $200/hr

Design and deliver production-ready Generative AI and Agentic AI solutions. * Architect scalable AI platforms leveraging cloud-native technologies and modern data ecosystems. * Lead AI solution ...

AI Architect

$85 - $120/hr

Design scalable AI, machine learning, and generative AI solutions that align with business goals and technology strategies. Architect and oversee the implementation of AI platforms, data pipelines ...

... AI architecture, creating the standards, patterns, and guardrails needed to scale AI solutions ... This includes generative AI, machine learning, automation, and future agent-based capabilities.

Showing results 41-60

Generative Ai Architect information

See salary details

$46.5K

$128.8K

$201.5K

How much do generative ai architect jobs pay per year?

As of Sep 9, 2026, the average yearly pay for generative ai architect in the United States is $128,756.00, according to ZipRecruiter salary data. Most workers in this role earn between $91,000.00 and $166,000.00 per year, depending on experience, location, and employer.

What are the main challenges a Generative AI Architect faces when designing scalable AI solutions?

Generative AI Architects often encounter challenges related to balancing computational efficiency with model accuracy, especially when deploying large-scale models in production environments. Ensuring data privacy and ethical AI use is also critical, as these systems may generate content based on sensitive or proprietary data. Additionally, collaborating effectively with cross-functional teams—such as data scientists, engineers, and business stakeholders—is essential to align technical solutions with organizational goals. Staying up-to-date with rapid advancements in generative AI techniques is another ongoing challenge in this dynamic field.

What are the key skills and qualifications needed to thrive as a Generative AI Architect?

To thrive as a Generative AI Architect, you need strong expertise in machine learning, deep learning, and software engineering, usually supported by an advanced degree in computer science or a related field. Proficiency with frameworks like TensorFlow, PyTorch, and cloud platforms such as AWS or Azure, as well as experience with MLOps tools, is typically required. Creative problem-solving, strong communication, and cross-functional collaboration are vital soft skills for designing innovative AI solutions and guiding teams. These skills ensure the architect can build scalable, cutting-edge generative AI systems that address business needs and drive technological advancement.

What is the difference between Generative Ai Architect vs Data Scientist?

AspectGenerative Ai ArchitectData Scientist
CredentialsAI/ML certifications, advanced degrees in CS or AIStatistics, Data Analysis, Computer Science degrees
Work EnvironmentAI development teams, R&D labs, tech companiesData analysis teams, research departments, business units
Industry UsageAI product development, machine learning projectsData analysis, predictive modeling, business insights
Search/Comparison IntentUnderstanding AI architecture roles, technical skillsData analysis skills, project scope

While both roles involve working with data and advanced technologies, a Generative Ai Architect specializes in designing and implementing AI models that generate content, whereas a Data Scientist focuses on analyzing data to extract insights and build predictive models. The roles often overlap in skills like programming and machine learning, but their primary focus and work environments differ.

How to become a generative AI architect?

To become a generative AI architect, one should have a strong background in computer science, machine learning, and deep learning, with experience in neural network models such as transformers and GANs. Proficiency in programming languages like Python, familiarity with AI frameworks like TensorFlow or PyTorch, and knowledge of data preprocessing are essential. Gaining certifications in AI or machine learning and working on relevant projects can also enhance qualifications for this role.
More about Generative Ai Architect jobs

What cities are hiring for Generative Ai Architect jobs?

Cities with the most Generative Ai Architect job openings:

What states have the most Generative Ai Architect jobs?

States with the most job openings for Generative Ai Architect jobs include:

What are popular job titles related to Generative Ai Architect jobs?

For Generative Ai Architect jobs, the most frequently searched job titles are:

Infographic showing various Generative Ai Architect job openings in the United States as of September 2026, with employment types broken down into 1% Internship, 76% Full Time, 19% Part Time, and 4% Contract. Highlights an 63% Physical, 4% Hybrid, and 33% Remote job distribution, with an average salary of $128,756 per year, or $61.9 per hour.

AI Architect/AI Engineer - Generative & Agentic AI

WI • On-site

Other

Medical, Dental, Vision

Posted 4 days ago


Job description

Job Details

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join our innovative company and help us improve the lives of people and animals everywhere.

About the Role

We are seeking an experienced hands‑on AI Architect to lead the architecture, design, and delivery of enterprise‑scale Generative and Agentic AI solutions. This is a hands‑on architectural leadership role spanning system design, rapid proof‑of‑concept (POC) and MVP delivery, API‑first solution architecture, and technical governance across our AI platform. The ideal candidate combines deep technical depth in LLMs, multi‑agent orchestration, and RAG architecture with the ability to translate business needs into scalable, production‑grade AI systems and to mentor engineering teams along the way.

Key Responsibilities
  • Own end‑to‑end architecture for enterprise Generative AI and Agentic AI solutions, from concept through production.
  • Lead rapid POC and MVP development to validate AI use cases and de‑risk technical approaches before full build‑out.
  • Architect scalable AI platforms leveraging LLMs, RAG pipelines, vector databases, and multi‑agent orchestration frameworks (LangGraph, AutoGen, Semantic Kernel).
  • Design API‑first architectures (REST/GraphQL) that expose AI capabilities to downstream applications and enterprise systems.
  • Define technology selection, architecture standards, and best practices for prompt engineering, model evaluation, and AI governance / Responsible AI.
  • Architect and guide MLOps/LLMOps practices for deployment, monitoring, and model/agent lifecycle management.
  • Lead architecture reviews and present designs to executive sponsors and engineering teams; drive stakeholder alignment.
  • Mentor AI engineers, set coding and architecture standards, and raise the technical bar across the team.
  • Evaluate and select cloud‑native AI services (Azure AI Foundry, Google Vertex AI), balancing scalability, cost, security, and performance.
Our Tech Stack

Databricks platform, Unity Catalog for governance, Delta Lake for data storage, Databricks Apps for hosting, and Databricks AI Gateway for model routing and governance. Microsoft Azure, including Azure AI Foundry for model deployment and orchestration. Multi‑LLM provider access. Anthropic Claude, OpenAI (GPT & Codex), and other foundation models.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, AI, Data Science, or a related field.
  • 6+ years of overall IT experience spanning software engineering, cloud architecture, and/or AI/ML.
  • 3+ years of hands‑on architecture experience specifically in Generative AI / Agentic AI systems.
  • Strong expertise in Python and modern AI development frameworks.
  • Demonstrated experience architecting solutions with LLMs (OpenAI, Claude, Gemini, Llama, or open‑weight models).
  • Deep understanding of RAG architectures, vector databases (Pinecone, FAISS, Databricks Vector Databases, pgvector), and embedding models.
  • Experience architecting on at least one major cloud platform (Azure, AWS, or GCP), including native AI services (Azure AI Foundry / Azure OpenAI, AWS Bedrock, Google Vertex AI).
  • Proven experience with MLOps/LLMOps: CI/CD, containerization (Docker/Kubernetes), observability, and evaluation frameworks.
  • Strong grounding in AI governance, security, compliance, and Responsible AI practices.
  • Excellent communication skills, with the ability to present architecture to both executives and engineers.
Preferred Qualifications
  • Experience designing state management and persistent memory for long‑running autonomous agents.
  • Familiarity with Model Context Protocol (MCP) and emerging AI agent ecosystems.
  • Experience with AI observability / evaluation tooling (LangSmith, Ragas, Langfuse, or custom eval harnesses).
  • Prior consulting, client‑facing, or forward‑deployed architecture experience.
  • Relevant cloud certifications (Azure AI Engineer/Architect, AWS ML Specialty, Google Professional ML Engineer).
  • Experience with NL‑to‑SQL, knowledge graphs, or GraphRAG‑style architecture.
HEALTHCARE DOMAIN PREFERENCE

We strongly prefer candidates who bring healthcare knowledge alongside their AI expertise. Our AI platforms are architected on healthcare distribution and specialty pharmacy data — experience with healthcare distribution, specialty pharma data, or healthcare EMR/EHR systems (HL7, FHIR, claims, NDC‑level data) is a significant advantage.

What Cencora offers

We provide compensation, benefits, and resources that enable a highly inclusive culture and support our team members’ ability to live with purpose every day.

In addition to traditional offerings like medical, dental, and vision care, we also provide a comprehensive suite of benefits that focus on the physical, emotional, financial, and social aspects of wellness.

  • medical, dental, and vision care
  • backup dependent care
  • adoption assistance
  • infertility coverage
  • family building support
  • behavioral health solutions
  • paid parental leave
  • paid caregiver leave

To encourage your personal growth, we also offer a variety of training programs, professional development resources, and opportunities to participate in mentorship programs, employee resource groups, volunteer activities, and much more.

  • training programs
  • professional development resources
  • opportunities to participate in mentorship programs
  • employee resource groups
  • volunteer activities

For details, visit https://www.virtualfairhub.com/cencora

Temps Plein Equal Employment Opportunity

Cencora is committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, age, disability, veteran status or membership in any other class protected by federal, state or local law. The company’s continued success depends on the full and effective utilization of qualified individuals. Therefore, harassment is prohibited and all matters related to recruiting, training, compensation, benefits, promotions and transfers comply with equal opportunity principles and are non‑discriminatory.

Cencora is committed to providing reasonable accommodations to individuals with disabilities during the employment process which are consistent with legal requirements. If you wish to request an accommodation while seeking employment, please call 888.692.2272 or email hrsc@cencora.com. We will make accommodation determinations on a request‑by‑request basis. Messages and emails regarding anything other than accommodations requests will not be returned.

Affiliated Companies

Affiliated Companies: International Oncology Network Solutions Inc

Cencora is a leading global pharmaceutical solutions company that is committed to improving the lives of people and animals everywhere. We connect manufacturers, providers, and patients to ensure that anyone can get the therapies they need, where and when they need them. We’re a purpose‑driven organization, where all of our team members around the world are united in our responsibility to create healthier futures. We work together every day to help our partners bring their innovations to patients worldwide, creating unparalleled access and impact at the center of health.

#J-18808-Ljbffr