Design Agentic AI solutions to optimize business workflow automation, including the use of memory, agentic reflection, and task planning. * Design AI integration patterns, such as RAG, for model ...
Design Agentic AI solutions to optimize business workflow automation, including the use of memory, agentic reflection, and task planning. * Design AI integration patterns, such as RAG, for model ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Director, AI Product Ops (Eagan)
Eagan, MN · On-site
$237K - $248K/yr
Director, AI Product Ops - TAAP Product We are seeking an exceptional, transformative Director of ... By automating coordination and program management tasks, you will not only liberate our product ...
New
Director, AI Product Ops (Eagan)
Eagan, MN · On-site
$237K - $248K/yr
Director, AI Product Ops - TAAP Product We are seeking an exceptional, transformative Director of ... By automating coordination and program management tasks, you will not only liberate our product ...
New
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Design and implement AI-driven workflows and solutions to automate repetitive tasks and improve process efficiency. * Develop APIs, scripts, and tools for seamless integration of AI models into ...
Director, AI Product Ops (Eagan)
Eagan, MN · On-site
$237K - $248K/yr
By automating coordination and program management tasks, you will not only liberate our product ... AI-First Product Operations Drive a Near-Zero-Overhead Model: Architect and run product operations ...
Director, AI Product Ops (Eagan)
Eagan, MN · On-site
$237K - $248K/yr
By automating coordination and program management tasks, you will not only liberate our product ... AI-First Product Operations Drive a Near-Zero-Overhead Model: Architect and run product operations ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$94K - $133K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$94K - $133K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
AI Business Systems Analyst
Eagan, MN · On-site +1
$65K - $100K/yr
The Enterprise AI & Applications Analyst also supports the administration, integration, governance ... Perform additional duties or tasks as assigned, including travel to orientation, company events ...
AI Business Systems Analyst
Eagan, MN · On-site +1
$65K - $100K/yr
The Enterprise AI & Applications Analyst also supports the administration, integration, governance ... Perform additional duties or tasks as assigned, including travel to orientation, company events ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$96K - $125K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$96K - $125K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$96K - $124K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
Senior AI Business Analyst
Minneapolis, MN · On-site
$96K - $124K/yr
As an AI Business Analyst, you will help translate complex business challenges into AI-ready ... Define and monitor all implementation tasks such as the production check-out process, including ...
Medical Billing Specialist
Saint Paul, MN · Remote
$50 - $80/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work * Author and review realistic evaluation tasks based on Clinical Study Reports, DSURs, PSURs/PBRERs, and ...
Medical Billing Specialist
Saint Paul, MN · Remote
$50 - $80/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work * Author and review realistic evaluation tasks based on Clinical Study Reports, DSURs, PSURs/PBRERs, and ...
AI Business Systems Analyst
Eagan, MN · On-site
The Enterprise AI & Applications Analyst also supports the administration, integration, governance ... Perform additional duties or tasks as assigned, including travel to orientation, company events ...
AI Business Systems Analyst
Eagan, MN · On-site
The Enterprise AI & Applications Analyst also supports the administration, integration, governance ... Perform additional duties or tasks as assigned, including travel to orientation, company events ...
Medical Writer / Clinical Document Author
Saint Paul, MN · Remote
$50 - $80/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work * Author and review realistic evaluation tasks based on Clinical Study Reports, DSURs, PSURs/PBRERs, and ...
Medical Writer / Clinical Document Author
Saint Paul, MN · Remote
$50 - $80/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work * Author and review realistic evaluation tasks based on Clinical Study Reports, DSURs, PSURs/PBRERs, and ...
Ai Task information
What is an AI task?
What are some common challenges faced by AI task specialists when working on multi-disciplinary teams?
What are the key skills and qualifications needed to thrive as an AI (Artificial Intelligence) engineer, and why are they important?
What is the difference between Ai Task vs Data Annotator?
| Aspect | Ai Task | Data Annotator |
|---|---|---|
| Required Credentials | Basic technical skills, sometimes certifications in AI or data labeling | Minimal formal education, training in annotation tools often provided |
| Work Environment | Remote or on-site, often part of AI development teams | Primarily remote, working with datasets and annotation platforms |
| Industry Usage | AI development, machine learning projects | Data preparation for AI, machine learning, and data science |
| Search & Comparison Intent | Understanding roles in AI projects, job requirements | Clarifying data labeling tasks and skills needed |
Ai Tasks involve a range of activities related to training AI models, including data labeling, model testing, and algorithm development. Data Annotators specifically focus on labeling and annotating datasets to train machine learning models. While both roles support AI development, Ai Tasks encompass broader responsibilities, whereas Data Annotators primarily handle data preparation.

BCG Platinion | Principal AI Tech Architect - AI Platforms
Minneapolis, MN • On-site
Full-time
Medical, Dental, Vision, Retirement, PTO
Re-posted 3 days ago
Key responsibilities
Design system architectures for AI and LLM-based solutions, ensuring scalability, low-latency inference, and modularity.
Define and develop agentic AI solutions to optimize business workflow automation, including memory, reflection, and task planning.
Design AI integration patterns such as RAG for model orchestration, context management, prompt orchestration, and external system connectivity.
Boston Consulting Group rating
9.5
Based on 16 frontline employees who took The Breakroom Quiz
Job description
Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
Who We Are
About BCG Platinion
BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.
What You'll Do
Principal AI Tech Architects at BCG Platinion are:
- Collaborative. They are interdisciplinary team players who seek alignment and establish relationships ranging from cross-functional stakeholder groups to existing teams.
- Systems thinkers. They are well-versed in designing sophisticated and robust AI solutions to common business problems.
- Technical experts. They are critical thinkers and have extensive Technology & AI expertise that drives novel solutions.
- Comfortable with ambiguity. They know the path forward isn't always well-defined. They are comfortable and confident working through the unknown.
- Change agents. They know how to make change happen across an organization. They can align and onboard teams to implement new processes and toolsets. They embrace complex challenges and guide an organization to optimize technology best practices.
- Agile advocates. They are well-versed in agile methodologies and use their expertise to strategically tackle difficult challenges and implement change.
- Innovative. They are creative thinkers who apply their deep technology architecture and AI Platform expertise to envision novel design patterns for the next generation of technology solutions.
- Knowledgeable. They have a sophisticated understanding of Technology Architecture and AI Platforms, acting as a viable resource on teams as both a hands-on practitioner and subject matter expert.
- Strategic partners. They work closely with senior client stakeholders, including C-level executives, to build hypothesis-driven solutions at the intersection of technology and business. They bridge the gap between IT and business functions, ensuring technology strategies are aligned with organizational goals to solve critical business challenges.
We are seeking Principal AI Tech Architects to design, guide, and evolve the architecture of next-generation intelligent agentic systems. This role bridges high-level system design with hands-on AI engineering - ideal for someone who can envision complex AI-enabled ecosystems while still being comfortable prototyping or coding to validate ideas. You'll work across AI, data, product, and engineering teams to define scalable architectures for AI-driven applications, enabling the seamless integration of large language models (LLMs), data pipelines, and enterprise systems.
AI Architecture & Solution Design
- Define system architectures for AI and LLM-based solutions, ensuring scalability, low-latency inference, and modularity.
- Design Agentic AI solutions to optimize business workflow automation, including the use of memory, agentic reflection, and task planning.
- Design AI integration patterns, such as RAG, for model orchestration, context management, prompt orchestration, and external system connectivity.
- Establish architectural blueprints, design principles, and governance frameworks for model versioning, data lineage and responsible AI solutions across the organization.
- Architect polyglot model runtimes and hybrid pipelines (batch training + streaming inference) with attention to cost, latency, and risk.
Prototyping & Validation
- Develop minimal viable prototypes or proof-of-concepts to test model architectures, RAG flows, and agent orchestration.
- Evaluate emerging AI frameworks and tools (e.g., LangChain, LlamaIndex, LangGraph, Strands, Google ADK, Semantic Kernel) for suitability and integration.
- Develop solutions using the latest agentic orchestration engines, such as n8n, Retool, OpenAI Agentkit, Microsoft Copilot Studio, and AWS Flows.
Implementation management and support
- Support restructuring IT processes and organization to adopt new systems.
- Oversee system performance, observability, and governance as solutions transition from prototype to production using tools such as LangSmith, Prometheus, Grafana, Evidently, WhyLogs, and OpenTelemetry.
- Optimize the application development processes - define standards for versioning, testing, and monitoring of models and AI services (LLMOps).
Communication and Collaboration
- Craft compelling narratives for Agentic reimagination of businesses, translating complex ideas for both technical and non-technical audiences.
- Deliver impactful presentations, leading modules, presenting findings, and building consensus with clients.
- Build collaboration, mentor teams, and share knowledge to drive collective success - partner with product managers, data scientists, and engineers to translate business goals into robust AI system designs.
- Facilitate technical and strategic working sessions and workshops with both client and internal teams - provide technical direction and mentorship to engineering teams on architectural patterns, scalability, and best practices.
- Provide directions on key work items and feedback to other team members.
Team Management
- Manage junior team members by defining and organizing their "module", helping them structure their work and associated analyses.
- Mentor and coach junior team members by building mutual development agreements and manufacturing opportunities for them to grow and develop along explicitly defined objectives.
- Provide quality assurance oversight - Review junior team members' output for overall correctness, level of insight, clarity, etc.
- Promote an overall positive experience for junior staff
- Serve as a role model by actively demonstrating and living BCG's Culture and Values.
Innovation and Growth
- Stay ahead of the curve on new techniques in distributed AI systems, retrieval-augmented generation (RAG), retrieval/indexing strategies, and agent frameworks.
- Drive innovation, uncovering novel ideas and transformative solutions.
- Serve as the subject matter expert on LLM integration, agentic system design, and intelligent automation frameworks.
- Foster a growth mindset, continuously learning and applying new skills to grow your impact.
- Support business development through technical proposals with clear AI/ML technology choices and roadmaps.
- Manage mid-to-senior level client relationships autonomously.
- Contribute to our thought leadership through written publications and speaking at events and conferences.
What You'll Bring
- Bachelor's degree in information technology, business administration, computer science, information systems, or system controls & engineering or a related field (Master's degree is a plus).
- 10+ years of technology consulting or software engineering experience with more than 5+ years in architecture discipline.
- Strong foundation in software architecture and distributed systems design.
- Proven experience designing or scaling AI/ML or LLM-based applications.
- Proficiency in one or more programming languages: Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
- Familiarity with modern AI frameworks (LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex).
- Understanding of Agentic AI capabilities and tools such as LangChain agents, AutoGen, multi-agent orchestration, RAG, memory modules, vector DBs, function-calling, observability, safety, deployment strategies and governance.
- Understanding of cloud architecture, data management, and API-based system integration
- Cloud platforms: AWS (Bedrock, AgentCore), Microsoft (Azure AI Foundry, Copilot Studio), Google (Vertex AI, ADK, Agentspace).
- Design and deployment of autonomous and semi-autonomous agents across multi-cloud and hybrid environments.
- Integration of agent workflows with enterprise APIs, knowledge bases, and vectorized memory stores.
- Containerization and orchestration: Docker, Kubernetes, Helm, Istio with GPU autoscaling for agentic runtime optimization.
- Experience with AI coding tools such as Cursor, Replit, Lovable, Claude code, Codex etc.
- Experience with vector databases, embeddings, context retrieval, and prompt orchestration patterns. Exposure to Pinecone, QDrant, Cosmos DB, Azure Search is a plus.
- Experience with knowledge graphs such as Neo4j and knowledge representation techniques is a plus.
- Exposure to Agentic memory engines such as mem0, Redis Memory, Postgres Memory is a plus.Outstanding ability to work creatively, autonomously, analytically, in a fast-paced problem-solving environment with a focus on customer and results.
- Superior technical knowledge, engineering rigor, and creative problem-solving.
- Ability to explain complex technology topics to senior executives.
- Ideally, experience with the below technologies:
- Multi-agent systems, RAG, or knowledge graph integration.
- MLOps / LLMOps pipelines, observability, and evaluation frameworks.
- Frontend frameworks (React, Next.js) for intelligent app interfaces.
- Consulting or innovation lab experience - comfortable with ambiguity and rapid iteration.
- An agile mindset that moves past blockers and a vision to iteratively migrate to the modern set of architecture capabilities with a lens of business benefits/value.
- Experience with the management of decision processes at large organizations.
- Strong customer and results orientation.
- Confidence and persuasiveness.
- Experience planning and managing large, complex projects.
- Willingness to travel to work with clients and BCG teams. At times, this role involves significant travel to client sites. The amount of travel will depend on client needs and nature of projects.
Additional info
- An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
- A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
FOR U.S. APPLICANTS:
The base compensation for this role is $230,000 in USD.
In addition to your base salary, you will also be eligible for an annual discretionary performance bonus and retirement contribution. BCG also provides a market leading benefits package described below.
- Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
- $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
- Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
- Vision insurance with coverage for both glasses and contact lenses annually.
- Reimbursement for gym memberships and other fitness activities.
- Fully vested retirement contributions made annually, whether you contribute or not.
- Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
- Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.
To learn more about our employee benefit please check ourBCG Benefits page.
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories wi...
What Boston Consulting Group employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Boston Consulting Group
Sourced by ZipRecruiter
Industry
Business management consulting
Company size
10,000+ Employees
Headquarters location
Boston, MA, US
Year founded
1963