Ai Rag Jobs in Marshfield, MA (NOW HIRING)

At BBH, Partnership is more than a form of ownership-it's our approach to business and relationships. We know that supporting your professional and personal goals is the best way to help our clients and advance our business. We take that responsibility seriously. With a 200-year legacy and a shared passion for what's next, this is the right place to build a fulfilling career.

About Us

We are on a mission to rebuild how financial services firms create, manage, and execute their data integrations and transformations. Today that process stretches across multiple teams, tools, and handoffs - slow to build, expensive to maintain, and nearly impossible to change. We collapse it into a single AI-native platform that business users can operate without writing a ticket, while engineering teams retain the governance and security controls they require. We're growing our founding team now.

About the Role

As our AI Engineering Director, you'll help execute the AI strategy for the platform - facilitating how AI is used to help financial services create, configure, and optimize their data integrations and transformations. The AI layer is what turns a capable platform into a genuinely new category of product.

You'll work with a team of AI engineers, remain deeply hands-on technically, and work closely with the Head of Engineering to ensure the AI layer integrates cleanly with the core platform. You'll help the organization take the decisions that matter - LLM selection, agentic architecture, RAG design, evaluation frameworks, and the interaction model that defines what "AI-native" actually means when applied to financial data workflows.

The challenge here is specific: AI outputs in a financial services context need to be accurate, explainable, and auditable. Generic LLM approaches are not sufficient. You'll build something that is both intelligent and trustworthy.

Responsibilities

AI Strategy & Architecture

• Execute the AI strategy - LLM selection and management, agentic application architecture, RAG system design, prompt engineering standards, and evaluation frameworks
• Help design and implement the core AI capabilities: transformation generation from natural language, integration configuration assistance, data quality detection, and intelligent validation
• Determine where AI adds genuine value vs. where deterministic logic is more appropriate - this judgment is critical for a financial services product
• Set technical standards and foster a culture of experimentation grounded in production discipline
• Partner with the Head of Engineering and Head of Design on cross-functional AI feature development

Hands-On Development

• Remain deeply technical - architect and implement core AI features
• Build and evolve the transformation generation engine, integration suggestion system, and intelligent validation layer
• Design the AI pipeline architecture that operates reliably inside Agno-orchestrated workflows

Model Operations

• Establish evaluation, monitoring, and continuous improvement practices for production AI systems
• Build frameworks to measure AI output quality - accuracy, consistency, and user acceptance rates
• Implement production monitoring and model drift detection

Responsible AI

• Define responsible AI practices appropriate for financial services - accuracy thresholds, auditability requirements, and appropriate human-in-the-loop controls
• Ensure AI outputs are explainable to both technical and non-technical users

Requirements

Experience

• 3+ years AI/ML engineering; 5+ years in a product development environment
• Player-coach track record - has led teams while remaining deeply hands-on

Technical Skills

• Expert Python proficiency
• Deep production LLM experience - RAG pipelines, prompt engineering, agentic systems, evaluation frameworks
• Production experience with agentic frameworks - Agno strongly preferred; LangChain, LlamaIndex, or comparable also considered
• Workflow orchestration experience (Temporal, Prefect, or Airflow) - AI components must operate reliably within platform workflows
• Azure (primary) or AWS
• Vector databases and embedding systems (Pinecone, Weaviate, pgvector, or comparable)
• Active daily user of AI coding assistants - this is a cultural requirement, not just a preference

Nice to Have

• Financial services, fintech, or regulated industry background - understanding of what accuracy and auditability mean in a compliance-sensitive context
• MLOps and model deployment at scale
• Experience fine-tuning open-source LLMs for domain-specific tasks
• Publications, conference talks, or open-source AI contributions
• Experience building AI features for data tools, analytics platforms, or enterprise SaaS products

Why Join Us

Category-defining work - AI-native data integration and transformation for financial services doesn't exist yet. You'll help build it from the ground up.

Enterprise backing, startup speed - The credibility, domain expertise, and runway of an established enterprise combined with the pace of a startup. This is an unusual opportunity.

Foundational team - You'll be among the first in-house hires. You'll set architecture, culture, and standards - not inherit them.

Competitive package - Market-rate salary and comprehensive benefits. Equity is available for select roles. Poland-based team members receive private healthcare (Medicover or Luxmed), Multisport card, home office setup budget, and professional development budget.

Salary Range

MA: $210,000 - $260,000 base salary + target annual bonus

NY/NJ: $210,000 - $260,000 base salary + target annual bonus

BBH and its affiliates' compensation program includes base salary, discretionary bonuses, and profit-sharing. The anticipated base salary range(s) shown above are only for the indicated location(s) and may differ in other locations due to cost of living and labor considerations. Base salaries may vary based on factors such as skill, experience and qualification for the role. BBH's total rewards package recognizes your contributions with more than just a paycheck-providing you with benefits that enhance your experience at BBH from long-term savings, healthcare, and income protection to professional development opportunities and time off, our programs support your overall well-being.

We value diverse experiences. We value diverse experiences and transferrable skillsets. If your career hasn't followed a traditional path, includes alternative experiences, or doesn't meet every qualification or skill listed in the job description, please do go ahead and apply.

About BBH:

Brown Brothers Harriman (BBH) is a premier global financial services firm, known for premium service, specialist expertise, technology solutions and partnership approach to client management. Across Investor Services and Capital Partners, we work with an enviable roster of sophisticated clients who make BBH their first call when they are tackling their hardest challenges. Delivering for our clients and each other energizes us.

We believe that how we do our work is just as important as what we do. We are relentless problem solvers who know our best ideas come from collective debate and development-so we are never possessive about our ideas. Every day we come together as a diverse community of smart and caring people to deliver exceptional service and expert advice-creating success that lasts. No matter where you sit in the organization, everyone is empowered to contribute their ideas. BBHers can pick up the phone and call any colleague, and they are happy to help. Expanding your impact beyond your daily role is part of how we operate as trusted partners to one another.

We believe stability is a competitive advantage, but being stable means having the knowledge, skill, and discipline to evolve, often-pushing the boundaries of innovation. As a private partnership, every investment we make is in the relationships, technologies, products and development we believe are in the long-term interests of our clients and our people. Our long-tenured leaders are experts in their areas and are actively involved in the day-to day business, taking the time to provide guidance and mentoring to build the next generation of BBHers. Because we know, our success begins with yours.

Go to BBH.com to learn more about our rewards and benefits, philanthropy, approach to sustainability or how we support you to thrive personally, physically and financially.