Entrylevel Retrieval Augmented Generation Jobs in Toronto, ON

Putting people first, every day

BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. In turn, we offer an award-winning environment that fosters apeople-first culturewith a high priority on your personal and professional growth.

Your Opportunity

We are seeking an experienced AI Engineer with a strong foundation in software engineering and a proven track record of building Generative and Agentic AI solutions. This new role is ideal for someone who thrives at the intersection of software development, applied AI research, and practical solution design. You will be responsible for designing, implementing, and deploying production-grade AI systems that leverage the latest in large language models (LLMs), orchestration frameworks, and agentic architectures.

Key Responsibilities

• Design & Development
  • Build scalable and robust AI-driven applications using LLMs and agentic frameworks.
  • Implement vector database solutions to enable semantic search, RAG (retrieval augmented generation), and knowledge management.
  • Develop orchestration pipelines with frameworks like LangChain, Semantic Kernel, AutoGen, or emerging agentic frameworks such as Agno and Parlant.
• Automation & Integration
  • Integrate workflow automation platforms (n8n, dify.ai Power Automate, etc.) with AI systems to deliver end-to-end business solutions.
  • Ensure seamless integration with existing enterprise software ecosystems and APIs.
• Quality & Evaluation
  • Apply or contribute to LLM evaluation methodologies, leveraging platforms like Arize, DeepEval, or IBM WatsonX for model benchmarking, monitoring, and continuous improvement.
  • Establish best practices for testing, performance tuning, and evaluation of agentic/LLM-based workflows.
• Collaboration & Delivery
  • Work closely with cross-functional teams including data scientists, software engineers, and product owners.
  • Translate business requirements into technical designs and deliver working AI-powered applications in production environments.

Required Skills & Qualifications

• Strong background in software engineering (e.g., system design, distributed systems, APIs, CI/CD).
• Proven experience in building Generative AI and/or agentic systems.
• Hands-on expertise with:
  • LLMs and model fine-tuning or integration.
  • Vector databases (e.g., Pinecone, Weaviate, Milvus, FAISS, etc.).
  • LLM orchestration frameworks (LangChain, Semantic Kernel, AutoGen, etc.).
  • Agentic frameworks (Pydantic AI, Agno, Parlant, or similar).
• Proficiency in at least one major programming language such as Python or .NET (strong engineering fundamentals matter more than specific syntax).
• Hands-on experience architecting, deploying, and operating cloud-native solutions on one or more major hyperscale platforms (Azure, AWS, or GCP)
• Experience with workflow automation tools like n8n, dify.ai, Power Automate, or similar platforms.

Nice-to-Have Skills

• Familiarity with LLM evaluation frameworks (Arize, DeepEval, IBM WatsonX).
• Contributions to open-source AI frameworks or communities.
• Experience in MLOps, monitoring, and model deployment pipelines.

Who You Are

• A problem-solver with strong engineering rigor and curiosity for cutting-edge AI.
• Comfortable moving between architecture, coding, and deployment.
• Passionate about transforming abstract business needs into intelligent, production-ready systems.

Salary range for this role is between $84,000 and $128,000.

Why BDO?
Our people-first approach to talent has earned us a spot among Canada's Top 100 Employers for 2026. This recognition is a milestone we're thrilled to add to our collection of awards for both experienced and student talent experiences.

At BDO, our people experience is guided by three core pillars-Do work with genuine care, Do what matters with purpose, and Do what's next - shaping how we support our people, serve our clients, and grow together.

Our firm is committed to providing an environment where you can be successful in the following ways:

• We enable you to engage with how we change and evolve, being a key contributor to the success and growth of BDO in Canada.
• We help you become a better professional within our services, industries, and markets with extensive opportunities for learning and development.
• We support your achievement of personal goals outside of the office and making an impact on your community.
• We foster a collaborative, inclusive environment where your ideas are valued, and you can do your best work with genuine care and purpose
• We encourage innovation and forward thinking, empowering you to embrace what's next and help shape the future of our firm

Giving back adds up:Where company meets community.BDO is actively involved in our communities by supporting local charity initiatives. We support staff with local and national events where you will be given the opportunity to contribute to your community.

Total rewards that matter: We pay for performance with competitive total cash compensation that recognizes and rewards your contribution. We provide comprehensive benefits from day one, and a flexible personal time off policy. We're committed to supporting your overall wellbeing and provide reimbursement for wellness initiatives that fit your lifestyle.

Everyone counts: We are committed to creating a workplace where employees can participate fully, contribute meaningfully and succeed without barriers. We are dedicated to fostering a workplace defined by respect, fairness, and a true sense of belonging for everyone. We recognize and celebrate the unique experiences, identities, and perspectives that each of us bring - and that these experiences strengthen how we work together. Our commitment extends to ensuring that our application process is both inclusive and accessible. If you require accommodation to complete the application process, please contact us.

Flexibility: All BDO personnel are expected to spend some of their time working in the office, at the client site, and virtually unless accommodations or alternative work arrangements are in place.

Our model is a blended approach designed to support the flexible needs of our people, the firm and our clients. It's about creating work experiences that meet everyone's needs and providing flexibility to adjust when, where and how we work to meet the expectations of our role.

Code of Conduct: Our Code of Conduct sets clear standards for how we conduct business. It reflects our shared values and commitments and includes guiding principles to help us make ethical decisions and maintain trust with each other, our clients, and the public.

BDO may use artificial intelligence enabled tools to support certain aspects of the recruitment process. While these tools assist our teams, our use of AI does not replace human decision making, and all employment-related outcomes are made by BDO personnel.

More information on BDO Canada's Privacy Policy can be found here:

Privacy Policy | BDO Canada

Ready to make your mark at BDO? Click "Apply now" to send your up-to-date resume to one of our Talent Acquisition Specialists.

To explore other opportunities at BDO, check out ourcareers page.

#LI-MM1