Hands-on experience with prompt engineering constructing effective prompts, detecting hallucinations, and evaluating outputs across accuracy, tone, coherence, and bias dimensions. * Experience ...
Quick apply
Hands-on experience with prompt engineering constructing effective prompts, detecting hallucinations, and evaluating outputs across accuracy, tone, coherence, and bias dimensions. * Experience ...
Solid understanding of Large Language Models (LLMs) - including prompt engineering, fine-tuning, RAG (Retrieval-Augmented Generation), and agentic workflows * Hands-on experience working with LLM API ...
Solid understanding of Large Language Models (LLMs) - including prompt engineering, fine-tuning, RAG (Retrieval-Augmented Generation), and agentic workflows * Hands-on experience working with LLM API ...
Advanced prompt engineering techniques (e.g., Chain-of-Thought). * Experience designing and implementing evaluation frameworks for AI agent performance. Your Impact & Growth ???? * First 90 Days:
Quick apply
Advanced prompt engineering techniques (e.g., Chain-of-Thought). * Experience designing and implementing evaluation frameworks for AI agent performance. Your Impact & Growth ???? * First 90 Days:
Familiarity with AI-assisted development tools, Gen AI patterns, prompt engineering for delivery tasks, or AI-accelerated SDLC practices is an asset. * Strong communication skills with the ability to ...
Familiarity with AI-assisted development tools, Gen AI patterns, prompt engineering for delivery tasks, or AI-accelerated SDLC practices is an asset. * Strong communication skills with the ability to ...
Data Engineer
Montreal, QC · On-site
Promouvoir les meilleures pratiques en matiere de prompt engineering, de generation augmentee par recuperation (RAG), d'appel d'outils (tool calling), de gestion du contexte, de tests ...
Data Engineer
Montreal, QC · On-site
Promouvoir les meilleures pratiques en matiere de prompt engineering, de generation augmentee par recuperation (RAG), d'appel d'outils (tool calling), de gestion du contexte, de tests ...
Data internship, Fall 2026
Levis, QC · Hybrid
Knowledge of generative AI models and solutions (synthetic data, LLMs, prompt engineering, etc.) for advanced analytics * Knowledge of MS Office suite (especially Excel) for data governance At ...
Data internship, Fall 2026
Levis, QC · Hybrid
Knowledge of generative AI models and solutions (synthetic data, LLMs, prompt engineering, etc.) for advanced analytics * Knowledge of MS Office suite (especially Excel) for data governance At ...
Connaissance de l'ingénierie des invites (prompt engineering) et des cadres d'orchestration de grands modèles de langage (LLM). * Expérience en architecture d'entreprise ou en conception de ...
New
Quick apply
Connaissance de l'ingénierie des invites (prompt engineering) et des cadres d'orchestration de grands modèles de langage (LLM). * Expérience en architecture d'entreprise ou en conception de ...
New
Knowledge of generative AI models and solutions (synthetic data, LLMs, prompt engineering, etc.) for advanced analytics * Knowledge of MS Office suite (especially Excel) for data governance At ...
Knowledge of generative AI models and solutions (synthetic data, LLMs, prompt engineering, etc.) for advanced analytics * Knowledge of MS Office suite (especially Excel) for data governance At ...
Senior Developer (AI / ML)
Montreal, QC · On-site +1
You have hands-on experience designing and implementing modern AI systems, including LLM-based applications, prompt engineering, and retrieval-based systems. You understand how to evaluate and ...
Senior Developer (AI / ML)
Montreal, QC · On-site +1
You have hands-on experience designing and implementing modern AI systems, including LLM-based applications, prompt engineering, and retrieval-based systems. You understand how to evaluate and ...
This is a Lead Software Engineering position at Vice President level, which is part of the job ... Establish and evolve LLMOps practices, including evaluation harnesses, prompt/version management ...
This is a Lead Software Engineering position at Vice President level, which is part of the job ... Establish and evolve LLMOps practices, including evaluation harnesses, prompt/version management ...
Hands-on experience in solution design and development, including Python, REST APIs, system integration, RAG, prompt engineering, testing, version control, documentation, and deployment. * Strong ...
Hands-on experience in solution design and development, including Python, REST APIs, system integration, RAG, prompt engineering, testing, version control, documentation, and deployment. * Strong ...
Working with AI agents, prompt engineering, retrieval systems, and workflow automation. * Experience integrating AI into real-world business or creative workflows. * Strong understanding of current ...
Working with AI agents, prompt engineering, retrieval systems, and workflow automation. * Experience integrating AI into real-world business or creative workflows. * Strong understanding of current ...
Senior AI Skill builder
Kirkland, QC · On-site
Exprience avec les LLMs, le prompt engineering ou les outils AI workflows * laise dans un environnement peu structur et autonome * Forte capacit dexcution et esprit exprimental Ce que vous y gagnerez
Quick apply
Senior AI Skill builder
Kirkland, QC · On-site
Exprience avec les LLMs, le prompt engineering ou les outils AI workflows * laise dans un environnement peu structur et autonome * Forte capacit dexcution et esprit exprimental Ce que vous y gagnerez
Working with AI agents, prompt engineering, retrieval systems, and workflow automation. * Experience integrating AI into real-world business or creative workflows. * Strong understanding of current ...
Working with AI agents, prompt engineering, retrieval systems, and workflow automation. * Experience integrating AI into real-world business or creative workflows. * Strong understanding of current ...
Educational & Community Developer/ Développeur · euse pédagogique et communautaire
Montreal, QC · On-site
Create engaging learning projects that bridge traditional coding (Computational Thinking) with emerging AI concepts (Prompt Engineering, LLM fundamentals - Critical Thinking).Facilitate with Impact:
Quick apply
Educational & Community Developer/ Développeur · euse pédagogique et communautaire
Montreal, QC · On-site
Create engaging learning projects that bridge traditional coding (Computational Thinking) with emerging AI concepts (Prompt Engineering, LLM fundamentals - Critical Thinking).Facilitate with Impact:
Prompt engineering, RAG patterns, vector databases (e.g., Pinecone, pgvector, Weaviate) * AI orchestration frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel) * Solutions deployment/ cloud ...
Prompt engineering, RAG patterns, vector databases (e.g., Pinecone, pgvector, Weaviate) * AI orchestration frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel) * Solutions deployment/ cloud ...
Compréhension des enjeux liés à l'orchestration d'agents, au prompt engineering et à la performance des systèmes IA * Expérience avec les environnements cloud (AWS, GCP ou Azure) * Familiarité ...
Quick apply
Compréhension des enjeux liés à l'orchestration d'agents, au prompt engineering et à la performance des systèmes IA * Expérience avec les environnements cloud (AWS, GCP ou Azure) * Familiarité ...
Design and implement LLM-powered applications using RAG, fine-tuning, prompt engineering, structured outputs, and vector databases. * Build AI systems that securely interact with enterprise data ...
Design and implement LLM-powered applications using RAG, fine-tuning, prompt engineering, structured outputs, and vector databases. * Build AI systems that securely interact with enterprise data ...
IA generative et NLP (fine-tuning, prompt engineering, integration de modeles) * Connaissance de Python (requis), R (un atout) * Experience Databricks (contexte AI/ML, atout) * Experience en analyse ...
IA generative et NLP (fine-tuning, prompt engineering, integration de modeles) * Connaissance de Python (requis), R (un atout) * Experience Databricks (contexte AI/ML, atout) * Experience en analyse ...
Large Language Models & Generative AIDesign and implement LLM-powered applications using RAG, fine-tuning, prompt engineering, structured outputs, and vector databases.Build AI systems that securely ...
Quick apply
Large Language Models & Generative AIDesign and implement LLM-powered applications using RAG, fine-tuning, prompt engineering, structured outputs, and vector databases.Build AI systems that securely ...
Prompt Engineering information
What is a Prompt Engineering job?
A Prompt Engineering job involves designing, refining, and optimizing prompts to improve the performance of AI language models. Prompt engineers work with large language models (LLMs) to generate accurate, relevant, and high-quality responses. They experiment with different phrasing techniques, fine-tune AI outputs, and collaborate with developers to enhance model capabilities. This role is essential in ensuring AI systems provide reliable and useful responses for various applications.
What are the key skills and qualifications needed to thrive in the Prompt Engineering position, and why are they important?
To excel in Prompt Engineering, a strong grasp of natural language processing (NLP), machine learning concepts, and analytical thinking is essential, often supported by a degree in computer science or a related field. Familiarity with AI platforms, code repositories (such as GitHub), and prompt development tools is typically required. Excellent problem-solving, creativity, and cross-functional communication skills help Prompt Engineers effectively collaborate and refine model outputs. These capabilities enable the creation of precise, effective prompts driving high-quality AI responses in rapidly evolving technical environments.
What are the most common challenges faced by Prompt Engineers in their daily work?
Prompt Engineers frequently encounter challenges such as ensuring the clarity and relevance of prompts to achieve accurate AI responses, troubleshooting inconsistent model behavior, and staying updated with evolving AI technologies. Balancing experimentation with efficiency is often essential, as iterative testing and refinement are core parts of the workflow. Collaboration with data scientists, product managers, and other engineers is common, requiring adaptability and strong communication skills. These challenges make the role dynamic and rewarding for professionals who enjoy problem-solving and innovation.
What are the most commonly searched types of Prompt Engineering jobs in Quebec? The most popular types of Prompt Engineering jobs in Quebec are:
What are popular job titles related to Prompt Engineering jobs in Quebec? For Prompt Engineering jobs in Quebec, the most frequently searched job titles are:
What job categories do people searching Prompt Engineering jobs in Quebec look for? The top searched job categories for Prompt Engineering jobs in Quebec are:
Contractor
Posted 10 days ago
Job description
QA Lead AI Systems & Models Testing
Quality Assurance Artificial Intelligence Contract Position
Contract
Montreal, QC
AI / ML Testing
LLM / RAG / LangChain
ABOUT THE ROLE
We are seeking an experienced QA Lead with deep expertise in AI systems testing to join our team on a contract basis in Montreal, Qubec. This role sits at the intersection of quality engineering and artificial intelligence, requiring hands-on proficiency in LLM behavior analysis, RAG pipeline validation, and modern AI orchestration frameworks. You will own the end-to-end test strategy for complex AI products and help define quality standards in a rapidly evolving space.
MUST-HAVE SKILLS
- Proven QA leadership experience designing and executing test strategies for AI/ML systems or LLM-powered applications.
- Strong understanding of LLM internals: tokenization, embeddings, attention mechanisms, and inference behavior to anticipate and diagnose failure modes.
- Hands-on experience with prompt engineering constructing effective prompts, detecting hallucinations, and evaluating outputs across accuracy, tone, coherence, and bias dimensions.
- Experience testing RAG pipelines and knowledge base integrations, including validation of data quality and retrieval accuracy as they impact model outputs.
- Familiarity with vector database mechanics: similarity search thresholds, embedding drift, near-duplicate documents, and sparse vs. dense embeddings.
- Practical experience with LangChain and/or LangGraph able to read chain/graph construction code, identify failure points, and write test harnesses.
- Ability to validate MCP (Model Context Protocol) integration points, including tool availability and error-handling scenarios.
- Proficiency applying generative AI evaluation metrics and establishing quality thresholds appropriate for production AI systems.
- Excellent written and verbal communication in English; bilingualism (English/French) is a plus for the Montreal market.
NICE-TO-HAVE SKILLS
- Experience with bias detection and safety testing frameworks for AI systems.
- Exposure to performance and scalability testing of vector databases under high load.
- Familiarity with CI/CD pipelines for ML model deployment and automated regression testing.
- Knowledge of responsible AI principles and AI governance frameworks.
- Contributions to or experience with open-source AI testing or evaluation tooling (e.g., DeepEval, Ragas, PromptFlow).
- Background in data engineering or data quality practices relevant to AI pipeline inputs.
- Cloud platform experience (AWS, Azure, or GCP) in the context of deploying or testing AI workloads.
KEY RESPONSIBILITIES
- Lead design and execution of comprehensive test strategies across AI systems, including prompt evaluation, output quality assessment, and bias/safety analysis.
- Develop and maintain test harnesses for LangChain and LangGraph-based applications; review chain and graph construction code to proactively surface integration risks.
- Validate RAG pipeline integrity data ingestion, chunking, retrieval accuracy, and embedding consistency and define edge-case coverage for vector database interactions.
- Establish and track generative AI quality metrics and thresholds; report on model output quality across multiple evaluation dimensions.
- Collaborate with ML engineers, data scientists, and product teams to embed quality practices throughout the AI development lifecycle.
- Document test findings clearly for both technical and non-technical stakeholders.
Contract position based in Montreal, Qubec, Canada On-site / Hybrid