Prompt Engineer Jobs in Watertown, CT (NOW HIRING)

Job Summary:
Dassault Systèmes is seeking a Quality Engineer for their ENOVIA brand, which provides leading enterprise collaboration applications across various industries. The role involves ensuring the quality delivery of applications by validating client fix packs, executing testing scenarios, and collaborating with developers and consultants in an agile environment.
Responsibilities:
• Validate Specification of new functionalities: ensure their completion and compliancy with DS standards
• Define functional testing scenarios: Use cases (customer scenarios) corresponding to functionalities to be tested.
• Strong understanding of testing principles, methodologies, and test case design
• Define scenarios based on Industrialization Strategy and Function Specifications
• Identify and qualify bugs and non-conformity areas within specification requirements.
• Execute testing: Run defined scenarios (acceptance, convergence & non regression)
• On Premise and CLOUD environments
• Mobile
• Understanding our Automation Framework and Developer environment
• Authoring and executing software test automation scripts using JavaScript
• Manage and Publish Test results
• Participate in GO/NOGO according to the DS defined Gates
• Define recovery plans with development teams
• Escalate issues and priority arbitration to stakeholders and management
• Document issues through Incident Reports (IRs) raised to the development teams for resolutions
• Constant follow-up on critical issues and ensure closure
• Understanding and testing of AI/ML based applications
• Develop and execute detailed test plans to assess AI algorithms, data quality, and system performance.
• Monitor and control testing process: steer in details QA activities for overall quality improvement
• Capitalize on feedbacks from the incidents reported by customers to continuously improve testing process (content and efficiency)
• Plan convergence and non-regression tests according to the targeted GA (final delivery) date and Define Industrialization plan:
• Compilation and arbitration between all scenarios.
• Necessary time and resources for testing
• Organization of activities between all the Development and Operations cycle gates
• Optimization of QA costs
• Focus efforts on automation and testing strategies for Continuous Integration
• Cover broad spectrum of tests including functional, UI, API and more along with regression tests to ensure a comprehensive test coverage
• A fast learner and highly motivated individual who is keen to take ownership
• Excellent communication skills, both oral and written
• Continually looking for ways to improve
• Desire to work in a collaborative team environment
• Strong critical thinking skills and organizational skills
• Work with cross-functional and multi geo teams.
Qualifications:
Required:
• Bachelor’s degree (Computer Science or related field)
• 2–5 years in software QA with enterprise-level products
• QA automation tools (e.g., Selenium, SAHI)
• Agentic AI, LLM & Advanced QA Capabilities
• Strong understanding of Transformer-based LLMs, Prompt Engineering, Retrieval-Augmented Generation (RAG), Function/Tool Calling, Multi-Agent Systems, Agent Planning & Reasoning Workflows, and Memory Architectures.
• Experience validating Agentic AI applications through scenario-based testing, adversarial testing, edge-case identification, and failure-mode analysis.
• Conduct hallucination testing, prompt injection validation, jailbreak detection, memory corruption testing, and tool-selection accuracy assessments.
• Design and execute AI evaluation frameworks using benchmark datasets, ground-truth validation, human evaluation methods, and LLM-as-a-Judge approaches.
• Validate agent workflows, reasoning chains, tool-calling accuracy, and multi-step decision-making processes.
• Experience with LangChain, LangGraph, OpenAI APIs, and Azure OpenAI services.
• Perform A/B testing, benchmarking, statistical analysis, and model comparison studies to measure improvements in accuracy, hallucination reduction, and tool-use effectiveness.
• Strong expertise in Python, SQL, API Testing, Log Analysis, CI/CD Automation, REST APIs, JSON, Authentication, and Test Case Design.
Company:
Dassault Systèmes is a catalyst for human progress. Founded in 1981, the company is headquartered in Vélizy-villacoublay, FRA, with a team of 10001+ employees. The company is currently Late Stage.