OR · On-site
$103K - $139K/yr
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment * Manage integration workstreams, including project ...
OR · On-site
$103K - $139K/yr
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment * Manage integration workstreams, including project ...
OR · On-site
$103K - $139K/yr
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment * Manage integration workstreams, including project ...
$103K - $139K/yr
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment * Manage integration workstreams, including project ...
$103K - $139K/yr
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment * Manage integration workstreams, including project ...
OR · On-site
Experience designing evaluation frameworks for LLM or generative AI features * Proven experience designing and analyzing experiments (A/B testing, feature rollouts, behavioral studies) * Master's or ...
OR · On-site +1
Drive a culture of testing, iterating, and scaling processes, ensuring that all workflows are ... Deep understanding of how LLMs, Generative AI workflows, and multi-modal data structures (video ...
OR · On-site +1
Drive a culture of testing, iterating, and scaling processes, ensuring that all workflows are ... Deep understanding of how LLMs, Generative AI workflows, and multi-modal data structures (video ...
$62.74/hr
Collaborate with a team of CG and Generative AI experts to develop unique content for animated ... Experiment with and evaluate the latest generative tooling and be open to testing new technology ...
$104K - $142K/yr
You will design, scale, and deploy generative AI (GenAI) and Large Language Model (LLM) agentic ... Own and advance technical solutions from concept to deployment, pressure-testing assumptions and ...
OR · Remote
$134K - $180K/yr
We are building with generative AI as a core capability from day one, both in the customer ... testing, and operational rigor. Minimum Qualifications * Bachelor's degree in Computer Science ...
OR · Remote
$134K - $180K/yr
We are building with generative AI as a core capability from day one, both in the customer ... testing, and operational rigor. Minimum Qualifications * Bachelor's degree in Computer Science ...
$140K - $170K/yr
... of agentic and generative AI products. In this role, you'll be the connective tissue between ... testing and iterating based on what's actually moving deals. How You'll Make Impact * Product ...
$140K - $170K/yr
... of agentic and generative AI products. In this role, you'll be the connective tissue between ... testing and iterating based on what's actually moving deals. How You'll Make Impact * Product ...
OR · On-site
$114K - $137K/yr
Support demonstrations, pilots, proofs of value, testing, deployment readiness, and user acceptance ... Applied experience with machine learning, generative AI, large language models, retrieval-augmented ...
OR · On-site
$114K - $137K/yr
Support demonstrations, pilots, proofs of value, testing, deployment readiness, and user acceptance ... Applied experience with machine learning, generative AI, large language models, retrieval-augmented ...
Develop and apply generative AI, large language model, and agentic methods for building research applications, including support for data preparation, testing, and technical evaluation. * Develop and ...
Develop and apply generative AI, large language model, and agentic methods for building research applications, including support for data preparation, testing, and technical evaluation. * Develop and ...
... and develop generative AI-enabled explainability features that make ouputs transparent and ... Conduct rigorous testing of algorithm performance, pipeline reliability, and API behavior to ensure ...
... and develop generative AI-enabled explainability features that make ouputs transparent and ... Conduct rigorous testing of algorithm performance, pipeline reliability, and API behavior to ensure ...
OR · On-site
Assess generative AI applications for response quality, grounding, relevance, consistency, and ... Perform model validation, testing, and performance assessments prior to production deployment.
OR · On-site
Assess generative AI applications for response quality, grounding, relevance, consistency, and ... Perform model validation, testing, and performance assessments prior to production deployment.
OR · On-site
... testing, knowledge graphs, and policyaware routing into accessible, outcomeoriented stories for ... Deep understanding of the progression from predictive analytics generative AI agentic AI and ...
OR · On-site
... testing, knowledge graphs, and policyaware routing into accessible, outcomeoriented stories for ... Deep understanding of the progression from predictive analytics generative AI agentic AI and ...
OR · On-site
Strong judgment on when to apply traditional ML vs. generative AI and the trade-offs involved ... Structured AI evaluation methods (offline/online testing, human-in-the-loop); computer vision ...
OR · On-site
Strong judgment on when to apply traditional ML vs. generative AI and the trade-offs involved ... Structured AI evaluation methods (offline/online testing, human-in-the-loop); computer vision ...
$63 - $83/hr
... Generative AI. The vision of the NVAIE Segment team is to use our deep expertise to guide and ... Expertise in building evaluation harnesses, success metrics, automated testing pipelines, and ...
OR · On-site
$73K - $244K/yr
The Opportunity As part of the People Tech & AI team you will lead teams delivering governed Generative AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ...
Portland, OR · On-site
$73K - $244K/yr
The Opportunity As part of the People Tech & AI team you will lead teams delivering governed Generative AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ...
Portland, OR · On-site
$73K - $244K/yr
The Opportunity As part of the People Tech & AI team you will lead teams delivering governed Generative AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ...
... generative, agentic, autonomous, embedded, and third-party AI. - Ensure AI use cases are ... Risk Assessment, Monitoring & Issue Management: - Oversee AI testing, monitoring, and metrics ...
... generative, agentic, autonomous, embedded, and third-party AI. - Ensure AI use cases are ... Risk Assessment, Monitoring & Issue Management: - Oversee AI testing, monitoring, and metrics ...
OR · Remote
This role focuses on evaluating LLMs and agentic systems, developing robust testing methodologies ... Build, validate, and optimize data models focused on generative AI and large language models.
OR · Remote
This role focuses on evaluating LLMs and agentic systems, developing robust testing methodologies ... Build, validate, and optimize data models focused on generative AI and large language models.
OR · On-site
... generative AI in robotics.This is the era of Physical AI, where intelligent machines can learn ... loop testing, AI enhanced manipulation workflows using NVIDIA's Isaac Lab, Isaac Sim, Newton ...
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

$103K - $139K/yr
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 10 days ago
8.8
Based on 23 frontline employees who took The Breakroom Quiz
31st of 186 rated software companies
The Opportunity
As a Lead Configuration & Integration Engineer, Customer Services at Brightflag, you will play a critical role within our Professional Services team, owning the end-to-end delivery of integrations between Brightflag and customer systems. This is a full-stack, customer-facing role that spans project management, requirements gathering, solution design, implementation, testing, and delivery. This is not a traditional solutions or integrations role; you will be directly contributing to how Brightflag evolves from a code-driven integration model to an AI-accelerated delivery engine. If you're someone who can both build integrations today and reimagine how they should be built tomorrow, this role gives you a chance to have outsized impact.
You will work directly with both technical and non-technical stakeholders to understand business needs, design scalable integration solutions, and deliver high-quality outcomes. You'll be responsible not only for defining what should be built, but also for building it-leveraging existing APIs, data transformations, and increasingly, generative AI tools.
This role sits at the center of a major transition in how we deliver integrations. Today, we rely on a mix of custom code and internal tooling. We are moving rapidly toward an AI-assisted model using tools such as Claude Code and OpenAI Codex. You will be expected to operate effectively in both worlds-bringing hands-on experience with traditional integration development while helping us evolve toward faster, more scalable, AI-driven delivery.
Success in this role requires strong ownership, technical depth, excellent communication skills, and a mindset focused on continuous improvement-helping us not just deliver integrations, but transform how we deliver them.
What You Will Be DoingOwn the end-to-end lifecycle of customer integrations, from discovery through delivery and post-go-live hypercare
Lead requirements gathering and solution design sessions with both technical and business stakeholders
Translate business requirements into technical designs, including data mappings, API interactions, workflows, and validation rules
Design, build, test, and deploy integrations between Brightflag and third-party systems (e.g., Accounts Payable, ERP)
Write and maintain custom code, scripts, or transformations where needed to support integration logic
Use generative AI tools (e.g., Codex, Claude Code) to accelerate development, testing, and documentation-while applying sound technical judgment
Manage integration workstreams, including project planning, stakeholder coordination, timelines, and delivery tracking
Develop and execute test plans, support UAT, and ensure integrations meet performance, reliability, and data integrity standards
Troubleshoot and resolve integration issues, identifying root causes across systems and APIs
Partner closely with Product and Engineering teams to improve integration patterns, tooling, and platform capabilities
Help define and evolve Brightflag's integration methodology, including templates, standards, and best practices
Identify opportunities to increase efficiency through automation and AI-assisted workflows
To be successful in this role, you need:
5+ years of experience delivering API-based integrations in a customer-facing or solutions engineering role
Hands-on experience with integration implementation, including coding, scripting, or configuring integrations-not just design
Strong understanding of REST APIs, JSON/XML, authentication methods (OAuth, API keys, etc.), and common integration patterns
Experience translating requirements into data mappings, workflows, and technical specifications
Proven ability to manage projects end-to-end, including stakeholder communication and timeline ownership
Experience working directly with customers, with the ability to explain technical concepts in clear, business-friendly language
Experience with traditional integration development approaches (custom code, scripts, internal tools)
Familiarity or hands-on experience with generative AI coding tools (e.g., GitHub Copilot, Codex, Claude Code) and an interest in applying them to real-world delivery
Strong problem-solving skills and the ability to debug complex, cross-system issues
The following are a bonus!
Experience integrating with financial or Accounts Payable systems (e.g., NetSuite, SAP, Oracle, Coupa)
Familiarity with integration platforms or middleware (e.g., MuleSoft, Boomi)
Experience with API testing/documentation tools (e.g., Postman, Swagger)
Proficiency in a programming language such as Python, JavaScript, or Java
Experience working in Agile environments and using tools like Jira or Asana
Life @ Brightflag
We're growing fast and so is the experience we can offer you:
A huge opportunity to make a real impact, to shape what we do and where we are going.
The exposure and challenge you need to learn, grow and progress your career in a high growth environment.
Complex technical and business problems to solve and the trust and autonomy you need to go and solve them.
A sound, helpful team, in a friendly, values-driven and inclusive environment.
Competitive salary with base of $150,000 USD plus bonus
401(k) plan with company match.
Comprehensive health insurance, life insurance and long term illness/income protection.
Fully flexible work location and work patterns so you can balance life at home with life at work - come to the office, work at home... or enjoy a blend of both at your discretion.
We are a diverse and inclusive bunch of people. We welcome diverse perspectives and people who make every day count and strive for constant improvement. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.
Location & Eligibility
This role offers flexible working arrangements. You can work on a hybrid schedule with 2-3 days per week in our New York office, or remote on Eastern or Central Time Zones in the US, you choose what works best for your lifestyle. New York or Chicago locations are strongly preferred.
Your time is valuable. To help with your application, we advise that regrettably we cannot offer work permit sponsorship/ self sponsorship for this role.
About Brightflag
Hi, we're Brightflag, the AI-powered, enterprise legal management platform that helps corporate legal departments operate with greater clarity, efficiency, and control.
Powered by our patented AI, which was developed with over 100,000 hours of legal and engineering expertise, and supported by our best-in-class Customer Success teams, Brightflag enables in-house legal teams to streamline operations, manage matters and spend, and collaborate more effectively with outside counsel.
Today, Brightflag is trusted by leading global organizations and forms part of the Legal & Regulatory division of Wolters Kluwer, a global provider of professional information, software solutions, and services. You can learn more about Brightflag here.
Our Interview PracticesTo maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we're getting to know you-not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.
Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.
Compensation:
$89,600.00 - $157,000.00 USDThis role is eligible for Bonus.Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process.
Additional Information:Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.
Get the full story on Breakroom