Experimentation Jobs

60 Experimentation Jobs Jobs Hiring Near You

LaunchDarkly's Experimentation team is building one of the company's most strategic product areas: a platform that helps leading engineering organizations move beyond intuition and make product ...

LaunchDarkly's Experimentation team is building one of the company's most strategic product areas: a platform that helps leading engineering organizations move beyond intuition and make product ...

Reporting to the Experimentation Manager, this role will help to accelerate the speed of learning while maintaining standardization of processes across teams. The Data Scientist will partner with ...

Core One is seeking a Junior Experimentation Analyst to support the program. This position requires an active TS/SCI clearance . Roles & Responsibilities: * Lead and support experimentation ...

Reporting to the Experimentation Manager, this role will help to accelerate the speed of learning while maintaining standardization of processes across teams. The Data Scientist will partner with ...

Experimentation Product Owner

Chicago, IL · On-site

$112K - $183K/yr

Working alongside the Experimentation Product Manager, this role is responsible for managing the testing backlog, coordinating implementation efforts, and ensuring the successful execution of A/B ...

$113 - $183/hr

Working alongside the Experimentation Product Manager, this role is responsible for managing the testing backlog, coordinating implementation efforts, and ensuring the successful execution of A/B ...

Core One is seeking a Junior Experimentation Analyst to support the program. This position requires an active TS/SCI clearance . Roles & Responsibilities: * Lead and support experimentation ...

$78 - $106/hr

Experimentation & Proactive A/B Testing Own the complete experimentation lifecycle: opportunity identification, hypothesis development, prioritization, test design, implementation, QA, launch ...

$163 - $224/hr

LaunchDarkly's Experimentation team is building one of the company's most strategic product areas: a platform that helps leading engineering organizations move beyond intuition and make product ...

$78 - $176/hr

You Have: 8+ years of experience in Joint or Service experimentation, including operations planning, exercise execution, data collection, and analysis support Nice If You Have: Experience with ...

New

Showing results 41-60

Data Scientist, Core Experimentation

OpenAI

Los Angeles, CA • On-site

$293 - $325/hr

Other

Re-posted yesterday


Key responsibilities

  • Drive the statistical direction and technical strategy for OpenAI's experimentation platform.

  • Design and improve experimentation methodologies used across product and research teams.

  • Lead investigations into complex experimentation anomalies and measurement failures.


Job description

About the Team

The Statsig team at OpenAI builds and operates the experimentation platform that powers product development, measurement, and decision-making across the company. We partner closely with product, engineering, and infrastructure teams to ensure experiments are trustworthy, statistically rigorous, and scalable to the needs of frontier AI products.

Our mission is to help teams make better decisions through reliable experimentation. We care deeply about statistical correctness, pragmatic solutions, and building systems that researchers and engineers can trust at massive scale. The team operates at the intersection of experimentation methodology, data infrastructure, causal inference, and product analytics.

We are looking for experienced experimentation experts who want to shape the future of experimentation in the AI era.

About the Role

We are hiring a Staff‑level Data Scientist to lead the evolution of OpenAI’s core experimentation platform. This role focuses on improving the statistical rigor, reliability, and practical usability of experimentation across the company.

You’ll tackle hard problems in online experimentation: sample ratio mismatch detection, variance reduction, bias mitigation, metric design, triggered analysis, heterogeneous treatment effect analysis, sequential testing, and experimentation in complex ML systems. You’ll also translate advanced statistical concepts into pragmatic systems and product experiences that teams can actually use.

This is a highly technical individual contributor role with significant influence across methodology, platform architecture, and experimentation best practices. The ideal candidate combines deep statistical expertise with strong systems intuition and hands‑on experience building or operating experimentation platforms at scale.

In this role, you will:
  • Drive the statistical direction and technical strategy for OpenAI’s experimentation platform.
  • Design and improve experimentation methodologies used across product and research teams.
  • Build pragmatic solutions to real‑world experimentation challenges, balancing rigor with operational simplicity.
  • Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures.
  • Develop scalable analytical systems and pipelines in Python and distributed compute environments.
  • Partner with engineers and product teams to improve experiment design, metric quality, and decision‑making practices.
  • Lead investigations into complex experimentation anomalies and measurement failures.
  • Establish best practices for experimentation governance, interpretation, and statistical correctness.
  • Mentor other data scientists and raise the overall technical bar for experimentation and causal inference.
You might thrive in this role if you have:
  • Experience building, scaling, or operating experimentation platforms at a large technology company.
  • Deep expertise in statistics, causal inference, and online experimentation methodology.
  • Strong understanding of practical experimentation challenges in production systems.
  • Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects.
  • Strong coding and systems skills in Python and large‑scale data processing frameworks (e.g., Spark).
  • Experience designing analytical data models and scalable experimentation pipelines.
  • Ability to communicate complex statistical concepts clearly to technical and non‑technical audiences.
  • Track record of influencing technical strategy through hands‑on technical leadership.
  • Experience in large‑scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high‑scale experimentation domains is highly valued.
Workplace & Location

This role is based in Bellevue. We use a hybrid work model and value in‑person collaboration for technical design, iteration, and cross‑functional partnership.

Compensation Range

$293K – $325K USD.

Equal Employment Opportunity

OpenAI is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

#J-18808-Ljbffr