ZipRecruiter

Log In

1

Ab Testing Developer Jobs (NOW HIRING)

AllyNd Partners

Sr. Data Scientist

New York, NY · Remote

Lead model validation, AB testing, and drift monitoring * Collaborate with data engineers and product managers on model-driven features * Contribute to data governance and regulatory compliance ...

Staffingine LLC

Architect

Phoenix, AZ · On-site

Collaborate with cross functional teams marketing data and engineering to translate business ... Perform unit testing UAT and AB testing within journeys to ensure optimal performance * Monitor ...

Scribd, Inc.

Senior Product Manager

$129K - $170K/yr

... engineering, design, sales, marketing, and executive stakeholders on strategy, roadmap ... g., AB testing and data analytics) and qualitative (e.g., user testing, interviews) research ...

USM

Ab Initio Tester

Washington, DC · On-site

Must have a minimum of 8 years of experience in testing AB Initio, ETL and BI applications with ... testing using SOAPUI or other equivalent tools. Experience using scripting and programming ...

Stem Xpert

Senior Ab Initio Consultants

Atlanta, GA

... engineering and systems integration. Our tightly integrated offerings are tailored to each clients ... Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure ...

AB Dynamics

Product Engineer

Torrance, CA · On-site

$70K - $95K/yr

Develops and executes testing plans for the products to ensure durability, performance ... We are part of the FTSE-listed UK company AB Dynamics Group. As an innovative and dynamic company ...

AB Dynamics

Product Engineer

Torrance, CA

About AB Dynamics AB Dynamics is one of the world's leading specialists in automotive test systems ... Develops and executes testing plans for the products to ensure durability, performance ...

next page

Showing results 1-20

All JobsAb Testing Developer Jobs

Ab Testing Developer information

See salary details

$13

$49

$88

How much do ab testing developer jobs pay per hour?

As of Jul 11, 2026, the average hourly pay for ab testing developer in the United States is $49.33, according to ZipRecruiter salary data. Most workers in this role earn between $26.44 and $67.31 per hour, depending on experience, location, and employer.

What is AB testing in coding?

An AB Testing Developer designs and implements experiments to compare two or more versions of a webpage or app feature to determine which performs better. This process involves coding, data analysis, and tools like analytics platforms to optimize user experience and conversion rates.

What jobs make $3,000 a month without a degree?

An A/B Testing Developer can earn around $3,000 or more per month, especially with experience in data analysis, programming, and familiarity with testing tools like Optimizely or VWO. Many roles in digital marketing, sales, or technical support also offer such salaries without requiring a degree, often emphasizing skills, certifications, or on-the-job training.

What is an AB Testing Developer?

An AB Testing Developer is a professional who designs, implements, and analyzes A/B tests to optimize websites, applications, or digital products. They work closely with product, design, and marketing teams to develop experiments that compare different versions of a webpage or feature to determine which performs better. Their responsibilities often include setting up test variants, ensuring accurate data collection, and interpreting results to provide actionable insights. AB Testing Developers typically have skills in programming, data analysis, and experimentation methodologies.

What are the key skills and qualifications needed to thrive as an AB Testing Developer, and why are they important?

To thrive as an AB Testing Developer, you need a solid background in web development, statistics, and data analysis, often supported by experience with JavaScript, HTML/CSS, and a relevant degree. Familiarity with AB testing platforms like Optimizely, Google Optimize, or Adobe Target, as well as analytics tools such as Google Analytics, is typically required. Strong problem-solving skills, attention to detail, and clear communication help you translate business goals into effective experiments and actionable insights. These skills and qualities are crucial for designing reliable tests, interpreting results accurately, and driving continuous optimization of digital experiences.

What are some common challenges faced by an AB Testing Developer when collaborating with cross-functional teams?

As an AB Testing Developer, a common challenge is ensuring clear communication between technical and non-technical team members, such as marketers, designers, and product managers. Translating business goals into precise test requirements and making sure that all stakeholders understand the testing process and results can be complex. Additionally, aligning priorities and timelines across departments while maintaining data integrity and minimizing disruptions to the user experience are frequent hurdles. Effective documentation and regular updates help facilitate smoother collaboration and successful test implementation.

What is the difference between Ab Testing Developer vs Data Analyst?

AspectAb Testing DeveloperData Analyst
Primary FocusDesigning and implementing A/B tests to optimize digital productsAnalyzing data to identify trends and support business decisions
Skills & CertificationsHTML, CSS, JavaScript, A/B testing tools, basic analyticsSQL, Excel, statistical analysis, data visualization
Work EnvironmentDigital marketing teams, product teams, e-commerceBusiness intelligence, marketing, finance, operations

While both roles involve data and analytics, an Ab Testing Developer specializes in creating and executing A/B tests to improve user experience and conversion rates. A Data Analyst focuses on interpreting data across various business functions to inform strategic decisions. The roles often collaborate but serve different core purposes within organizations.

Is software testing a good career?

Software testing, including roles like A/B Testing Developer, is a viable career with demand in industries focused on digital products and user experience. It involves skills in testing tools, scripting, and understanding user behavior, often requiring certifications or experience with automation and data analysis. The field offers opportunities for growth into quality assurance, automation, and product management roles.

Are there any legit product testing jobs?

Product testing jobs, including roles like A/B testing developers, are legitimate opportunities that involve analyzing user data and optimizing digital experiences. These positions often require skills in data analysis, familiarity with testing tools, and sometimes certifications in analytics or user experience. Job seekers should verify the employer's credibility and avoid offers that seem suspicious or require upfront payments.
More about Ab Testing Developer jobs
What cities are hiring for Ab Testing Developer jobs? Cities with the most Ab Testing Developer job openings:
What states have the most Ab Testing Developer jobs? States with the most job openings for Ab Testing Developer jobs include:
What job categories do people searching Ab Testing Developer jobs look for? The top searched job categories for Ab Testing Developer jobs are:
Ab Testing Developer jobs near you
Infographic showing various Ab Testing Developer job openings in the United States as of July 2026, with employment types broken down into 71% Full Time, and 29% Contract. Highlights an 86% In-person, and 14% Hybrid job distribution, with an average salary of $102,607 per year, or $49.3 per hour.
Principal AI Engineer - Agentic Systems and LLM Platforms

Principal AI Engineer - Agentic Systems and LLM Platforms

TMS

Irvine, CA • On-site

Contractor

Posted 14 days ago

Job description

Role: Principal AI Engineer – Agentic Systems & LLM Platforms 
Duration: 6+ Months C2H
Location: Irvine, CA (Hybrid)
 
 
Job Summary:
 
Required Qualifications:
 
Must Have:
Strong software engineering fundamentals and proficiency in Python plus Java Go TypeScript is a strong plus
Experience of working with Codex.
Proven experience building LLM powered applications in production tool calling function, calling structured outputs retrieval and evaluation.
Experience designing distributed systems and APIs REST, RPC plus event driven patterns Kafka, SQS, Pub Sub.
Solid understanding of data engineering basics SQL data modeling feature engineering and data quality
Handson knowledge of cloud platforms AWS or Azure or GCP containers, Docker and orchestration Kubernetes preferred.
Ability to write clean testable secure code comfortable with code reviews and engineering rigor
Experience with multiagent systems planning verification and autonomous workflow execution
Experience with vector databases hybrid search and knowledge graphs
Familiarity with model evaluation offline evals golden datasets adversarial testing regression harnesses and AB testing.
 
Technical Skills:
Agent frameworks Lang Graph Semantic Kernel similar orchestration frameworks or equivalent custom implementations
RAG tooling embedding pipelines hybrid retrieval reranking chunking strategies citation provenance
Observability Open Telemetry structured logging dashboards alerting
Data systems OLTP analytics warehouses lakes streaming pipelines feature stores optional
Testing unit integration tests for tools replay tests for agent traces eval harnesses for LLM outputs
 
Key Responsibilities:
1. Agentic AI System Design Engineering
Design and implement agent architectures planner executor tool using agents multiagent orchestration reflection evaluation loops.
Build tooling integrations for agents merchant systems underwriting platforms transaction stores risk engines CRM case tools knowledge bases and workflow engines.
Implement robust state management session memory task plans provenance traceability and replay ability of agent actions
 
2. LLM RAG Engineering for Payments Workloads
Develop RAG pipelines over policies SOPs card network rules underwriting guidelines dispute playbooks and merchant agreements.
Apply prompt and system design structured output patterns and schema validation for deterministic agent behaviour.
Optimize for latency cost and reliability using caching model routing and evaluation driven prompt iteration.
 
3. ML Decisioning Integration
Combine LLM agents with classical ML models fraud scoring anomaly detection risk scoring and rules engines.
Build feedback loops from outcomes chargeback win rate false positives approval uplift to continuously improve models and agent strategies.
 
4. Safety Compliance and Responsible AI
Implement guardrails PII handling policy enforcement prompt injection defences tool per missioning rate limiting and safe failover.
Ensure auditability why an agent took action evidence used and human approval where required humanintheloop.
 
5. Productionization MLOps LLMOps
Build CICD for agent services evaluation suites telemetry drift detection and incident response playbooks.
Instrument agent behavior using tracing spans structured logs and metrics task success tool errors hallucination indicators
 
6. Collaboration Leadership
Partner with Product Risk Ops Underwriting Compliance and Engineering to convert business problems into deployable AI solutions.
Mentor engineers set standards for agent design patterns testing and production readiness.