Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Ads AI Analytics Lead II
OR · Remote
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... Remote
Ads AI Analytics Lead II
OR · Remote
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... Remote
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work in a fast-paced environment * Excellent online research skills * Reliable computer system and ...
Quick apply
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work in a fast-paced environment * Excellent online research skills * Reliable computer system and ...
Senior Product Manager, Ads Quality
$129K - $170K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Senior Product Manager, Ads Quality
$129K - $170K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... This role is remote and the base pay range for a successful candidate is dependent on their ...
US remote-friendly Reddit has a flexible first workforce. At Reddit we continue to grow our teams ... Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ...
US remote-friendly Reddit has a flexible first workforce. At Reddit we continue to grow our teams ... Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ...
Senior Product Manager, Ads Quality
OR · Remote
$126K - $166K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... Remote
Senior Product Manager, Ads Quality
OR · Remote
$126K - $166K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... Remote
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * Technical Domain ...
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * Technical Domain ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
San Francisco, CA · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
San Francisco, CA · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Senior Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States)
San Francisco, CA · Remote
$123K - $169K/yr
This opportunity is fully remote and does not require you to be located in any particular state ... evaluation. * A Bachelor's Degree or an equivalent work experience is required What you'll get:
Senior Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States)
San Francisco, CA · Remote
$123K - $169K/yr
This opportunity is fully remote and does not require you to be located in any particular state ... evaluation. * A Bachelor's Degree or an equivalent work experience is required What you'll get:
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
San Francisco, CA · On-site +1
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
San Francisco, CA · On-site +1
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
Los Angeles, CA · Remote
$326K/yr
The Ads Marketplace team is responsible for the core engine that drives Yelp\'s advertising ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
Los Angeles, CA · Remote
$326K/yr
The Ads Marketplace team is responsible for the core engine that drives Yelp\'s advertising ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
Los Angeles, CA · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
Los Angeles, CA · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Senior Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States)
Austin, TX · Remote
$103K - $142K/yr
This opportunity is fully remote and does not require you to be located in any particular state ... evaluation. * A Bachelor's Degree or an equivalent work experience is required What you'll get:
Senior Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States)
Austin, TX · Remote
$103K - $142K/yr
This opportunity is fully remote and does not require you to be located in any particular state ... evaluation. * A Bachelor's Degree or an equivalent work experience is required What you'll get:
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
New York, NY · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Principal Product Manager - Ads Auction and Measurements (Remote - United States)
New York, NY · Remote
The Ads Auction system sits at the heart of this exchange, determining which ads are shown for ... Auction Measurement & Evaluation: Define and own the key metrics framework for evaluating auction ...
Video Editor - UGC & Ecommerce Ads
$1.0K - $3.0K/wk
Contract | Full-Time Hours (40 hrs/week) | Fully Remote About Brick Social Brick Social is a ... You'll be evaluated against clear, measurable KPIs: * On-time delivery: 100% target, 95 ...
Video Editor - UGC & Ecommerce Ads
$1.0K - $3.0K/wk
Contract | Full-Time Hours (40 hrs/week) | Fully Remote About Brick Social Brick Social is a ... You'll be evaluated against clear, measurable KPIs: * On-time delivery: 100% target, 95 ...
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * 4+ years of hands-on ...
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * 4+ years of hands-on ...
Staff Data Scientist, Ads Delivery
San Francisco, CA · On-site +1
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... San Francisco, Palo Alto or Seattle. #LI-NM4 #LI-REMOTE
Staff Data Scientist, Ads Delivery
San Francisco, CA · On-site +1
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... San Francisco, Palo Alto or Seattle. #LI-NM4 #LI-REMOTE
Senior Machine Learning Engineer Remote
Washington, DC · Remote
$115K - $300K/yr
Hands-on recommendation, search, ranking, ads ranking, feed ranking, or content discovery systems ... Two-tower models, embedding retrieval, candidate generation, ranking, and online/offline evaluation.
Quick apply
Senior Machine Learning Engineer Remote
Washington, DC · Remote
$115K - $300K/yr
Hands-on recommendation, search, ranking, ads ranking, feed ranking, or content discovery systems ... Two-tower models, embedding retrieval, candidate generation, ranking, and online/offline evaluation.
Staff Data Scientist - Ads Measurement, Signals, Privacy
$217K - $303K/yr
Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ... Generous Paid Parental Leave #LI-Remote Pay Transparency: This job posting may span more than one ...
Staff Data Scientist - Ads Measurement, Signals, Privacy
$217K - $303K/yr
Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ... Generous Paid Parental Leave #LI-Remote Pay Transparency: This job posting may span more than one ...
Remote Ads Evaluator information
See salary details
$29.5K - $36.5K
13% of jobs
$36.5K - $43.5K
12% of jobs
$43.6K is the 25th percentile. Wages below this are outliers.
$43.5K - $50.5K
14% of jobs
The median wage is $56.6K / yr.
$50.5K - $57.5K
13% of jobs
$57.5K - $64.5K
12% of jobs
$64.5K - $71.5K
6% of jobs
$75.7K is the 75th percentile. Wages above this are outliers.
$71.5K - $78.5K
9% of jobs
$78.5K - $85.5K
11% of jobs
$85.5K - $92.5K
4% of jobs
$92.5K - $99.5K
4% of jobs
$99.5K - $106.5K
2% of jobs
$29.5K
$65.5K
$106.5K
How much do remote ads evaluator jobs pay per year?
What are the key skills and qualifications needed to thrive as a remote ads evaluator, and why are they important?
What is the difference between Remote Ads Evaluator vs Remote Content Moderator?
| Aspect | Remote Ads Evaluator | Remote Content Moderator |
|---|---|---|
| Required Credentials | Basic computer skills, attention to detail | Basic computer skills, attention to detail |
| Work Environment | Online, flexible hours | Online, flexible hours |
| Industry Usage | Advertising, marketing | Social media, online platforms |
Both roles involve online work with flexible hours and require basic computer skills. Remote Ads Evaluators focus on assessing online advertisements for relevance and quality, mainly in marketing and advertising industries. Remote Content Moderators review user-generated content to ensure compliance with platform policies, mainly in social media and online communities. While similar, their primary tasks and industry focus differ, making each role suited to different interests within online content management.
How do remote ads evaluators typically collaborate with teams while working independently?
What is a remote ads evaluator?
What cities are hiring for Remote Ads Evaluator jobs?
Cities with the most Remote Ads Evaluator job openings:
What are the most commonly searched types of Ads Evaluator jobs?
The most popular types of Ads Evaluator jobs are:
What states have the most Remote Ads Evaluator jobs?
States with the most job openings for Remote Ads Evaluator jobs include:
What job categories do people searching Remote Ads Evaluator jobs look for?
The top searched job categories for Remote Ads Evaluator jobs are:

Instacart rating
7.1
Based on 31 frontline employees who took The Breakroom Quiz
28th of 64 rated delivery companies
Job description
At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.
Instacart has become a lifeline for millions of people, and we're building the team to help push our shopping cart forward. If you're ready to do the best work of your life, come join our table.
Instacart is a Flex First team
There's no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work-whether it's from home, an office, or your favorite coffee shop-while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.
Overview
The Commercial Scaled Intelligence (CSI) team is an AI-first team dedicated to delivering actionable commercial insights and scalable automation to drive revenue growth and operational efficiency across the company. The team focuses on intelligence generation, predictive analytics, and workflow automation to enable data-driven decision-making and optimize commercial performance.
As an Ads AI Analytics Lead II, you will own the intelligence behind our Ads agents. You will design the Ads semantic/context layer and build vertical AI agents that analyze campaigns, diagnose performance, and recommend actions that improve ROAS, pacing, and partner outcomes. You will partner with Ads GTM, Product, Data Science, and Engineering to ship production agents with measurable lift.
About the Job
- Define Ads ontologies and metrics for campaigns, budgets, bids, creatives, audiences, and placements.
- Build dbt models and curated marts in Snowflake with clear data contracts, tests, and SLOs.
- Ingest and enrich unstructured Ads content and publish retrieval-ready datasets using our managed search/vector services.
- Design and evaluate retrieval workflows (RAG) with existing services for hybrid search and re-ranking; set quality/latency targets and iterate via experiments.
- Design agent reasoning and policies on ads, including tool definitions and human-in-the-loop approvals.
- Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency, and cost.
- Run A/B or uplift experiments to quantify impact and guide iteration.
- Translate Ads problems into agent behaviors and own KPIs such as ROAS lift, pacing accuracy, RCA precision/recall, forecast MAPE, and time-to-insight.
About You
Minimum Qualifications
- 3-6 years in analytics engineering, data science, or applied AI with strong SQL and Python.
- 2+ years of domain expertise in ads, retail, or e-commerce data.
- Advanced Proficiency in Python and SQL, with experience using dbt and Snowflake or BigQuery, including skills in data modeling, testing, and managing data contracts.
- Deep Expertise in orchestrating data pipelines using dbt and Airflow
- Experience with at least one data visualization tool (Tableau, Mode, Power BI, Looker, or similar)
- Ability to design offline/online evaluations and run A/B or uplift tests
- Fluency in Ads analytics concepts such as ROAS, CPA, CTR, CVR, LTV, pacing, auction dynamics, and incrementality.
- Strong stakeholder communication with a track record of shipping production data or AI systems that drove business impact.
- Understanding of ML models to drive recommendations on bid, keywords, and budgets
- Experience with evaluation and guardrail frameworks and human-in-the-loop QA.
Preferred Qualifications
- Strong understanding of AI and machine learning concepts, with experience creating AI-driven products.
- Deep expertise in advertising products, including leading and driving automation projects.
- Proven ability to improve operational efficiency through automation initiatives in fast-paced environments.
- Applied experience in modeling techniques for Ads, including forecasting, anomaly detection, uplift modeling, and causal inference.
- Hands-on experience with workflow automation and low-code development platforms (Zapier, n8n, Gumloop, Superblocks)
- Familiarity with retail media or ad platforms, including Amazon, Google, Meta, Shopify, or DoorDash.
#LI-Remote
Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.
Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.
For US based candidates, the base pay ranges for a successful candidate are listed below.
CA, NY, CT, NJ
$157,000-$165,000 USD
WA
$150,000-$159,000 USD
OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI
$144,000-$152,000 USD
All other states
$131,000-$138,000 USD
What Instacart employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Instacart
Sourced by ZipRecruiter
Instacart, based in San Francisco, CA, US, operates within the retail industry, specifically grocery delivery and pick-up service. It is recognized as a pioneer in this field, delivering fresh groceries from local stores directly to customers' doors. The company, which launched its services in 2012, continues to pioneer change in the online grocery shopping sector through its commitment to cutting-edge technology, new business ideas, and dedicated service.
Industry
Technology, communication and media
Company size
10,000+ Employees
Headquarters location
San Francisco, CA, US
Year founded
2012