Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Ads AI Analytics Lead II
OR · Remote
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... Remote
Ads AI Analytics Lead II
OR · Remote
Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency ... Remote
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work in a fast-paced environment * Excellent online research skills * Reliable computer system and ...
Quick apply
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work in a fast-paced environment * Excellent online research skills * Reliable computer system and ...
US remote-friendly Reddit has a flexible first workforce. At Reddit we continue to grow our teams ... Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ...
US remote-friendly Reddit has a flexible first workforce. At Reddit we continue to grow our teams ... Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ...
Senior Product Manager, Ads Quality
$129K - $170K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Senior Product Manager, Ads Quality
$129K - $170K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... This role is remote and the base pay range for a successful candidate is dependent on their ...
Senior Product Manager, Ads Quality
OR · Remote
$126K - $166K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... Remote
Senior Product Manager, Ads Quality
OR · Remote
$126K - $166K/yr
... design, evaluation, and tradeoffs. * Proven track record of defining and executing on product ... Remote
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * Technical Domain ...
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * Technical Domain ...
Staff Data Scientist, Ads Delivery
Seattle, WA · On-site +1
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... REMOTE
Staff Data Scientist, Ads Delivery
Seattle, WA · On-site +1
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... REMOTE
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * 4+ years of hands-on ...
We're a remote-friendly company, and this position is open to candidates anywhere in the U.S ... Proven ability in training, evaluating, and deploying large-scale models. * 4+ years of hands-on ...
Staff Data Scientist, Ads Delivery
Seattle, WA · On-site +1
$164K - $339K/yr
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... REMOTE At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for ...
Staff Data Scientist, Ads Delivery
Seattle, WA · On-site +1
$164K - $339K/yr
Design and productionize robust, scalable ML and evaluation frameworks-spanning forecasting ... REMOTE At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for ...
Staff Data Scientist - Ads Measurement, Signals, Privacy
$217K - $303K/yr
Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ... Generous Paid Parental Leave #LI-Remote Pay Transparency: This job posting may span more than one ...
Staff Data Scientist - Ads Measurement, Signals, Privacy
$217K - $303K/yr
Define Ground Truth & Evaluation Frameworks: Solve the industry-wide challenge of validating ... Generous Paid Parental Leave #LI-Remote Pay Transparency: This job posting may span more than one ...
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work ... Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
Quick apply
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work ... Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work ... Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
Must not have current or previous experience with "Ads quality rating" * Web-savvy and able to work ... Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
Senior Creative Strategist, Performance Advertising - REMOTE
Philadelphia, PA · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Philadelphia, PA · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Philadelphia, PA · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Philadelphia, PA · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Charlotte, NC · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Charlotte, NC · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Austin, TX · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Austin, TX · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Jersey City, NJ · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Jersey City, NJ · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Denver, CO · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Quick apply
Senior Creative Strategist, Performance Advertising - REMOTE
Denver, CO · Remote
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Denver, CO · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Senior Creative Strategist, Performance Advertising - REMOTE
Denver, CO · On-site +1
$105K - $150K/yr
Research customers, competitors, and category trends (including tracking competitor ads) to ... Create a shared framework for evaluating creative performance * Improve the quality, clarity, and ...
Remote Ads Evaluator information
See salary details
$29.5K - $36.5K
13% of jobs
$36.5K - $43.5K
12% of jobs
$43.6K is the 25th percentile. Wages below this are outliers.
$43.5K - $50.5K
14% of jobs
The median wage is $56.6K / yr.
$50.5K - $57.5K
13% of jobs
$57.5K - $64.5K
12% of jobs
$64.5K - $71.5K
6% of jobs
$75.7K is the 75th percentile. Wages above this are outliers.
$71.5K - $78.5K
9% of jobs
$78.5K - $85.5K
11% of jobs
$85.5K - $92.5K
4% of jobs
$92.5K - $99.5K
4% of jobs
$99.5K - $106.5K
2% of jobs
$29.5K
$65.5K
$106.5K
How much do remote ads evaluator jobs pay per year?
What are the key skills and qualifications needed to thrive as a Remote Ads Evaluator, and why are they important?
What is the difference between Remote Ads Evaluator vs Remote Content Moderator?
| Aspect | Remote Ads Evaluator | Remote Content Moderator |
|---|---|---|
| Required Credentials | Basic computer skills, attention to detail | Basic computer skills, attention to detail |
| Work Environment | Online, flexible hours | Online, flexible hours |
| Industry Usage | Advertising, marketing | Social media, online platforms |
Both roles involve online work with flexible hours and require basic computer skills. Remote Ads Evaluators focus on assessing online advertisements for relevance and quality, mainly in marketing and advertising industries. Remote Content Moderators review user-generated content to ensure compliance with platform policies, mainly in social media and online communities. While similar, their primary tasks and industry focus differ, making each role suited to different interests within online content management.
How do Remote Ads Evaluators typically collaborate with teams while working independently?
What are Remote Ads Evaluators?

Instacart rating
7.1
Based on 31 frontline employees who took The Breakroom Quiz
28th of 64 rated delivery companies
Job description
At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.
Instacart has become a lifeline for millions of people, and we're building the team to help push our shopping cart forward. If you're ready to do the best work of your life, come join our table.
Instacart is a Flex First team
There's no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work-whether it's from home, an office, or your favorite coffee shop-while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.
Overview
The Commercial Scaled Intelligence (CSI) team is an AI-first team dedicated to delivering actionable commercial insights and scalable automation to drive revenue growth and operational efficiency across the company. The team focuses on intelligence generation, predictive analytics, and workflow automation to enable data-driven decision-making and optimize commercial performance.
As an Ads AI Analytics Lead II, you will own the intelligence behind our Ads agents. You will design the Ads semantic/context layer and build vertical AI agents that analyze campaigns, diagnose performance, and recommend actions that improve ROAS, pacing, and partner outcomes. You will partner with Ads GTM, Product, Data Science, and Engineering to ship production agents with measurable lift.
About the Job
- Define Ads ontologies and metrics for campaigns, budgets, bids, creatives, audiences, and placements.
- Build dbt models and curated marts in Snowflake with clear data contracts, tests, and SLOs.
- Ingest and enrich unstructured Ads content and publish retrieval-ready datasets using our managed search/vector services.
- Design and evaluate retrieval workflows (RAG) with existing services for hybrid search and re-ranking; set quality/latency targets and iterate via experiments.
- Design agent reasoning and policies on ads, including tool definitions and human-in-the-loop approvals.
- Establish evaluation suites covering precision/recall, calibration, hallucination rate, latency, and cost.
- Run A/B or uplift experiments to quantify impact and guide iteration.
- Translate Ads problems into agent behaviors and own KPIs such as ROAS lift, pacing accuracy, RCA precision/recall, forecast MAPE, and time-to-insight.
About You
Minimum Qualifications
- 3-6 years in analytics engineering, data science, or applied AI with strong SQL and Python.
- 2+ years of domain expertise in ads, retail, or e-commerce data.
- Advanced Proficiency in Python and SQL, with experience using dbt and Snowflake or BigQuery, including skills in data modeling, testing, and managing data contracts.
- Deep Expertise in orchestrating data pipelines using dbt and Airflow
- Experience with at least one data visualization tool (Tableau, Mode, Power BI, Looker, or similar)
- Ability to design offline/online evaluations and run A/B or uplift tests
- Fluency in Ads analytics concepts such as ROAS, CPA, CTR, CVR, LTV, pacing, auction dynamics, and incrementality.
- Strong stakeholder communication with a track record of shipping production data or AI systems that drove business impact.
- Understanding of ML models to drive recommendations on bid, keywords, and budgets
- Experience with evaluation and guardrail frameworks and human-in-the-loop QA.
Preferred Qualifications
- Strong understanding of AI and machine learning concepts, with experience creating AI-driven products.
- Deep expertise in advertising products, including leading and driving automation projects.
- Proven ability to improve operational efficiency through automation initiatives in fast-paced environments.
- Applied experience in modeling techniques for Ads, including forecasting, anomaly detection, uplift modeling, and causal inference.
- Hands-on experience with workflow automation and low-code development platforms (Zapier, n8n, Gumloop, Superblocks)
- Familiarity with retail media or ad platforms, including Amazon, Google, Meta, Shopify, or DoorDash.
#LI-Remote
Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.
Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.
For US based candidates, the base pay ranges for a successful candidate are listed below.
CA, NY, CT, NJ
$157,000-$165,000 USD
WA
$150,000-$159,000 USD
OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI
$144,000-$152,000 USD
All other states
$131,000-$138,000 USD
What Instacart employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Instacart
Sourced by ZipRecruiter
Instacart, based in San Francisco, CA, US, operates within the retail industry, specifically grocery delivery and pick-up service. It is recognized as a pioneer in this field, delivering fresh groceries from local stores directly to customers' doors. The company, which launched its services in 2012, continues to pioneer change in the online grocery shopping sector through its commitment to cutting-edge technology, new business ideas, and dedicated service.
Industry
Technology, communication and media
Company size
10,000+ Employees
Headquarters location
San Francisco, CA, US
Year founded
2012