ZipRecruiter

Log In

2

Remote Online Evaluator Jobs in Decatur, GA (NOW HIRING)

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · On-site +1

$100K - $138K/yr

Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls ... All Remote Hires will be required to travel to Orlando, Florida at least twice per year for Town ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · Remote

$107K - $146K/yr

Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls ... All Remote Hires will be required to travel to Orlando, Florida at least twice per year for Town ...

CRH

Business Process Lead - Infor M3 - Remote

Atlanta, GA · On-site +1

$140K - $160K/yr

Participate in solution demos, including the assessment of metrics, evaluation of business value ... Please complete your online profile and it will be sent to the hiring manager. Our system allows ...

Expressable

Occupational Therapist

Atlanta, GA · Remote

$40 - $55/hr

... online therapy. We believe in empowering caregivers to be active participants in their loved one ... Provide remote occupational therapy sessions/evaluations for a diverse pediatric population

Expressable

Speech-Language Pathologist

Atlanta, GA · Remote

$63K - $81K/yr

... led online speech therapy. We believe in empowering caregivers to be active participants in their ... Provide remote speech therapy sessions/evaluations for a diverse pediatric population * Diagnose ...

Valnet Freelance

MovieWeb: Movies & TV Reporter

Atlanta, GA · Remote

$25 - $34/hr

This is a paid freelance remote position. The editorial team at MovieWeb.com is looking for a ... Founded in 1995, MovieWeb.com is the premier online destination for movie enthusiasts, providing ...

Expressable

Speech-Language Pathologist

Atlanta, GA · Remote

$40 - $54/hr

... access to family-led online speech therapy. We believe in empowering caregivers to be active ... Provide remote speech therapy sessions/evaluations for a diverse pediatric population * Diagnose ...

Mindful

Physician (Patient Care)

Atlanta, GA · On-site +1

$175 - $200/hr

Our clinicians manage patients online, allowing the autonomy to set their own schedules. We value ... remote follow-ups) What you will do: * Conduct psychiatric evaluations * Manage your patient ...

CRH

Business Process Lead - Infor M3 - Remote

Atlanta, GA · Remote

$140K - $160K/yr

Participate in solution demos, including the assessment of metrics, evaluation of business value ... Please complete your online profile and it will be sent to the hiring manager. Our system allows ...

ReSource Pro

Commercial Lines Account Manager

Atlanta, GA · Remote

$53K - $91K/yr

All remote positions are based in the United States, and candidates must reside within the U.S. to ... Online talent assessment * Hiring Manager Interview *Additional interview steps may be added ...

ReSource Pro

Commercial Lines Account Manager

Atlanta, GA · On-site +1

$53K - $91K/yr

All remote positions are based in the United States, and candidates must reside within the U.S. to ... Online talent assessment * Hiring Manager Interview *Additional interview steps may be added ...

W&M Environmental Group

Air Modeler

Atlanta, GA · Remote

$80K - $119K/yr

Experience evaluating meteorological data, surface characteristics, terrain, background ... If you need assistance completing your online application, please email hrhelp@braunintertec.com.

next page

Showing results 1-20

All JobsOnline Evaluator JobsRemote Online Evaluator JobsRemote Online Evaluator Jobs in Decatur, GA

Remote Online Evaluator information

See Decatur, GA salary details

$28.8K

$63.9K

$104K

How much do remote online evaluator jobs pay per year?

As of Jul 29, 2026, the average yearly pay for remote online evaluator in Decatur, GA is $63,922.00, according to ZipRecruiter salary data. Most workers in this role earn between $43,400.00 and $77,600.00 per year, depending on experience, location, and employer.

Is a remote online evaluator a legit job?

A remote online evaluator is a legitimate job that involves reviewing and assessing online content, advertisements, or search results. These positions are often offered by reputable companies and typically require basic computer skills and internet access; however, applicants should verify the employer's credibility before applying to avoid scams.

What are the key skills and qualifications needed to thrive as a Remote Online Evaluator, and why are they important?

To thrive as a Remote Online Evaluator, you typically need strong analytical skills, attention to detail, and a high school diploma or equivalent. Familiarity with web browsers, search engines, and evaluation tools or platforms is often required, sometimes supplemented by training or certifications in digital evaluation. Excellent written communication, time management, and self-motivation are essential soft skills for excelling in a remote and independent work environment. These abilities ensure accurate, objective assessments of online content and efficient completion of tasks with minimal supervision.

What is the difference between Remote Online Evaluator vs Remote Content Moderator?

AspectRemote Online EvaluatorRemote Content Moderator
Required CredentialsHigh school diploma or equivalent; sometimes college courseworkHigh school diploma or equivalent; sometimes prior experience in moderation
Work EnvironmentHome-based, flexible hours, independent workHome-based, shift work, often with team supervision
Employer & Industry UsageMarket research firms, advertising agencies, tech companiesSocial media platforms, online communities, tech companies

Both roles are remote, involve evaluating online content, and require similar educational backgrounds. However, Remote Online Evaluators focus on assessing websites, ads, or search results for quality and relevance, while Remote Content Moderators review user-generated content to ensure community guidelines are followed. Understanding these differences helps job seekers find the role that best matches their skills and interests.

How does a Remote Online Evaluator typically communicate and collaborate with their team while working from home?

As a Remote Online Evaluator, most collaboration and communication take place through digital channels such as email, instant messaging platforms, and project management tools. Team meetings are often conducted via video conferencing to discuss guidelines, share updates, and clarify expectations. While the work is largely independent, evaluators are encouraged to ask questions and share feedback to ensure consistency and accuracy in assessments. Regular check-ins with supervisors or quality assurance leads help maintain alignment with project objectives and provide opportunities for peer support.

How to become an online evaluator?

To become an online evaluator, you typically need a high school diploma or equivalent, strong analytical skills, and familiarity with internet search engines and social media. Many companies require passing a skills test and completing an application process, which may include a sample evaluation or assessment. Having good communication skills and the ability to work independently are also important for success in this role.

How much do remote online evaluators make?

Remote online evaluators typically earn between $10 and $15 per hour, depending on the company and the complexity of the tasks. Some positions may offer performance-based bonuses or part-time schedules, but overall pay remains within this range for most roles.

What are Remote Online Evaluators?

Remote Online Evaluators are professionals who assess and rate online content, advertisements, search engine results, or products to ensure they meet specific guidelines and quality standards. They typically work from home, using a computer to review information and provide feedback to companies that want to improve their digital offerings. This job requires attention to detail, strong analytical skills, and the ability to follow detailed instructions. Remote Online Evaluators often work independently on a flexible schedule, making it a popular choice for those seeking remote or part-time work. Some common employers are search engines, e-commerce sites, and companies focused on digital marketing.

How to make $1000 a week remotely?

Remote online evaluators typically earn between $10 and $15 per hour, making it challenging to reach $1000 weekly without working 70+ hours. Increasing earnings may involve taking on multiple evaluation projects, improving skills, or seeking higher-paying opportunities within the evaluation field, but consistent high weekly income often requires additional side jobs or specialized roles.
What are popular job titles related to Remote Online Evaluator jobs in Decatur, GA? For Remote Online Evaluator jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Remote Online Evaluator jobs in Decatur, GA look for? The top searched job categories for Remote Online Evaluator jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Remote Online Evaluator jobs? Cities near Decatur, GA with the most Remote Online Evaluator job openings:
Remote Online Evaluator jobs near you
Infographic showing various Remote Online Evaluator job openings in Decatur, GA as of July 2026, with employment types broken down into 45% Locum Tenens, 6% Internship, 36% Full Time, 9% Part Time, 3% Contract, and 1% Summer. Highlights an 88% Physical, 4% Hybrid, and 8% Remote job distribution, with an average salary of $63,922 per year, or $30.7 per hour.

Senior Agentic (AI) Engineer

Worth AI

Atlanta, GA • On-site, Remote

$100K - $138K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 14 days ago

Job description

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that automate KYB, underwriting, and risk decisions on regulated financial data. You'll own agents end-to-end architecture, retrieval, tools, evals, and production deployment and partner closely with our Chief AI Officer, applied scientists, and platform teams.

Responsibilities
  • Design and ship multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) for onboarding, underwriting, case review, and continuous monitoring.
  • Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent SDK) with explicit state, durable execution, retries, and safe fallbacks.
  • Build the retrieval layer powering our agents - chunking, hybrid search, reranking, and grounded citation.
  • Own the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evals, and red-teaming for jailbreaks, prompt injection, and PII leakage.
  • Expose agents to production systems via well-typed tools and MCP servers. Treat tool surface area as a product.
  • Drive production MLOps: deployment, versioning, traffic shaping, cost/latency budgets, tracing, and on-call playbooks for agent incidents.
  • Partner with security and compliance to keep agents inside SOC 2, GDPR, CCPA, and fair-lending posture - auditability and explainability built in, not bolted on.
  • Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes.
  • Technology Stack
    • Languages: Python, Node.js, TypeScript
    • Agent / LLM frameworks: LangGraph, LangChain, Claude Agent SDK, MCP, OpenAI SDK
    • Models: Anthropic Claude, OpenAI, open-weight where appropriate
    • Retrieval & Data: PostgreSQL, pgvector, OpenSearch, Kafka, Redshift, Redis
    • Infra: AWS, Kubernetes (EKS), ArgoCD, Terraform
    • Evals & Observability: LangSmith / Langfuse / Braintrust-style tooling, DataDog

Requirements

  • 5+ years of software engineering experience, with 2+ years building production LLM or agentic systems (not just notebooks or demos).
  • Hands-on experience with a modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that run, fail gracefully, and recover.
  • Strong RAG fundamentals chunking, embeddings, hybrid retrieval, reranking, grounding - and judgment about when RAG isn't the right answer.
  • Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
  • Production MLOps fluency: deployed LLM workloads under real latency, cost, and reliability constraints.
  • Strong Python; comfortable in TypeScript / Node.js.
  • Solid systems engineering instincts APIs, async patterns, queues, databases, distributed system failure modes.
  • Calibrated communicator; thrives in ambiguous, fast-moving environments.
  • Prior experience in fintech, lending, payments, KYB/KYC, fraud, or AML.
  • Experience building MCP servers or other structured tool interfaces for LLMs.
  • Background in classical ML (ranking, scoring, calibration).
  • Experience designing explainable / auditable AI workflows for regulated environments.
  • Open-source contributions to agent frameworks, eval tooling, or retrieval libraries.
  • AWS depth (EKS, MSK, RDS, S3, Lambda) and IaC with Terraform.
Success Metrics
  • Agent Quality: Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our eval suites.
  • Production Reliability: Agents you own meet defined SLOs for latency (P90/P99), tool-call success, and cost per task.
  • Velocity: New agent capabilities go from prototype to production in weeks, without skipping evals or guardrails.
  • Risk Posture: Zero material incidents tied to prompt injection, PII leakage, or unsafe tool use on agents you own.
  • Force Multiplier: Patterns, tools, and eval scaffolding you build get adopted across engineering.

All Remote Hires will be required to travel to Orlando, Florida at least twice per year for Town Halls and team collaboration, in addition to orientation in Orlando.

Benefits

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance
  • Flexible Paid Time Off
  • 9 paid Holidays
  • Family Leave
  • Remote
  • Hybrid work (for Orlando Associates)
  • Free Food & Snacks (Orlando)
  • Wellness Resources

Apply