Ai Content Evaluator Jobs (NOW HIRING)

Hiring a Medical Coder - AI Content Evaluator (Remote)!
This role focuses on applying medical coding and healthcare operations expertise to assess and improve AI-generated content. You will evaluate AI responses related to healthcare operations, medical coding, and reimbursement, ensuring they are accurate, practical, and aligned with industry standards. By creating realistic healthcare scenarios and providing detailed feedback, you will help train and refine advanced AI models used in the healthcare domain.
Responsibilities

• Assess and validate AI-generated content related to healthcare operations, medical coding, and reimbursement to ensure responses are accurate, practical, and aligned with industry expectations.
• Analyze, score, and compare AI model outputs to support ongoing AI development and performance improvement efforts.
• Draft clear, well-written, subject matter expert responses to operational healthcare scenarios for use in AI model training and benchmarking.
• Identify inaccuracies, inconsistencies, or unclear recommendations within model-generated content and provide actionable, detailed feedback to guide improvements.
• Create authentic healthcare operations use cases based on your professional experience, including scenario design, supporting documentation, input datasets, and evaluation criteria.
• Test AI performance against custom-built scenarios and refine tasks based on quality reviews, performance results, and stakeholder feedback.
• Adhere to project standards, documentation guidelines, and submission requirements with a high degree of accuracy and attention to detail.
• Maintain consistent quality while meeting productivity expectations throughout the duration of the engagement.
• Interpret and apply process documentation, incorporating feedback effectively across iterative review cycles.
• Work independently in a remote environment, managing priorities, deadlines, and deliverables with minimal oversight.
• Use common workplace technologies, including cloud-based collaboration tools and document management systems, to complete and submit work products.

Essential Skills

• Professional experience supporting healthcare operations, revenue cycle functions, health information management, utilization management, patient access, compliance, or related healthcare administrative environments.
• Hands-on medical coding experience or substantive healthcare operations experience, with recent direct involvement in day-to-day work as an individual contributor.
• Strong medical billing, medical coding, and healthcare operations knowledge, including familiarity with medical terminology and health information management practices.
• Bachelor's degree.
• Exceptional written communication skills with the ability to explain technical and operational healthcare concepts clearly and concisely.
• Strong attention to detail and the ability to interpret and follow process documentation accurately.
• Ability to apply feedback effectively and maintain high quality across iterative review and revision cycles.
• Comfort with user-level AI and large language model (LLM) tools, including basic interaction and evaluation of AI-generated content.
• Proficiency with common workplace technologies such as cloud-based collaboration platforms, document management tools, software installations, and routine file-sharing and file-conversion processes.
• Ability to work independently in a remote setting while managing priorities, deadlines, and deliverables with minimal oversight.
• Availability to work 30-40 hours per week over a multi-month project-based engagement (approximately 12 weeks).
• Residence within the United States.

Additional Skills & Qualifications

• Coding certifications such as CPC, CCS, or CCA are preferred.
• Healthcare credentials such as CPC, CCS, RHIT, RHIA, or similar are beneficial but not required.
• Experience in utilization management, utilization review, case management, or prior authorization processes.
• Experience in patient access, revenue cycle, or compliance-related healthcare administrative roles.
• Familiarity with generative AI technologies, large language models, and the evolving artificial intelligence landscape.
• Experience evaluating healthcare documentation and reimbursement scenarios for accuracy and adherence to industry standards.
• Interest in applying medical coding and healthcare operations expertise to support the development of advanced AI systems.

Work Environment
This is a 100% remote role, offering the flexibility to work from your preferred location within the United States. The engagement averages 30-40 hours per week over approximately 12 weeks, with the potential to extend based on project needs. Working hours are flexible, allowing you to manage your schedule while meeting project deadlines and productivity expectations. You will perform meaningful, self-directed work in a fully digital environment, using cloud-based collaboration platforms, document management tools, and standard office software. The role centers on evaluating coding-related content, healthcare documentation, and reimbursement scenarios while helping train AI models to better understand industry standards and best practices, providing an opportunity to make a direct impact on emerging healthcare technology.
Job Type & Location
This is a Contract position based out of New York, NY.
Pay and Benefits
The pay range for this position is $75.00 - $75.00/hr.
Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)
Workplace Type
This is a fully remote position.
Application Deadline
This position is anticipated to close on Sep 7, 2026.
About Aston Carter
Aston Carter provides world-class corporate talent solutions to thousands of clients across the globe. Specialized in accounting, finance, human resources, talent acquisition, procurement, supply chain and select administrative professions, we extend the capabilities of industry-leading companies. We draw on our deep recruiting expertise and expansive network to meet the evolving needs of our clients and talent community with agility and excellence. With offices across the U.S., Canada, Asia Pacific and Europe, Aston Carter serves many of the Fortune 500. We are proud to be a ClearlyRated Best of Staffing® Platinum Award winner for both client and talent service.
The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please email astoncarteraccommodation@astoncarter.com for other accommodation options.
San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.
Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.