Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
New York, NY ยท On-site +1
$200/hr
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
New York, NY ยท On-site +1
$200/hr
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Java Full Stack Developer with Ariba Experience
Bridgewater, NJ ยท On-site +1
$53.75 - $69.25/hr
Develop code in alignment with client-approved Java coding standards using technologies such as ... Can we use Freelancer? : No * Named Job Posting? (if Yes - needs to be approved by SCSC) : No
Java Full Stack Developer with Ariba Experience
Bridgewater, NJ ยท On-site +1
$53.75 - $69.25/hr
Develop code in alignment with client-approved Java coding standards using technologies such as ... Can we use Freelancer? : No * Named Job Posting? (if Yes - needs to be approved by SCSC) : No
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
There are many 100% remote engineers and non-engineers in the company. * We have videos on for our weekly team syncs and pair-coding / tech discussion. Application Process * Apply to any one of the ...
There are many 100% remote engineers and non-engineers in the company. * We have videos on for our weekly team syncs and pair-coding / tech discussion. Application Process * Apply to any one of the ...
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Mindrift connects specialists with project-based AI opportunities for leading tech companies ... Creating a task that genuinely challenges the best models is non-trivial. You need to deeply ...
Freelance Senior Designer
New York, NY ยท On-site
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Freelance Senior Designer
New York, NY ยท On-site
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Freelance Senior Designer
New York, NY ยท Remote
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Quick apply
Freelance Senior Designer
New York, NY ยท Remote
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Freelance Senior Designer
Brooklyn, NY ยท On-site +1
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Freelance Senior Designer
Brooklyn, NY ยท On-site +1
We are world-class experience designers, technologists, strategic thinkers and creators assembled ... Creative coding knowledge is a plus. * 2D/3D animation knowledge is a plus. * Experience designing ...
Freelance Full-Stack Web App Developer
Queens, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Queens, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Queens, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Queens, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Brooklyn, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Brooklyn, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
New York, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
New York, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Brooklyn, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
Brooklyn, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
New York, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
Freelance Full-Stack Web App Developer
New York, NY ยท Remote
$60/hr
Our mission is to help develop high-quality AI technologies by combining real-world expertise from ... Write clear, testable code and debug end-to-end issues across frontend, backend, and database.
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
This includes both academic manuscripts and non-academic material originally written in various ... technology company. We specialize in AI products and solutions that improve how research gets ...
Freelance Data Scraping Engineer (Python)
New York, NY ยท Remote
$37/hr
About the Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer ... who can solve non-trivial problems, work confidently with modern web technologies and data ...
Freelance Data Scraping Engineer (Python)
New York, NY ยท Remote
$37/hr
About the Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer ... who can solve non-trivial problems, work confidently with modern web technologies and data ...
Freelance Data Scraping Engineer (Python)
New York, NY ยท On-site +1
$37/hr
About the Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer ... who can solve non-trivial problems, work confidently with modern web technologies and data ...
Freelance Data Scraping Engineer (Python)
New York, NY ยท On-site +1
$37/hr
About the Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer ... who can solve non-trivial problems, work confidently with modern web technologies and data ...
Freelance Non Coding Tech information
What is the difference between Freelance Non Coding Tech vs Freelance Data Entry Specialist?
| Aspect | Freelance Non Coding Tech | Freelance Data Entry Specialist |
|---|---|---|
| Required Credentials | Technical certifications, industry-specific knowledge | Basic computer skills, typing proficiency |
| Work Environment | Remote, project-based | Remote, often repetitive tasks |
| Employer & Industry Usage | Tech companies, startups, digital agencies | Businesses, administrative sectors |
| Search & Comparison Intent | Technical skills, project work | Data accuracy, typing speed |
Freelance Non Coding Tech involves technical skills like UI/UX, testing, or project management, often requiring certifications. Freelance Data Entry Specialists focus on accurate data input and management, with less technical credentials. Both roles are remote and project-based but serve different industry needs and skill sets.

$200/hr
Part-time
Posted 22 days ago
Job description
Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.What this opportunity involves:
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
- Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history
- Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent
- Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient
- Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust
What this is NOT:
- Not data labeling
- Not prompt engineering
- Not writing code from scratch - the agent writes most of the code; you guide and evaluate
What we look for:
- 8+ years in software development
- Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
- Experience writing tests (functional, integration)
- English proficiency - B2+
Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply Pass qualification(s) Join a project Complete tasks Get paidEffort estimate
Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation:
Up to $200/hr equivalent, depending on level and pace. Tasks are estimated at ~30 hours each; you set your own schedule.