Assistant Leetcode Jobs (NOW HIRING)

Job Summary:
Prolific is building a significant pool of quality human data in the AI space, and they are seeking Senior Python Developers to assist in training and evaluating advanced AI models. The role involves reviewing AI-generated Python code, validating logical reasoning, and conducting execution testing to ensure performance and output are accurate.
Responsibilities:
• Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
• Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound.
• Conduct Execution Testing: execute model-generated scripts in appropriate environments to verify performance and output.
• Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
• Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.
Qualifications:
Required:
• Educational Background: a BSc or higher in Computer Science, Software Engineering, or closely related technical field
• Professional Experience: real world experience as a Senior Software Engineer/ Developer specializing in Python
• Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Deep Domain Knowledge: expert understanding of the GIL (Global Interpreter Lock), decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
• Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
• Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.
• Core Language: expert mastery of Python 3.x, including type hints and modern language features.
• Frameworks: extensive experience with Django, FastAPI, or Flask.
• Testing & Tools: proficiency with pytest, unittest, coverage.py, and tox.
• Backend & API: strong understanding of RESTful APIs, GraphQL, and server-side logic in a Python environment (e.g., with FastAPI or Django REST Framework).
Company:
Building the most advanced global infrastructure for People Science. Founded in 2014, the company is headquartered in London, GBR, with a team of 51-200 employees. The company is currently Growth Stage.