Job Summary:
Prolific is building the biggest pool of quality human data in the world. They are seeking Senior Python Developers to join their Expert Network to help train and evaluate cutting-edge AI models by reviewing AI-generated Python code and providing structured feedback on model performance.
Responsibilities:
• Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
• Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound.
• Conduct Execution Testing: execute model-generated scripts in appropriate environments to verify performance and output.
• Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
• Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.
Qualifications:
Required:
• Educational Background: a BSc or higher in Computer Science, Software Engineering, or closely related technical field
• Professional Experience: real world experience as a Senior Software Engineer/ Developer specializing in Python
• Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Deep Domain Knowledge: expert understanding of the GIL (Global Interpreter Lock), decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
• Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
• Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.
• Core Language: expert mastery of Python 3.x, including type hints and modern language features.
• Frameworks: extensive experience with Django, FastAPI, or Flask.
• Testing & Tools: proficiency with pytest, unittest, coverage.py, and tox.
• Backend & API: strong understanding of RESTful APIs, GraphQL, and server-side logic in a Python environment (e.g., with FastAPI or Django REST Framework).
Company:
Building the most advanced global infrastructure for People Science. Founded in 2014, the company is headquartered in London, GBR, with a team of 51-200 employees. The company is currently Growth Stage.