ZipRecruiter

Log In

1

From Home Test Item Writer Jobs (NOW HIRING)

Speak

Assessment Design Lead

San Francisco, CA · On-site

$100K - $140K/yr

... from unit-level mastery checks to standalone proficiency tests to onboarding placement, all in ... an item writer can generate items against and an ML Engineer can build a grading model against.

DPR Construction

Item Management Assistant

Orlando, FL · On-site

$39K - $45K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Austin, TX · On-site

$41K - $48K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Morrisville, NC · On-site

$39K - $45K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Richmond, VA · On-site

$41K - $48K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Charlotte, NC · On-site

$41K - $47K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Atlanta, GA · On-site

$40K - $46K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Dallas, TX · On-site

$41K - $48K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Nashville, TN · On-site

$40K - $46K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Atlanta, GA · On-site

$40K - $46K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Raleigh, NC · On-site

$40K - $47K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Richmond, VA · On-site

$41K - $48K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

DPR Construction

Item Management Assistant

Nashville, TN · On-site

$40K - $46K/yr

Supports system and process testing for item management workflows by executing test steps ... Excellent written and verbal communication skills. * Strong time management and problem-solving ...

Ask IT consulting

Test Scripts Writer

Durham, NC

$28/hr

NC FAST P4 Test Scripts Writer Location : Research Triangle Park, Durham, NC REQ ID: 496061 ... freedom from defects. This position is responsible for reviewing test cases and other testing ...

Infojini Inc

Test Scripts Writer

Durham, NC

$30/hr

We offer an excellent compensation package Hi, This is Keith from Infojini Consulting. We have a requirement for Test Scripts Writer at Durham, NC for 12+ months contract position. If interested ...

US IT Solutions Inc

Test Scripts Writer

Durham, NC

Company Description We are from US IT Solutions, an ISO Certified, E-Verify, WMBE Certified ... Test Scripts Writer Duration 12 Months Location: Durham, NC Description: Duties include analyzing ...

previous page

Showing results 41-60

All JobsTest Item Writer JobsFrom Home Test Item Writer Jobs

From Home Test Item Writer information

See salary details

$11

$24

$42

How much do from home test item writer jobs pay per hour?

As of Aug 15, 2026, the average hourly pay for from home test item writer in the United States is $24.29, according to ZipRecruiter salary data. Most workers in this role earn between $18.51 and $27.88 per hour, depending on experience, location, and employer.

What is a from home test item writer?

A From Home Test Item Writer is a professional who creates questions and assessment materials for exams, quizzes, or standardized tests while working remotely. These writers design test items according to specific guidelines and educational standards, often for subjects ranging from K-12 to higher education or professional certification. The role typically involves researching subject matter, ensuring questions are fair and unbiased, and sometimes reviewing or revising existing test items. Working from home offers flexibility, but it also requires strong communication skills and the ability to meet deadlines independently.

What are the key skills and qualifications needed to thrive as a from home test item writer?

To thrive as a From Home Test Item Writer, you need strong subject matter expertise, excellent written communication skills, and experience with educational standards or curriculum development. Familiarity with item authoring platforms, learning management systems, and sometimes certifications in teaching or assessment design are typically required. Attention to detail, creativity, and self-motivation are vital soft skills for crafting clear, unbiased, and engaging test questions independently. These skills ensure the creation of high-quality, valid assessments that accurately measure learning outcomes and support educational goals.

What is the difference between From Home Test Item Writer vs From Home Content Reviewer?

AspectFrom Home Test Item WriterFrom Home Content Reviewer
CredentialsTypically requires subject matter expertise, writing skills, and sometimes certification in test developmentRequires strong attention to detail, editing skills, and familiarity with content standards
Work EnvironmentPrimarily independent, remote work focused on creating test questions and materialsRemote work involving reviewing and editing existing content for accuracy and quality
Employer & Industry UsageUsed by educational testing companies, certification bodies, and assessment organizationsEmployed by testing agencies, educational institutions, and certification providers

In summary, From Home Test Item Writers focus on creating new test questions and materials, while From Home Content Reviewers concentrate on evaluating and editing existing content. Both roles are remote, require specific skills, and are essential in the assessment industry.

What are some common challenges faced by from home test item writers, and how can they be managed effectively?

From Home Test Item Writers often encounter challenges such as maintaining focus and motivation in a remote setting, adhering to strict content and formatting guidelines, and ensuring the originality and validity of test questions. To manage these effectively, it's helpful to establish a dedicated workspace, set clear daily goals, and regularly communicate with team leads or review committees for feedback. Leveraging collaboration tools and participating in virtual training sessions can also help writers stay aligned with evolving standards and foster a sense of connection with the broader team.
More about From Home Test Item Writer jobs

What cities are hiring for From Home Test Item Writer jobs?

Cities with the most From Home Test Item Writer job openings:

What are the most commonly searched types of Test Item Writer jobs?

The most popular types of Test Item Writer jobs are:

What states have the most From Home Test Item Writer jobs?

States with the most job openings for From Home Test Item Writer jobs include:

What job categories do people searching From Home Test Item Writer jobs look for?

The top searched job categories for From Home Test Item Writer jobs are:

From Home Test Item Writer jobs near you
Infographic showing various From Home Test Item Writer job openings in the United States as of August 2026, with employment types broken down into 2% As Needed, 70% Full Time, 24% Part Time, and 4% Contract. Highlights an 87% Physical, 2% Hybrid, and 11% Remote job distribution, with an average salary of $50,519 per year, or $24.3 per hour.

Assessment Design Lead

Speak

San Francisco, CA • On-site

$100K - $140K/yr

Full-time

Posted 4 days ago

Job description

About us
Our mission is to reinvent the way people learn, starting with language.
Learning a language can change a life by opening doors to new cultures, careers, and communities. Two billion people around the world are actively trying to learn a language, but the best way to learn (one-on-one tutoring) is hard to access at scale and hasn't been meaningfully improved in decades. Speak is building a human-level, AI-powered tutor in your pocket: a conversation-first experience that lets learners actually speak, get instant feedback, and progress through carefully designed lessons. The result is a complete path from beginner to confident speaker across multiple languages.
Speak first launched in South Korea in 2019, where Speak has now become the number one language learning app, and we now serve learners across many markets and 15+ languages. Speak is one of the world's leading AI companies, with over $150m raised in venture investment from OpenAI, Accel, Founders Fund, Khosla Ventures, and more, with a distributed team across San Francisco, Seoul, Tokyo, Taipei, and Ljubljana.
About this role
Speak cares deeply about learners actually learning and improving with Speak. We have a dedicated Proficiency team to own how we measure learning efficacy and speaking proficiency, from unit-level mastery checks to standalone proficiency tests to onboarding placement, all in service of understanding users' proficiency levels and learning gains in an accurate, transparent and actionable manner. Because everything happens remotely and asynchronously in the app, keeping scores fair, stable over time, and resistant to gaming is both hard and genuinely interesting.
We're looking for an Assessment Design Lead: the person who defines what we measure, why, how, and signs off on whether our assessments actually measure the right thing. You will be staffed on the Proficiency team and report to the Head of Learning Design and Curriculum. If solving reliable, at-scale speaking assessment excites you and you want to directly shape Speak's efficacy story, we'd love to hear from you.
What you'll be doing
  • Own Assessment Design - Define what Speak measures, why, and how often across three distinct assessment types (Curriculum Mastery Assessment, Proficiency Test, Placement Test) - with the Proficiency Test as the immediate focus, expanding to the other two as the pod's priorities evolve. Keep constructs (fluency, pronunciation, grammar, task achievement) clearly separated and each aligned to CEFR or a comparable speaking proficiency standard, so no single assessment conflates domains it wasn't designed to measure.
  • Define Constructs & Build the Rubric/Blueprint Layer - Translate fuzzy goals like "measure fluency" or "measure pronunciation" into concrete, scoreable constructs, item blueprints, and rubrics that an item writer can generate items against and an ML Engineer can build a grading model against.
  • Own Validity & the Quality Bar - Sign off on content validity for every assessment that ships. Decide what "mastery" or a passing score operationally means, catch cases where an assessment is measuring the wrong thing before it ships, own the rubric/rater guidelines behind the human-labeled data our ML scoring models are evaluated against, and audit items/rubrics for bias across learner subgroups. Making sure scores stay comparable as the assessment evolves and stay meaningful against attempts to game an unproctored test.
  • Design and run the validity evidence plan - so validity is built into the process rather than checked only after launch. This includes concurrent/criterion studies benchmarking Speak's assessments against external proficiency measures (CEFR-anchored exams, expert human ratings), so we can say what a Speak Score means in terms the outside world already trusts.
  • Partner Tightly with Product and ML - Work closely with the Product Manager and ML Engineers on automated scoring, calibration, and feedback generation. You own the construct and quality bar, they own the model. Neither works without the other, and the loop between you is the product.

What we're looking for
Must-Haves
  • Assessment/Psychometric Design: 4+ years designing rubrics, blueprints, and item specs for a real, shipped language assessment product (or equivalent depth in closely related psychometric/measurement work) - not just academic theory. Can explain reliability and validity in plain language and knows how to catch a test that's measuring the wrong construct.
  • Language Proficiency Domain Expertise: Deep familiarity with frameworks like CEFR (or ACTFL, IELTS/TOEFL band descriptors) and what separates "did you learn what we taught you" from "how good is your speaking overall."
  • Fairness Across Learner Populations: Can identify whether an item or rubric unfairly penalizes specific L1 backgrounds or accents (differential item functioning) - essential for a speech-based test serving learners across dozens of native languages.
  • Translates Qualitative → Technical: Can turn a construct like "pronunciation quality" into something concrete enough for an ML engineer to build a scoring pipeline against, without either oversimplifying or getting lost in academic nuance.
  • Quantitative Rigor: Comfortable running or interpreting the statistics behind a rubric or rater system - inter-rater reliability (e.g., Cohen's/Fleiss' kappa), classical test theory, and basic IRT concepts - enough to know whether a scoring system is actually reliable, not just plausible.
  • Ownership of Quality Bar: Comfortable being the sign-off authority on content validity - makes the call clearly and follows through on it, rather than deferring to data alone or product pressure to ship.
  • AI Fluency & Judgment: Uses AI tools directly in their own workflow (e.g., drafting item variants, testing rubric language, exploring construct definitions) and has real judgment about when AI-generated output is precise enough to ship vs. needs a human rewrite - distinct from spec'ing work for the ML Engineer to build.
  • Comfort with Ambiguity: Comfortable operating in a 0-to-1 environment. Can wear multiple hats, take a fuzzy goal and turn it into a concrete plan, communicate tradeoffs clearly, and keep momentum without waiting for perfect clarity or team setup

Nice-to-Haves
  • Speech/pronunciation science background - can own pronunciation frameworks and L2-specific error taxonomy directly
  • Familiarity with adaptive testing or IRT-adjacent concepts (even if not the primary psychometrician)
  • Experience at a large-scale language testing organization or similar high-rigor assessment environment
  • Experience thriving in an EdTech startup environment, especially in a newly forming team or 0-to-1 mandate
  • Advanced degree (Master's or PhD) in psychometrics, measurement, applied linguistics, SLA, or a related quantitative field; track record of shipped assessment work still matters more
  • Has authored technical/validity reports or published assessment research

How We Work
This role is designed to be highly collaborative with our Assessment ML Engineer. Success depends on a tight loop where constructs, rubrics, and model outputs co-evolve together - from the earliest fuzzy construct through to a shipped scoring model - rather than a one-time handoff from a finished spec to an implementation.
Why work at Speak
  1. Join a fantastic, tight-knit team at the right time: we're growing very quickly, we've most recently raised our Series C from some of the top investors in the valley, and we've achieved product-market fit in our initial markets. You'd join at a magical time when a single person could significantly change the course of the company.
  2. Do your life's work with people you'll love working with: we care strongly about our craft and want every person at Speak to feel like they're growing every day. We believe in the idea that working with people you both enjoy and have respect for makes everything better. We hire thoughtfully and only work with people we admire deeply.
  3. Global in nature: We're live in over 40 countries and launching in a number of new markets soon. We have dedicated offices in San Francisco, Ljubljana, Seoul, Tokyo, and Taipei, and you'll have the opportunity to talk to users in each of these regions on a regular basis as well as travel.
  4. Impact people's lives in a major way: Learning a language is one of the single most life-changing skills one can learn, and right now 99% of people never achieve their goal because the process is broken. We're helping millions of people achieve their goals and improve their lives.

Speak does not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Apply