1

Crowd Testing Jobs (NOW HIRING)

... with a crowd as you are one-on-one is very important. People best suited for this role are ... Gathering & sourcing of targeted testing audience. Minimum Requirements: * Bachelor's degree or 4 ...

... testing, remodeling and infrastructure repair projects, and work through the Computerized ... Performs security responsibilities such as making security rounds, locking doors, and crowd control ...

Senior SWQA Test Development Engineer

Santa Clara, CA

$129.80K - $168.50K/yr

Excellent communication skills and experience working across geographically distributed teams Ways to Stand Out from the Crowd: * Experience testing AI/ML platforms, LLM pipelines, or inference ...

This business unit is unique, and we certainly aren't afraid to stand out from the crowd and tackle ... Experience with unit testing, integration testing, and end-to-end testing. * Experience with ...

This business unit is unique, and we certainly aren't afraid to stand out from the crowd and tackle ... Experience with unit testing, integration testing, and end-to-end testing. * Experience with ...

Scenario Testing: Create complex, real-world scenarios (e.g., varying lighting, crowd densities, weather conditions) to test algorithm robustness. * Automation: Develop and maintain automated test ...

We play a crucial role in testing the GPUs and SoCs shipped to customers worldwide. We look forward ... Ways to stand out from the crowd: * Strong handson experience in solving complex engineering issues ...

next page

Showing results 1-20

Crowd Testing information

See salary details

$10

$46

$69

How much do crowd testing jobs pay per hour?

As of Jun 3, 2026, the average hourly pay for crowd testing in the United States is $46.58, according to ZipRecruiter salary data. Most workers in this role earn between $34.86 and $59.13 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Crowd Tester, and why are they important?

To excel as a Crowd Tester, you need strong attention to detail, analytical thinking, and familiarity with software testing concepts, often supported by basic IT knowledge or relevant certifications. Competence with bug tracking tools, test case management systems, and various operating systems or mobile devices is commonly required. Strong communication, reliability, and the ability to follow detailed instructions help you stand out in this role. These skills ensure accurate testing, clear reporting, and valuable feedback for improving product quality.

What are the typical challenges faced by professionals working in crowd testing roles?

Crowd testing professionals often encounter challenges such as coordinating with a diverse group of testers from different time zones and backgrounds, ensuring consistent communication, and managing varying levels of tester expertise. Additionally, they must efficiently triage and validate a high volume of bug reports, distinguishing genuine issues from duplicates or low-priority findings. Adapting to rapidly changing project requirements and maintaining effective collaboration with remote teams and clients are also common aspects of the role.

What is crowd testing?

Crowd testing, also known as crowdsourced testing, is a software testing method that leverages a large, diverse group of remote testers from around the world to evaluate applications, websites, or digital products. These testers use real devices and environments, helping companies identify bugs, usability issues, and compatibility problems that might not be found in traditional in-house testing. Crowd testing is valued for its scalability, speed, and access to a wide variety of user perspectives, making it especially useful for consumer-facing products.

What is the difference between Crowd Testing vs Software Tester?

AspectCrowd TestingSoftware Tester
CredentialsBasic testing knowledge, sometimes certificationsOften requires testing certifications (e.g., ISTQB)
Work EnvironmentRemote, crowdsourced, flexibleTypically in-office or remote, dedicated team
Industry UsageUsed by companies seeking diverse device/browser testingUsed for ongoing quality assurance in software development

While both Crowd Testing and Software Testers focus on software quality, Crowd Testing involves a large, diverse group of testers often working remotely and on-demand, ideal for quick, broad testing. Software Testers are usually part of a dedicated team with specialized skills, focusing on detailed, structured testing processes.

More about Crowd Testing jobs
What states have the most Crowd Testing jobs? States with the most job openings for Crowd Testing jobs include:
Infographic showing various Crowd Testing job openings in the United States as of May 2026, with employment types broken down into 15% Full Time, and 85% Part Time. Highlights an 97% Physical, and 3% Remote job distribution, with an average salary of $96,884 per year, or $46.6 per hour.

Senior Software Engineer, Sports AI

Genius Sports

Los Angeles, CA

$160K - $230K/yr

Other

Posted 26 days ago


Job description

By bringing together next-gen technology and the finest live data available, Genius Sports is enabling a new era of sports for fans worldwide, delivering experiences that are more immersive, interactive and personalized than ever before.Learn more at geniussports.com.

About the Role  

We're looking for a Senior Software Engineer on our Sports AI team to help build the next generation of real-time AI systems powering sports analysis and insights. 

These systems transform live sports broadcasts (incorporating signals from video, crowd noise, audio commentary, and text) into a structured understanding of game context and auto-generated insights. The outputs from these systems power a range of products including automated highlight clipping, augmented broadcasts, semi-automatic play-by-play collection, and natural-language insight generation. For example, these systems can detect a goal, attribute it to the correct player, and localize where it occurred on the pitch within seconds by combining crowd noise spikes, commentary signals, and video cues. 

This role sits at the intersection of streaming and distributed systems, AI, and product engineering. You'll build and operate real-time pipelines that process noisy, asynchronous inputs under tight latency constraints. These systems combine traditional streaming and data processing techniques with modern multimodal AI models to produce reliable outputs in production. 

You'll work on challenges like aligning signals across multiple sources, handling uncertainty and inconsistency in model outputs, and designing systems that degrade gracefully in real-world conditions. We are early in building these capabilities, so the role involves working through ambiguity, experimenting with different approaches, and building new systems from first principles where established patterns don't yet exist. 

Key Responsibilities 

  • Design, build, and operate real-time streaming systems that convert live sports broadcasts into structured events, attributes, and insights
  • Ingest and synchronize signals from video, audio, commentary, and data feeds under real-world latency and reliability constraints
  • Integrate modern AI models into production systems, including multi-step pipelines where model outputs are composed, validated, and refined
  • Design and implement evaluation and observability frameworks to measure system quality, including offline benchmarks, real-time metrics, and regression testing
  • Develop mechanisms for identifying and handling uncertainty in model outputs, such as confidence scoring, validation checks, and human-in-the-loop workflows where appropriate
  • Own systems end-to-end from early prototypes through production, making key architectural decisions around scalability, reliability, and performance
  • Collaborate closely with product and data partners to shape, prioritize, and ship high-impact systems
  • Mentor engineers and help establish best practices for building and operating applied AI systems in production 

  
Qualifications  

  • 5+ years of experience building production-grade software systems 
  • Strong software engineering fundamentals including system design, testing, observability, and performance 
  • Experience building streaming, data-intensive, and/or distributed systems with real-time constraints
  • Proven ability to design scalable systems that are robust under real-world conditions, including handling partial failures, inconsistent data, and latency tradeoffs
  • Ability to evaluate system quality beyond traditional metrics (e.g., ambiguous or probabilistic outputs)
  • Product-minded: able to translate ambiguous problems into practical, high-impact solutions
  • Strong, demonstrated interest in building AI-powered features or systems; keep up with latest generative AI progress and capabilities
  • Comfortable working in fast-moving, iterative environments with evolving requirements 

  
Preferred Qualifications  

  • Hands-on experience integrating LLMs and other ML/AI systems in production workflows via platforms like Vertex AI or AWS Bedrock
  • Experience building or maintaining human-in-the-loop workflows
  • Familiarity with streaming systems and tooling (e.g., Pulsar, Kafka, Flink, etc.)
  • Experience working with audio/video streaming and processing systems, including familiarity with media delivery protocols (e.g., HLS, DASH, RTP), container formats, codecs, and tooling such as FFmpeg or GStreamer
  • Background or strong interest in sports
  • Experience with Rust 

The salary for this role is based on an annualized range of $160,000 - $230,000 USD. This role will also be eligible to take part in Genius Sports Group's benefits plan.

We enjoy an 'office-first' culture and maximize opportunities to collaborate, connect and learn together. Our hybrid working models differ depending on your role and location. Occasional travel may be required.

As well as a competitive salary and range of benefits, we're committed to supporting employee wellbeing and helping you grow your skills, experience and career. Learn more about how rewarding life at Genius can be at Reward | Genius Sports. One team, being brave, driving change

We strive to create an inclusive working environment, where everyone feels a sense of belonging and the ability to make a difference. Learn more about our values and culture at Culture | Genius Sports.

Let us know when you apply if you need any assistance during the recruiting process due to a disability.