Experience developing and executing testing strategies (manual and automated) for products and ... Experience with AI tools and LLM-related workflows, including data annotation and model training ...
Quick apply
Experience developing and executing testing strategies (manual and automated) for products and ... Experience with AI tools and LLM-related workflows, including data annotation and model training ...
LLM Algorithmic Optimization Engineer
San Jose, CA · On-site
$143K - $186K/yr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
LLM Algorithmic Optimization Engineer
San Jose, CA · On-site
$143K - $186K/yr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs. Implement ... Practical experience developing and deploying LLM-based or agent-driven systems. Demonstrated ...
New
Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs. Implement ... Practical experience developing and deploying LLM-based or agent-driven systems. Demonstrated ...
New
LLM Algorithmic Optimization Engineer
$143K - $186K/yr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
LLM Algorithmic Optimization Engineer
$143K - $186K/yr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
AI/LLM Engineers
Denver, CO · On-site
Job Summary : Pyramid Consulting, Inc. is seeking talented AI/LLM Engineers for a long-term ... Responsibilities : • Ability to design thorough test cases and support reliability testing across ...
New
AI/LLM Engineers
Denver, CO · On-site
Job Summary : Pyramid Consulting, Inc. is seeking talented AI/LLM Engineers for a long-term ... Responsibilities : • Ability to design thorough test cases and support reliability testing across ...
New
Conduct performance testing, code reviews, and implement DevSecOps best practices. Required Skills ... Working knowledge of LLM models, prompt engineering, and AI data pipelines. * Strong grasp of ...
Quick apply
Conduct performance testing, code reviews, and implement DevSecOps best practices. Required Skills ... Working knowledge of LLM models, prompt engineering, and AI data pipelines. * Strong grasp of ...
In this role, you will be responsible for rigorously testing the security and integrity of Large ... Familiarity with prominent LLM families (e.g., GPT series, Claude, Llama, PaLM) and their common ...
In this role, you will be responsible for rigorously testing the security and integrity of Large ... Familiarity with prominent LLM families (e.g., GPT series, Claude, Llama, PaLM) and their common ...
Strong statistical analysis skills: sampling, uncertainty quantification, significance testing ... LLM Evaluation Expertise: Demonstrated experience with LLM evaluation, benchmarking, alignment ...
Strong statistical analysis skills: sampling, uncertainty quantification, significance testing ... LLM Evaluation Expertise: Demonstrated experience with LLM evaluation, benchmarking, alignment ...
Software Engineering SMTS - LLM Gateway
Bellevue, WA · On-site
$138K - $182K/yr
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
Software Engineering SMTS - LLM Gateway
Bellevue, WA · On-site
$138K - $182K/yr
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$144K - $198K/yr
Experience building LLM, GNN serving platforms in largescale environments typical of major tech ... Practical experience delivering system design, application development, testing, and operational ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$144K - $198K/yr
Experience building LLM, GNN serving platforms in largescale environments typical of major tech ... Practical experience delivering system design, application development, testing, and operational ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$144K - $198K/yr
Experience building LLM, GNN serving platforms in largescale environments typical of major tech ... Practical experience delivering system design, application development, testing, and operational ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$144K - $198K/yr
Experience building LLM, GNN serving platforms in largescale environments typical of major tech ... Practical experience delivering system design, application development, testing, and operational ...
Chicago, IL Duration: 12 Months Skills: QA Automation, GenAI Validation * 60% is Device Testing and 40% is LLM / GenAI Validation (AI Testing) * Test automation experience is non-negotiable manual ...
Chicago, IL Duration: 12 Months Skills: QA Automation, GenAI Validation * 60% is Device Testing and 40% is LLM / GenAI Validation (AI Testing) * Test automation experience is non-negotiable manual ...
Contribute to the development of LLM-powered features from concept through deployment, including prototyping, testing, iteration, and implementation. * Support retrieval-augmented generation (RAG ...
Quick apply
Contribute to the development of LLM-powered features from concept through deployment, including prototyping, testing, iteration, and implementation. * Support retrieval-augmented generation (RAG ...
Contribute to the development of LLM-powered features from concept through deployment, including prototyping, testing, iteration, and implementation. * Support retrieval-augmented generation (RAG ...
Contribute to the development of LLM-powered features from concept through deployment, including prototyping, testing, iteration, and implementation. * Support retrieval-augmented generation (RAG ...
Software Engineering SMTS - LLM Gateway
$144K - $190K/yr
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
Software Engineering SMTS - LLM Gateway
$144K - $190K/yr
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$147K - $203K/yr
... testing, and operational stability for enterprise AI platforms. • Proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services. • Excellent ...
SR Principal Software Engineer - LLM Engineering
Palo Alto, CA · On-site
$147K - $203K/yr
... testing, and operational stability for enterprise AI platforms. • Proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services. • Excellent ...
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who ... Experience in test-driven development with focus on unit testing, integration testing and end-to ...
LLM Algorithmic Optimization Engineer - Intern
San Jose, CA · On-site
$38 - $46/hr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
LLM Algorithmic Optimization Engineer - Intern
San Jose, CA · On-site
$38 - $46/hr
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
... LLM inference as well as deployment across distributed and heterogeneous hardware environments ... Contribute to the entire pipeline from research, development, and testing, through to deployment on ...
This role involves ensuring the quality of LLM training data, maintaining testing environments, and analyzing errors. Candidates should possess strong coding skills, fluency in multiple languages ...
This role involves ensuring the quality of LLM training data, maintaining testing environments, and analyzing errors. Candidates should possess strong coding skills, fluency in multiple languages ...
Llm Testing information
See salary details
$11.78 - $16.22
4% of jobs
$16.22 - $20.65
3% of jobs
$20.65 - $25.09
7% of jobs
$25.09 - $29.52
8% of jobs
$30.82 is the 25th percentile. Wages below this are outliers.
$29.52 - $33.96
6% of jobs
$33.96 - $38.40
13% of jobs
The median wage is $40.15 / hr.
$38.40 - $42.83
20% of jobs
$47.01 is the 75th percentile. Wages above this are outliers.
$42.83 - $47.27
14% of jobs
$47.27 - $51.70
12% of jobs
$51.70 - $56.14
7% of jobs
$56.14 - $60.58
5% of jobs
$11
$39
$60
How much do llm testing jobs pay per hour?
As of Jun 6, 2026, the average hourly pay for llm testing in the United States is $39.41, according to ZipRecruiter salary data. Most workers in this role earn between $30.05 and $47.84 per hour, depending on experience, location, and employer.
Contractor
Medical, Dental, Vision, Life, Retirement, PTO
Posted 14 days ago
Job description
About the Role
The Product & Regulatory Operations organization plays a critical role in supporting user and business safety across platforms. This team partners closely with product, engineering, legal, and cross-functional stakeholders to deliver operational excellence for emerging and high-priority initiatives.
As a Technical Product Operations Specialist, you will drive product quality, growth, and operational efficiency through data-driven decision-making, technical tooling, and AI-enabled workflows. This role requires a high degree of autonomy, along with strong technical acumen and product sense to independently execute and scale solutions.
Key Responsibilities
- Drive execution strategy across multiple products and platforms, including launching 0→1 initiatives, accelerating delivery, and improving quality through technical and programmatic solutions
- Write and optimize advanced SQL queries to collect, transform, and analyze product data; identify trends and actionable insights
- Build and maintain dashboards, reports, and visualizations (e.g., Google Sheets or similar tools) to support stakeholder decision-making
- Leverage AI agents and AI-assisted tools to automate workflows, accelerate analysis, and prototype solutions
- Identify program risks proactively and develop data-backed mitigation strategies; communicate effectively across cross-functional teams
- Own end-to-end program management, including planning, execution, risk identification, and cross-team coordination
- Strengthen cross-functional partnerships and proactively remove blockers to drive execution
- Support data annotation, labeling, and LLM training initiatives to improve product quality
Minimum Qualifications
- 8+ years of experience in consulting, strategy, operations, or technical program management, with a focus on product operations
- Strong proficiency in SQL, including advanced queries (CTEs, joins, aggregations, window functions, transformations)
- Experience working with AI agents and AI-assisted workflows, including prompt iteration and automation use cases
- Advanced proficiency in Google Workspace (especially Sheets), including complex formulas, documentation, and workflow automation
- Experience managing multiple workstreams simultaneously with strong prioritization skills
- Self-starter with the ability to work independently and drive projects with minimal oversight
- Strong analytical and critical thinking skills with a data-driven approach to problem solving
- Proven organizational and time-management capabilities
- Experience with data annotation/labeling and LLM training workflows
Preferred Qualifications
- Experience with development tools such as VS Code or similar environments
- Experience with low-code/no-code prototyping or AI-assisted development
- Experience building dashboards using tools such as Tableau, Looker, or similar platforms
- Familiarity with data pipelines, ETL processes, and data infrastructure concepts
- Experience collaborating with engineering teams on technical requirements and specifications
- Background in quality assurance, triage operations, or ML/AI validation workflows
- Experience developing and executing testing strategies (manual and automated) for products and features
Team & Role Context
- Supports multiple cross-functional teams and products, providing technical operations support across diverse initiatives
- Requires a balance of technical execution and program management skills
- Ideal candidates thrive in fast-paced environments and can manage projects from initiation through delivery
Must-Have Skills
- Deep experience in technical product operations or program management
- Strong SQL and data analysis capabilities
- Experience with AI tools and LLM-related workflows, including data annotation and model training support
Nice-to-Have Skills
- Experience with low-code/no-code or AI-assisted development
- Understanding of data infrastructure and pipelines
- Experience with product testing and validation frameworks
Location: Remote
Role type: Contract 6 Month Position
Expected hours: 40 per week
Benefits:
- Dental insurance
- Health insurance
- Health savings account
- Life insurance
- Paid time off
- Retirement plan
- Vision insurance
Schedule:
- 8 hour shift
- Monday to Friday
Language:
- English (Required)
About Linda Werner & Associates
Sourced by ZipRecruiter