Llm Testing Jobs (NOW HIRING)

... Testing, LLM Testing. • LLM Testing • ASR - Speech-to-Text Testing • NLU - Intent Recognition and Entity Extraction Testing • Dialog Management Testing • NLG Testing • TTS - Text-to ...

... LLM testing tools, Jira, Confluence). - Oversee QA activities in a hybrid work environment in Phoenix, AZ, with occasional onsite meetings and adherence to agency policies.

Establish LLM testing frameworks, including mocking, stubbing, and deterministic validation strategies for non-deterministic systems * Manage flaky test mitigation, applying controlled seeds, mocked ...

AI/ML validation (LLM testing, model accuracy, hallucination detection) * Proficiency in API testing and validation of RESTful services. * Plus: Experience with performance/load testing tools K6 or ...

... LLM testing, search optimization, and prompt engineering. • Lead meetings with other AEs to solicit feedback and facilitate sharing of enhanced support workflows and AI-enhanced use cases.

... LLM Testing Define and execute test strategies for GenAI workflows including prompt engineering hallucination detection and model evaluation GenAILLM Simplify Build AI testing frameworks to validate ...

... LLM testing frameworks. • Experience with prompt fine-tuning techniques, LLMs optimization techniques(pre-training, post-training etc) • Collaborate with cross-functional agile teams of software ...

Adversarial AI and LLM testing What you bring to this role: * Bachelor's degree preferably in Cybersecurity, Information Security, Information Systems, Computer Science or Management Information ...

Adversarial AI and LLM testing What you bring to this role: * Bachelor's degree preferably in Cybersecurity, Information Security, Information Systems, Computer Science or Management Information ...

This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...

This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...

This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...

Human evaluation pipelines A/B testing frameworks Continuous feedback loops Continuously improve ... LLM ecosystems, RAG pipelines, and agentic AI architectures Strong hands-on experience with AWS ...

Develop Python-based evaluation frameworks , benchmarks, and testing utilities * Analyze model ... Proven experience in LLM response evaluation (quality, coherence, accuracy, bias, hallucinations)

Define metrics and build testing infrastructure to measure copilot quality, accuracy, and user ... Deep understanding of LLM architectures, prompting techniques, and their capabilities/limitations

Ability to create automated tests covering: oFunctional oAPI oIntegration oPerformance oSecurity oAI/ML validation (LLM testing, model accuracy, hallucination detection) * Proficiency in API testing ...

Perform LLM testing, search optimization, and prompt engineering. * Lead meetings with other AEs to solicit feedback and facilitate sharing of enhanced support workflows and AI-enhanced use cases.

Experience with LLM and LMM development and fine-tuning ... Experience applying ML techniques in manufacturing, testing, or hardware optimization.Proficiency ...

... LLM-powered applications for social impact in healthcare and public health. Commitment * 3-6 hours ... Support prompt engineering and testing * Help build and test RAG pipelines * Contribute to ...

You should be passionate about writing clean, maintainable code, implementing comprehensive testing ... LLM gateway serviceBuild and maintain integrations with multiple LLM providers and AI services ...