Llm Evaluation Jobs in Bothell, WA (NOW HIRING)

The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in ...

The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in ...

Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time - RAG systems: Design retrieval-augmented generation systems that ...

Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time - RAG systems: Design retrieval-augmented generation systems that ...

Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time - RAG systems: Design retrieval-augmented generation systems that ...

Build and maintain LLM evaluation frameworks - including automated regression suites, human preference datasets, and task-specific benchmarks - to ensure consistent, trustworthy AI output * Architect ...

Build and maintain LLM evaluation frameworks - including automated regression suites, human preference datasets, and task-specific benchmarks - to ensure consistent, trustworthy AI output * Architect ...

Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science ...

MT/LLM Evaluation: Review machine-translated and AI-generated Turkish content for accuracy, fluency, and usability, determining whether content is publication-ready or requires post-editing.

Build and maintain LLM evaluation frameworks - including automated regression suites, human preference datasets, and task-specific benchmarks - to ensure consistent, trustworthy AI output* Architect ...

... • Conduct LLM evaluation using automated and human-in-the-loop techniques (offline + online). • Optimize inference workflows for latency, GPU utilization, and cost efficiency (quantization ...

Define's Client enterprise AI strategy and architecture, including platform selection, LLM evaluation, governance model, technical standards, and alignment with Client's long-term digital and ...

Define's Client enterprise AI strategy and architecture, including platform selection, LLM evaluation, governance model, technical standards, and alignment with Client's long-term digital and ...

Apple Services Engineering (ASE) powers the AI and LLM features behind experiences that hundreds of ... As these systems increasingly rely on human-in-the-loop evaluation, the quality of our products is ...

... Worked with LLM evaluation, observability, or guardrails • Have experience with cloud environments (AWS, GCP, Azure), containers, and basic Kubernetes concepts • Have shipped and operated ...

Apple Services Engineering (ASE) powers the AI and LLM features behind experiences that hundreds of ... As these systems increasingly rely on human-in-the-loop evaluation, the quality of our products is ...

Design and build benchmarks and evaluation methods that measure LLM capabilities in both text and multimodal modalities. * Apply post-training expertise (SFT, RLHF, reward modeling) to connect ...

LLM evaluation: Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time * RAG systems: Design retrieval-augmented ...

LLM evaluation: Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time * RAG systems: Design retrieval-augmented ...

LLM evaluation:** Build evaluation frameworks that measure LLM output quality (accuracy, actionability, calibration) and detect degradation over time - **RAG systems:** Design retrieval-augmented ...