Llm Evaluation Jobs (NOW HIRING)

Info Way Solutions is seeking a highly skilled LLM Optimization & Evaluation Specialist to design, optimize, and evaluate large language model systems in production. This role focuses on prompt ...

Familiarity with LLM evaluation frameworks, structured benchmarking, or human-in-the-loop refinement methods (e.g., RLHF-style workflows). * Expertise with advanced retrieval techniques such as ...

Mentor engineering teams on LLM architecture, evaluation, performance tuning, and Agentic AI development. Required Education Bachelor's or Master's degree in Computer Science, Data Science ...

Experience with LLM evaluation frameworks and metric-driven iteration.

LLM Evaluation Frameworks & Responsible AI Practices * REST API Development & Automated API Testing * Java/Kotlin Development * CI/CD using Maven & Jenkins * Kubernetes Container Orchestration

Master's degree or PhD in Engineering, Computer Science, or a related technical field. * 5 years of experience with LLM evaluation, machine learning algorithms and tools, and general generative AI ...

The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in ...

LLM Evaluation & Optimization * Python / C# / JavaScript Development * REST APIs & Enterprise Integration Patterns * Azure Cloud Architecture * AI Solution Architecture & Design * Responsible AI ...

Highlight STEM engineering impact, Python/data tooling, and experience with data labeling, RLHF, LLM evaluation, training data quality, and annotation guidelines compliance.

The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in ...

Highlight STEM engineering impact, Python/data tooling, and experience with data labeling, RLHF, LLM evaluation, training data quality, and annotation guidelines compliance.

Implement LLM evaluation frameworks using LangSmith, Ragas, DeepEval, or custom evaluation pipelines to measure answer quality, groundedness, latency, and hallucination rates. * Apply LLMOps best ...

AI/LLM evaluation and LLM-as-a-Judge * Embeddings/vector search * Strong analytical and research skills * Experience with clinical, financial, or regulated domains is a plus.

AI Evaluation Experience Previous experience with AI evaluation, RLHF, prompt engineering, AI annotation, or LLM evaluation is strongly preferred . Candidates with exceptional finance expertise who ...

AI Evaluation Experience Previous experience with AI evaluation, RLHF, prompt engineering, AI annotation, or LLM evaluation is strongly preferred . Candidates with exceptional finance expertise who ...

Conduct research to advance the state-of-the-art in LLM evaluation methods, including training LLM judges; refining LLM-based data synthesis pipelines; and improving evaluation efficiency. * Build ...

Own the diagnostic loop for LLM-based clinical services: take failure modes surfaced by clinical ... Own the evaluation roadmap and quality bar for the team's AI services: which metrics gate ...

Implement LLM-based workflows including prompt engineering, evaluation, and RAG * Build knowledge retrieval pipelines to support IVR use cases (FAQs, troubleshooting, account queries) * Collaborate ...

LLM Evaluation metrics (accuracy, faithfulness and relevance) * Prompt/version tracking * Logging and Tracking * Human in the loop (HITL) feedback loops * Deployment and MLOPS * Containerization ...

AI Evaluation Experience Previous experience with AI evaluation, RLHF, prompt engineering, AI annotation, or LLM evaluation is strongly preferred . Candidates with exceptional finance expertise who ...