HCL Global Systems Inc is seeking a Senior QA Engineer with strong experience in API testing and AI/LLM-based applications. The role involves designing test strategies for API-driven applications ...
HCL Global Systems Inc is seeking a Senior QA Engineer with strong experience in API testing and AI/LLM-based applications. The role involves designing test strategies for API-driven applications ...
Title and Summary Manager, AI Engineering (Tester ) Mastercard's Business & Market Insights (B&MI ... Design and own end-to-end LLM evaluation frameworks - including automated prompt regression ...
Title and Summary Manager, AI Engineering (Tester ) Mastercard's Business & Market Insights (B&MI ... Design and own end-to-end LLM evaluation frameworks - including automated prompt regression ...
Roles and Responsibilities: • Design and own end-to-end LLM evaluation frameworks - including ... testing exercises targeting prompt injection, jailbreaks, data leakage, context poisoning, and ...
Roles and Responsibilities: • Design and own end-to-end LLM evaluation frameworks - including ... testing exercises targeting prompt injection, jailbreaks, data leakage, context poisoning, and ...
AI Quality Engineer (AI QE)
Edina, MN · On-site
$74K - $96K/yr
The role focuses on AI/LLM testing, validation, automation, and quality engineering for AI-powered applications and intelligent workflows. Key Responsibilities: • Develop AI Quality Engineering and ...
AI Quality Engineer (AI QE)
Edina, MN · On-site
$74K - $96K/yr
The role focuses on AI/LLM testing, validation, automation, and quality engineering for AI-powered applications and intelligent workflows. Key Responsibilities: • Develop AI Quality Engineering and ...
Automation QA w/ AI testing
Fort Mill, SC · On-site
This role combines extensive Quality Engineering and software testing experience with hands-on AI model evaluation, production-grade LLM testing, test automation, and data-driven analysis. The ...
Automation QA w/ AI testing
Fort Mill, SC · On-site
This role combines extensive Quality Engineering and software testing experience with hands-on AI model evaluation, production-grade LLM testing, test automation, and data-driven analysis. The ...
AI Agentic Tester
Denver, CO · On-site
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
AI Agentic Tester
Denver, CO · On-site
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
AI Agentic Tester
Denver, MO · On-site +1
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. Test RAG pipelines, prompt engineering, and AI agent orchestration. Execute API testing using Postman, Swagger ...
AI Agentic Tester
Denver, MO · On-site +1
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. Test RAG pipelines, prompt engineering, and AI agent orchestration. Execute API testing using Postman, Swagger ...
AI Agentic Tester
Denver, MO · On-site +1
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
AI Agentic Tester
Denver, MO · On-site +1
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
Automation QA w/ AI testing
New York, NY · On-site
This role combines extensive Quality Engineering and software testing experience with hands-on AI model evaluation, production-grade LLM testing, test automation, and data-driven analysis. The ...
Automation QA w/ AI testing
New York, NY · On-site
This role combines extensive Quality Engineering and software testing experience with hands-on AI model evaluation, production-grade LLM testing, test automation, and data-driven analysis. The ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
Quick apply
Test Engineer-AI/LLM
Palo Alto, CA · On-site
This is a unique opportunity to pioneer testing methodologies for next-generation AI systems at the forefront of technology. We are also seeking a Contractor based LLM Evaluation & QA Engineer to ...
AI Agentic Tester (Remote)
Denver, MO · Remote
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
Quick apply
AI Agentic Tester (Remote)
Denver, MO · Remote
Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. * Test RAG pipelines, prompt engineering, and AI agent orchestration. * Execute API testing using Postman ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
This role combines strong software testing fundamentals with AI evaluation expertise. The ... LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
Reviews AI-enabled applications and LLM integrations for common risks (for example, prompt ... Exposure to testing AI-enabled applications (including LLM-based features) and familiarity with ...
AI/LLM Engineer
Ozone Park, NY · On-site
Develop production-ready solutions with appropriate testing, monitoring, and error handling. Guardrails & Responsible AI * Design and implement guardrails and safety mechanisms for LLM-powered ...
AI/LLM Engineer
Ozone Park, NY · On-site
Develop production-ready solutions with appropriate testing, monitoring, and error handling. Guardrails & Responsible AI * Design and implement guardrails and safety mechanisms for LLM-powered ...
Llm Tester information
What are popular job titles related to Llm Tester jobs?
For Llm Tester jobs, the most frequently searched job titles are:
Senior QA Engineer - API & AI/LLM Testing
Mason, OH • On-site
HCL Global Systems Inc
• IT Services • 1 - 5K employees1,001 - 5,000 employees
Full-time
Re-posted 6 days ago
Job description
Job Summary:
HCL Global Systems Inc is seeking a Senior QA Engineer with strong experience in API testing and AI/LLM-based applications. The role involves designing test strategies for API-driven applications, performing end-to-end testing, and collaborating with cross-functional teams to ensure quality in healthcare systems.
Responsibilities:
• Design and execute test strategies for API-driven applications
• Perform end-to-end testing across APIs, databases, and UI layers
• Validate data extraction and transformation logic, including AI/LLM outputs
• Develop and maintain automation frameworks for API and UI testing
• Perform data validation using SQL and NoSQL (DBeaver, MongoDB, or similar tools)
• Test chatbot and AI/LLM workflows Integrate automated tests into CI/CD pipelines
• Collaborate with cross-functional teams to ensure quality Identify, debug, and track defects through resolution
Qualifications:
Required:
• Strong experience in API testing (Postman, REST APIs)
• Hands-on automation experience (RestAssured, Selenium, Playwright, Cypress, or similar)
• Solid SQL and NoSQL skills for data validation
• Experience with CI/CD tools (Jenkins, Git, etc.)
• Understanding of microservices and integration testing
• Experience in healthcare domain (claims, benefits, eligibility)
• Exposure to AI/LLM-based applications (chatbots, data extraction, NLP)
• Familiarity with cloud platforms (AWS/Azure)
Preferred:
• Experience in testing AI projects
• LM Evaluation & Benchmarking: Design and execute 'LLM-as-a-Judge' frameworks to automatically score model outputs on continuous scales for accuracy, relevance, and tone.
• Hallucination & Bias Testing: Develop testing workflows to rigorously stress-test models against data hallucinations, toxic language, and gender/racial biases.
• Test Dataset Curation: Build and maintain high-quality, domain-specific golden datasets (input/output pairs) representing standard user queries and complex edge cases.
Company:
HCL Global Systems is a staffing and recruiting company providing consulting and business solutions. Founded in 2005, the company is headquartered in Farmington Hills, USA, with a team of 1001-5000 employees. The company is currently Late Stage.
HCL Global Systems Inc is seeking a Senior QA Engineer with strong experience in API testing and AI/LLM-based applications. The role involves designing test strategies for API-driven applications, performing end-to-end testing, and collaborating with cross-functional teams to ensure quality in healthcare systems.
Responsibilities:
• Design and execute test strategies for API-driven applications
• Perform end-to-end testing across APIs, databases, and UI layers
• Validate data extraction and transformation logic, including AI/LLM outputs
• Develop and maintain automation frameworks for API and UI testing
• Perform data validation using SQL and NoSQL (DBeaver, MongoDB, or similar tools)
• Test chatbot and AI/LLM workflows Integrate automated tests into CI/CD pipelines
• Collaborate with cross-functional teams to ensure quality Identify, debug, and track defects through resolution
Qualifications:
Required:
• Strong experience in API testing (Postman, REST APIs)
• Hands-on automation experience (RestAssured, Selenium, Playwright, Cypress, or similar)
• Solid SQL and NoSQL skills for data validation
• Experience with CI/CD tools (Jenkins, Git, etc.)
• Understanding of microservices and integration testing
• Experience in healthcare domain (claims, benefits, eligibility)
• Exposure to AI/LLM-based applications (chatbots, data extraction, NLP)
• Familiarity with cloud platforms (AWS/Azure)
Preferred:
• Experience in testing AI projects
• LM Evaluation & Benchmarking: Design and execute 'LLM-as-a-Judge' frameworks to automatically score model outputs on continuous scales for accuracy, relevance, and tone.
• Hallucination & Bias Testing: Develop testing workflows to rigorously stress-test models against data hallucinations, toxic language, and gender/racial biases.
• Test Dataset Curation: Build and maintain high-quality, domain-specific golden datasets (input/output pairs) representing standard user queries and complex edge cases.
Company:
HCL Global Systems is a staffing and recruiting company providing consulting and business solutions. Founded in 2005, the company is headquartered in Farmington Hills, USA, with a team of 1001-5000 employees. The company is currently Late Stage.
About HCL Global Systems
Sourced by ZipRecruiter
HCL Global Systems is One of the Best IT Consulting Firm specialized in Application Development, Quality Testing, IT Courses Training, Staffing and Recruitment services. With wide range of experience, We are confident in our ability to help our Customers grow and improve their businesses. More than likely, regardless of the nature and scope of the problem, Our dedicated Team of Professionals can help you to achieve a cost effective business solution.
Industry
It services
Company size
1,001 - 5,000 Employees
Headquarters location
Farmington Hills, MI, US
Year founded
2005