ZipRecruiter

Log In

1

Java Software Development Engineer In Test Jobs in Utah

Sentar, Inc.

Software Engineer

Roy, UT · On-site

Reviews and tests software components for adherence to the design requirements and documents test ... software development in at least one object-oriented programming language such as Java or C ...

Sentar

Software Engineer

Roy, UT · On-site

Reviews and tests software components for adherence to the design requirements and documents test ... software development in at least one object-oriented programming language such as Java or C ...

Sentar

Software Engineer

Roy, UT · On-site

Reviews and tests software components for adherence to the design requirements and documents test ... software development in at least one object-oriented programming language such as Java or C ...

previous page

Showing results 41-60

All JobsJava Software Development Engineer In Test JobsJava Software Development Engineer In Test Jobs in Utah

Java Software Development Engineer In Test information

What does a Java Software Development Engineer in Test do?

A Java Software Development Engineer In Test (SDET) is responsible for designing, developing, and maintaining automated test frameworks and scripts using Java. SDETs work closely with developers and QA teams to ensure the quality and reliability of software applications by writing code that tests other code. They also help identify bugs, create test plans, and contribute to continuous integration and deployment processes. SDETs play a key role in improving software quality and speeding up release cycles through automation.

What are the key skills and qualifications needed to thrive as a Java Software Development Engineer in Test?

To thrive as a Java Software Development Engineer In Test, you need strong programming skills in Java, a solid understanding of software testing principles, and experience with automated testing frameworks, often backed by a degree in computer science or related field. Familiarity with tools like Selenium, TestNG, JUnit, CI/CD systems, and source control platforms such as Git is typically required, along with knowledge of API testing and scripting. Excellent problem-solving abilities, attention to detail, and clear communication skills help you identify issues and collaborate effectively with development teams. These skills ensure the delivery of high-quality, reliable software by enabling thorough, efficient, and automated testing processes.

How does a Java Software Development Engineer in Test typically collaborate with developers and QA teams during the software development lifecycle?

A Java SDET works closely with both developers and QA teams to ensure software quality from the earliest stages of development. They participate in sprint planning, help define acceptance criteria, and design automated test frameworks that integrate smoothly with the development pipeline. Collaboration often involves reviewing code, sharing test results in real time, and troubleshooting issues together to accelerate the feedback loop. This hands-on involvement helps catch defects early and supports a culture of continuous integration and delivery.

What is the difference between Java Software Development Engineer In Test vs Java QA Engineer?

AspectJava Software Development Engineer In TestJava QA Engineer
Primary FocusDevelops automated tests, writes test frameworks, and ensures software quality through codingPerforms manual and automated testing, focuses on test execution and defect reporting
Skills & CertificationsJava programming, automation tools (Selenium, JUnit), scripting, CI/CD knowledgeTesting methodologies, Java basics, automation tools, bug tracking
Work EnvironmentSoftware development teams, Agile/Scrum environments, coding-intensiveTesting teams, collaboration with developers, sometimes manual testing

In summary, Java Software Development Engineer In Test roles focus on creating automated testing solutions and integrating testing into the development process, requiring strong coding skills. Java QA Engineers primarily perform testing activities, including manual and automated tests, often with less emphasis on developing testing frameworks.

What are popular job titles related to Java Software Development Engineer In Test jobs in Utah?

For Java Software Development Engineer In Test jobs in Utah, the most frequently searched job titles are:

What job categories do people searching Java Software Development Engineer In Test jobs in Utah look for?

The top searched job categories for Java Software Development Engineer In Test jobs in Utah are:

What cities in Utah are hiring for Java Software Development Engineer In Test jobs?

Cities in Utah with the most Java Software Development Engineer In Test job openings:

Java Software Development Engineer In Test jobs near you

Senior Software Engineer in Test (AI Agentic Systems)

Collective Health

Lehi, UT • On-site

$109K - $136K/yr

Full-time

Medical, Retirement, PTO

Re-posted 7 days ago

Collective Health rating

7.5

Company rating: 7.5 out of 10

Based on 6 frontline employees who took The Breakroom Quiz

207th of 500 rated business services

Job description

At Collective Health, we're transforming how employers and their people engage with their health benefits by seamlessly integrating cutting-edge technology, compassionate service, and world-class user experience design.
This is not a traditional QA role. You will be the quality owner for an LLM-based multi-agent pipeline that autonomously adjudicates health insurance claims for self-funded plan sponsors. You are building a Three-Tier Evaluation Framework to ensure our Gemini-powered agents reason correctly, call tools accurately, and produce DOL-ready outcomes.
You will work at the intersection of Vertex AI, healthcare compliance, and high-scale data engineering. Your work directly determines whether claims are paid correctly and whether the company can withstand a Department of Labor (DOL) or state DOI audit. The stakes are real, the domain is hard, and the problems are genuinely novel.
What you'll do:
  • Outcome Evaluation (The "What")
    • Golden Set Governance: Build and maintain a versioned library of "Grounding Data" results by working with senior claims examiners to define "Ground Truth."
    • Model-as-a-Judge Automation: Design automated "LLM-grading-LLM" workflows using custom rubrics to score factual grounding and policy compliance.
    • Semantic Assertion Framework: Develop testing libraries that move beyond string matching to validate semantic equivalence and numerical accuracy in agent outputs.
  • Trajectory Evaluation (The "How")
    • Function-Call Auditing: Use Vertex AI traces to programmatically verify that mandatory tools (via MCP) were invoked with correct arguments.
    • Orchestration Logic Validation: Assert that agents respect defined priorities across the four architectural layers: Data & Knowledge, Orchestration, Agentic Reasoning, and Tooling.
    • Reasoning Trace Auditing: Ensure every autonomous decision is traceable to a specific SOP sentence and a live API data point.
  • Continuous Automated Regression (The "Always")
    • CI/CD Integration: Every prompt or model update in Vertex AI Prompt Management must trigger an automated regression run.
    • Auto-SxS: Own the automated pairwise comparison process to detect logic drift between "New" and "Production" agent versions.
    • Mocking & Resilience: Build a Vertex AI/ADK mocking layer to simulate model responses, allowing for thousands of logic tests in seconds with zero API costs.
To be successful in this role, you'll need:
  • Required Skills (The Core Bar)
    • 5+ years of of experience in software testing and development
    • Python SDET Expertise: Expert in Python and pytest, specifically building custom mocking frameworks for external APIs (Vertex AI/ADK).
    • AI/LLM Observability: Hands-on experience with Vertex AI Experiments, Auto-SxS, and Cloud Logging for trace analysis.
    • Data Literacy: Expert-level SQL (BigQuery) and Pandas skills to "diff" massive datasets and identify adjudication discrepancies.
    • Prompt Engineering for QA: Ability to analyze "System Instructions" and refine prompts based on failed test cases to close logic gaps.
    • Architectural Testing: Experience testing multi-layer systems involving RAG (Vertex AI Search), state management (LangGraph), and function calling.
  • Preferred Skills (The "Nice-to-Haves")
    • Healthcare/Claims Domain: Familiarity with claims adjudication concepts (pend reason codes, COB, eligibility, stop-loss).
    • Compliance Knowledge: Understanding of HIPAA/PHI handling and writing test evidence for regulatory bodies (DOL/DOI).
    • Human-in-the-Loop Testing: Experience in "Shadow Mode" monitoring-comparing agent decisions against human expert (MCA) baselines.
Pay Transparency Statement
This is a hybrid position based out of our Lehi or Plano offices, with the expectation of being in office at least two weekdays per week. #LI-hybrid
The actual pay rate offered within the range will depend on factors including geographic location, qualifications, experience, and internal equity. In addition to the salary, you will be eligible for 115000 stock options and benefits like health insurance, 401k, and paid time off. Learn more about our benefits at https://jobs.collectivehealth.com/benefits/.
Lehi, UT Pay Range
$99,200-$124,000 USD
Plano, TX Pay Range
$109,120-$136,400 USD
Why Join Us?
  • Mission-driven culture that values innovation, collaboration, and a commitment to excellence in healthcare
  • Impactful projects that shape the future of our organization
  • Opportunities for professional development through internal mobility opportunities, mentorship programs, and courses tailored to your interests
  • Flexible work arrangements and a supportive work-life balance

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Collective Health is committed to providing support to candidates who require reasonable accommodation during the interview process. If you need assistance, please contact recruiting-accommodations@collectivehealth.com.
Privacy Notice
For more information about why we need your data and how we use it, please see our privacy policy: https://collectivehealth.com/privacy-policy/.

What Collective Health employees say

Pay

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply