1

Language Testing Evaluator Jobs in Decatur, GA (NOW HIRING)

Sr. Software Engineer

Atlanta, GA · On-site

$117K - $155K/yr

... language models, embeddings, retrieval-augmented generation (RAG), and MCP or similar agent ... testing, evaluation harnesses, observability, and review gates that hold AI-accelerated delivery to ...

Evaluation pipelines * Perform structured validation of model outputs and behavior. * Ensure ... Hands-on experience testing AI/ML systems. * Strong programming skills in at least one language:

Design Expert - Remote

Atlanta, GA · On-site +1

$30 - $70/hr

AI-assisted software development, natural-language-to-code workflows, and rapid prototyping ... Evaluation & Rubric Development Preferred Qualifications * 5+ years of experience as a product ...

Implementing systematic testing (e.g., RAG evaluation, stress testing) to ensure AI solutions meet ... Language Processing (NLP) and Generative AI. * Strong foundation in Python and cloud-native ...

Implementing systematic testing (e.g., RAG evaluation, stress testing) to ensure AI solutions meet ... Language Processing (NLP) and Generative AI. * Strong foundation in Python and cloud-native ...

Showing results 21-40

Language Testing Evaluator information

See Decatur, GA salary details

$28.8K

$63.9K

$104K

How much do language testing evaluator jobs pay per year?

As of Sep 9, 2026, the average yearly pay for language testing evaluator in Decatur, GA is $63,922.00, according to ZipRecruiter salary data. Most workers in this role earn between $43,400.00 and $77,600.00 per year, depending on experience, location, and employer.

What does a language testing evaluator do?

A Language Testing Evaluator is responsible for assessing and scoring language proficiency tests. They review written, spoken, or comprehension responses to determine a test taker’s language skills based on standardized criteria. Evaluators ensure that testing is fair, accurate, and consistent, often working for educational institutions, certification bodies, or language assessment companies. Their work helps determine language competency for academic placement, employment, or immigration purposes.

What are the key skills and qualifications needed to thrive as a language testing evaluator?

To thrive as a Language Testing Evaluator, you need strong linguistic knowledge, attention to detail, and often a degree in linguistics, education, or a related field. Familiarity with standardized testing platforms, scoring rubrics, and assessment software is typically required. Critical thinking, clear communication, and impartiality are important soft skills for evaluating language proficiency accurately and fairly. These skills ensure reliable assessment results that support fair placement, certification, or advancement decisions.

How does a language testing evaluator typically collaborate with other team members during the assessment process?

Language Testing Evaluators often work closely with test developers, psychometricians, and fellow evaluators to ensure the accuracy and fairness of assessments. Collaboration may involve participating in calibration sessions to maintain consistent scoring standards, providing feedback on test items, and discussing borderline cases. Regular meetings and communication with the team help maintain quality and reliability throughout the evaluation process, fostering a supportive environment where evaluators can learn from one another.
Infographic showing various Language Testing Evaluator job openings in Decatur, GA as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 14% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution, with an average salary of $63,922 per year, or $30.7 per hour.

Research Engineer - Post-Training & Small Language Models (SLMs), Healthcare AI

Atlanta, GA • On-site

Deloitte
Finance and Insurance • 10K+ employees

Full-time

Re-posted 3 days ago


Deloitte rating

8.2

Company rating: 8.2 out of 10

Based on 93 frontline employees who took The Breakroom Quiz

48th of 154 rated financial services


Job description

Research Engineer - Post-Training & Small Language Models (SLMs), Healthcare AI

Three hundred fifty million Americans rely on a healthcare system whose decision-making has become slow, costly, and adversarial - care delayed by prior authorization and paperwork, claims that misfire, clinical decisions made without the right information at the right moment, and patients who struggle to navigate or afford the care they need. Deloitte has a new AI-first effort,, backed by $1B in committed investment, building the reasoning models and agentic systems to rebuild how that system decides - across payers, providers, and life sciences, and for the patients they serve - so that care is faster, fairer, and far less wasteful. This is not AI applied at the margins. It is a ground-up rebuild of the decision-making machinery behind American healthcare, at national scale.

This is resourced to do real post-training at scale - committed investment in GPU compute and training infrastructure, not toy fine-tunes.

As a Research Engineer on our post-training team, you will design, train, evaluate, and align the models that reason about healthcare - working across the full post-training lifecycle to shape model behavior for clinical and operational decisioning across the industry. Healthcare decisioning is one of the cleanest verifiable-reward domains outside math and code: the problems are hard. We ground that reward in real signals - clinical policy and criteria, adjudicated outcomes, and clinical-expert judgment - so correctness is checkable rather than asserted.

You will own the post-training stack for our clinical reasoning models end to end - from data and reward design through trained, evaluated models that ship. This is not a prompt-engineering role. We are looking for people who understand not just how to use LLMs, but how to improve and shape model behavior through advanced post-training.

You do not need a healthcare background. We pair every engineer with clinical and domain experts and teach you the domain - you bring the modeling depth.

We hire on demonstrated depth, not years - the level you join at is determined through our interview process, based on the depth and judgment you demonstrate, not your years in a title.

Work you'll do

Post-training & alignment

Design and execute post-training pipelines: supervised fine-tuning (SFT), preference optimization, and reinforcement learning / alignment workflows.

Build and optimize training using techniques such as SFT, RLHF, PPO, DPO, GRPO, RLAIF, and Constitutional AI, and understand how each affects reasoning quality, safety, latency, cost, and reliability.

Train reasoning models for healthcare decisioning using verifiable-reward RL - designing reward signals and verifiers grounded in clinical guidelines, policy and criteria, and adjudicated outcomes.

Reward modeling & data

Develop reward models and preference datasets to improve reasoning quality, factuality, safety, policy adherence, and task performance.

Curate, clean, synthesize, and evaluate large-scale instruction, preference, and domain-specific datasets, with rigorous filtering, deduplication, and quality control.

Build verification and reward pipelines from our proprietary clinical, claims, and operational data and from clinical-expert labeling - turning guidelines, policy, and adjudicated outcomes into checkable reward signals at scale.

Efficient fine-tuning, training & inference infrastructure

Implement efficient fine-tuning strategies including LoRA, QLoRA, PEFT, and adapter-based approaches; build scalable distributed training using DeepSpeed, FSDP, Megatron-LM, Ray, or equivalent.

Optimize inference performance - latency, throughput, quantization, and deployment efficiency - for production, including frameworks such as vLLM, TensorRT-LLM, or TGI.

Small language models & open-weight models

Train and optimize open-weight models such as Llama, Qwen, Mistral, or DeepSeek; build specialized small language models (SLMs) for on-premise and cloud-hybrid deployment with strong performance-per-dollar.

Evaluation, safety & red teaming

Design evaluation frameworks covering reasoning, hallucination detection, factuality, instruction following, structured outputs, and domain-specific metrics.

Build healthcare-grade evaluation - held-out clinical benchmarks, deployment regression gates, calibration and uncertainty, factuality against ground truth, and bias/fairness evaluation across patient populations and subgroups - co-designed with clinical experts.

Apply PHI/HIPAA-aware data handling and produce model documentation suitable for regulated clinical use.

Perform red teaming and adversarial testing to identify alignment failures, unsafe behaviors, jailbreak vulnerabilities, and regression risks; collaborate with agentic and application teams to improve tool use, grounding, and long-horizon reasoning.

The team

Deloitte brings together AI researchers, modeling and platform engineers, architects, clinical and domain specialists, and product leaders to build, deploy, and operate verticalized AI systems across software, data, models, and cloud infrastructure - engineered for one of the most complex operating environments in the world. The work spans the healthcare industry - payers, providers, and life sciences - and involves genuinely hard reasoning problems, nuanced operational workflows, and a high bar for reliability, with little tolerance for shallow or unreliable outputs. We pair frontier AI research with production-grade engineering, and we ship into real clinical and operational settings rather than leaving models in the lab.

You can go deep. The team sub-specializes across post-training research, data and reward engineering, and training and inference infrastructure - you won't be expected to own all of it alone.

Qualifications - Required Skills and Experience

Bachelor's degree in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics, Computational Linguistics, or a related field.

Demonstrated depth training and post-training large transformer-based language models in production or research - this is your craft, not coursework or a one-off fine-tune. Genuine depth including SFT and at least one preference-optimization or RL method, evidenced by shipped models, releases, or research.

Hands-on experience with reasoning-model training and/or verifiable-reward (RLVR) workflows.

Strong understanding of modern post-training techniques: SFT, RLHF, PPO, DPO, GRPO, RLAIF, and preference optimization workflows.

Experience with open-weight foundation models such as Llama, Qwen, Mistral, DeepSeek, or equivalent architectures.

Strong expertise in PyTorch and modern deep-learning tooling; experience with distributed training frameworks such as DeepSpeed, FSDP, Megatron-LM, or Ray.

Experience implementing efficient fine-tuning techniques such as LoRA, QLoRA, PEFT, and quantization-aware workflows.

Deep understanding of transformer architectures, tokenization, attention mechanisms, decoding strategies, and model scaling trade-offs.

Strong grasp of LLM evaluation methodologies, benchmarking, reward modeling, and alignment trade-offs; experience with large-scale and synthetic datasets, filtering, deduplication, and quality-control pipelines.

Strong Python engineering skills and production-grade software practices; ability to work through ambiguous, highly complex technical problems in fast-moving environments.

Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.

Limited immigration sponsorship may be available.

Qualifications - Required Skills and Experience

Experience building or optimizing reasoning models, agentic models, or tool-using LLM systems.

Familiarity with inference optimization frameworks such as vLLM, TensorRT-LLM, TGI, or Ollama.

Experience with multimodal models, speech models, or domain-specific foundation models; experience using large-scale GPU clusters and distributed compute.

Contributions to open-source AI projects, research publications, benchmark development, or model releases.

Familiarity with safety, governance, and responsible-AI practices; experience in regulated or high-stakes industries such as healthcare, finance, insurance, or public sector.\

Wages and Salary

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $110,700-$379,200.

This position is aligned with the Core Talent Model. To view the associated benefit package, please reference this document: https://resources.deloitte.com/:b:/r/sites/dnet-tod-us/Shared Documents/Benefits/USBenefitsJourneyC...

Qualifications:

Research Engineer - Post-Training & Small Language Models (SLMs), Healthcare AI

Three hundred fifty million Americans rely on a healthcare system whose decision-making has become slow, costly, and adversarial - care delayed by prior authorization and paperwork, claims that misfire, clinical decisions made without the right information at the right moment, and patients who struggle to navigate or afford the care they need. Deloitte has a new AI-first effort,, backed by $1B in committed investment, building the reasoning models and agentic systems to rebuild how that system decides - across payers, providers, and life sciences, and for the patients they serve - so that care is faster, fairer, and far less wasteful. This is not AI applied at the margins. It is a ground-up rebuild of the decision-making machinery behind American healthcare, at national scale.

This is resourced to do real post-training at scale - committed investment in GPU compute and training infrastructure, not toy fine-tunes.

As a Research Engineer on our post-training team, you will design, train, evaluate, and align the models that reason about healthcare - working across the full post-training lifecycle to shape model behavior for clinical and operational decisioning across the industry. Healthcare decisioning is one of the cleanest verifiable-reward domains outside math and code: the problems are hard. We ground that reward in real signals - clinical policy and criteria, adjudicated outcomes, and clinical-expert judgment - so correctness is checkable rather than asserted.

You will own the post-training stack for our clinical reasoning models end to end - from data and reward design through trained, evaluated models that ship. This is not a prompt-engineering role. We are looking for people who understand not just how to use LLMs, but how to improve and shape model behavior through advanced post-training.

You do not need a healthcare background. We pair every engineer with clinical and domain experts and teach you the domain - you bring the modeling depth.

We hire on demonstrated depth, not years - the level you join at is determined through our interview process, based on the depth and judgment you demonstrate, not your years in a title.

Work you'll do

Post-training & alignment

Design and execute post-training pipelines: supervised fine-tuning (SFT), preference optimization, and reinforcement learning / alignment workflows.

Build and optimize training using techniques such as SFT, RLHF, PPO, DPO, GRPO, RLAIF, and Constitutional AI, and understand how each affects reasoning quality, safety, latency, cost, and reliability.

Train reasoning models for healthcare decisioning using verifiable-reward RL - designing reward signals and verifiers grounded in clinical guidelines, policy and criteria, and adjudicated outcomes.

Reward modeling & data

Develop reward models and preference datasets to improve reasoning quality, factuality, safety, policy adherence, and task performance.

Curate, clean, synthesize, and evaluate large-scale instruction, preference, and domain-specific datasets, with rigorous filtering, deduplication, and quality control.

Build verification and reward pipelines from our proprietary clinical, claims, and operational data and from clinical-expert labeling - turning guidelines, policy, and adjudicated outcomes into checkable reward signals at scale.

Efficient fine-tuning, training & inference infrastructure

Implement efficient fine-tuning strategies including LoRA, QLoRA, PEFT, and adapter-based approaches; build scalable distributed training using DeepSpeed, FSDP, Megatron-LM, Ray, or equivalent.

Optimize inference performance - latency, throughput, quantization, and deployment efficiency - for production, including frameworks such as vLLM, TensorRT-LLM, or TGI.

Small language models & open-weight models

Train and optimize open-weight models such as Llama, Qwen, Mistral, or DeepSeek; build specialized small language models (SLMs) for on-premise and cloud-hybrid deployment with strong performance-per-dollar.

Evaluation, safety & red teaming

Design evaluation frameworks covering reasoning, hallucination detection, factuality, instruction following, structured outputs, and domain-specific metrics.

Build healthcare-grade evaluation - held-out clinical benchmarks, deployment regression gates, calibration and uncertainty, factuality against ground truth, and bias/fairness evaluation across patient populations and subgroups - co-designed with clinical experts.

Apply PHI/HIPAA-aware data handling and produce model documentation suitable for regulated clinical use.

Perform red teaming and adversarial testing to identify alignment failures, unsafe behaviors, jailbreak vulnerabilities, and regression risks; collaborate with agentic and application teams to improve tool use, grounding, and long-horizon reasoning.

The team

Deloitte brings together AI researchers, modeling and platform engineers, architects, clinical and domain specialists, and product leaders to build, deploy, and operate verticalized AI systems across software, data,...


What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom