ZipRecruiter

Log In

1

Online Agi Jobs (NOW HIRING)

Amazon

Senior Inference Engineer, AGI

Sunnyvale, CA · On-site

$122K - $168K/yr

... online behavior (e.g., parity across sampling and logit processing) Work with the evaluation team to enable offline inference that captures the quality dimensions unique to real-time conversation ...

Ascensus Global Inc.

Spanish Linguist

Hagerstown, MD · On-site

$110K - $160K/yr

With ISO 9001:2015 and 17100:2015 certifications, AGI provides services in more than 100 languages ... Monitoring published, online, and broadcast media to identify relevant content * Writing Reports

Amazon

Senior Inference Engineer, AGI

Sunnyvale, CA · On-site

$122K - $168K/yr

... online behavior (e.g., parity across sampling and logit processing) Work with the evaluation team to enable offline inference that captures the quality dimensions unique to real-time conversation ...

Amazon

Senior Inference Engineer, AGI

Sunnyvale, CA · On-site

$122K - $168K/yr

... online behavior (e.g., parity across sampling and logit processing) • Work with the evaluation team to enable offline inference that captures the quality dimensions unique to real-time conversation ...

Amazon

Senior Inference Engineer, AGI

Sunnyvale, CA

$122K - $168K/yr

... online behavior (e.g., parity across sampling and logit processing) Work with the evaluation team to enable offline inference that captures the quality dimensions unique to real-time conversation ...

Amazon

Senior Inference Engineer, AGI

Sunnyvale, CA · On-site

$122K - $168K/yr

... online behavior (e.g., parity across sampling and logit processing) Work with the evaluation team to enable offline inference that captures the quality dimensions unique to real-time conversation ...

next page

Showing results 1-20

All Jobsagi Jobsremote JobsOnline Agi Jobs

Online Agi information

See salary details

$17.5K

$40.6K

$86K

How much do online agi jobs pay per year?

As of Aug 30, 2026, the average yearly pay for online agi in the United States is $40,596.00, according to ZipRecruiter salary data. Most workers in this role earn between $25,000.00 and $43,500.00 per year, depending on experience, location, and employer.

What is the difference between Online Agi vs Online Agi?

AspectOnline Agi

Since the comparison is between the same job title, there is no difference in roles, credentials, or work environment. Both refer to online agricultural advisors providing remote support to farmers and agribusinesses. They typically hold relevant certifications in agriculture or agronomy and work within the agriculture industry, often via online platforms or remote communication tools. The search intent for both terms is similar, focusing on remote agricultural consulting roles.

What cities are hiring for Online Agi jobs?

Cities with the most Online Agi job openings:

What are the most commonly searched types of Agi jobs?

The most popular types of Agi jobs are:

What states have the most Online Agi jobs?

States with the most job openings for Online Agi jobs include:

What job categories do people searching Online Agi jobs look for?

The top searched job categories for Online Agi jobs are:

Online Agi jobs near you
Infographic showing various Online Agi job openings in the United States as of August 2026, with employment types broken down into 50% Full Time, and 50% Part Time. Highlights an 100% In-person job distribution, with an average salary of $40,596 per year, or $19.5 per hour.

Senior Inference Engineer, AGI

Sunnyvale, CA • On-site

Amazon
IT Services • 10K+ employees

7.4

Company rating: 7.4 out of 10

Based on 7,128 frontline employees who took The Breakroom Quiz

6th of 39 rated national retailers

Good employer

Recommended by students

Paid breaks

Learn more about Amazonexternal

$122K - $168K/yr

Full-time

Posted 13 days ago

Job description

We are looking for a Senior Inference Engineer to own inference for real-time multimodal
conversational AI. This is a full-stack inference role: you will work across the entire path a model
takes from research to production - shaping model architecture so it is servable, building the
real-time runtime that serves it within hard latency budgets, and building the offline systems
that train and reinforce it.
You will operate at the boundary of Science and Inference, taking frontier-scale speech and
audio models and making them run within real-time latency budgets on production hardware.
You will co-design architectures with scientists to make them inference-friendly from inception,
own the low-latency streaming serving path, and build the training and reinforcement-learning
infrastructure that closes the loop. You will have the compute, data, and runway to solve
problems that few teams in the world are positioned to tackle.
As a Senior Engineer, you will own a significant area of the inference stack end to end, drive its
technical execution, contribute to the team's roadmap, and work closely with scientists and
hardware partners to ensure our models run fast enough to feel human in real time - and at a
cost that makes them viable at scale

You may go deep in one of the areas below while
contributing across the others.
Key job responsibilities
Model Architecture & Inference Co-Design
Partner with research scientists to make model architectures servable from inception -
surfacing the latency, memory, and cost implications of architecture choices before they are
locked in
Implement and optimize the inference path for large-scale multimodal models - attention
and KV-cache mechanisms, multimodal/autoregressive decoding, and the compute
primitives on the critical path
Apply efficiency techniques across the stack - quantization (per-tensor/per-channel/per-
group, INT8/FP8/BF16), speculative decoding, operator fusion, and paged KV-cache - and
quantify their quality/latency trade-offs
Develop and tune high-performance kernels for critical operations where off-the-shelf
implementations leave performance on the table, integrating them into production serving
with minimal overhead
Profile end-to-end performance with tools such as Nsight Compute/Systems and roofline
analysis to identify and eliminate bottlenecks in large-scale inference workloads
Real-Time & Interactive Runtime
Own the real-time serving path for streaming multimodal conversational AI, meeting sub-
second, streaming latency budgets under concurrent session load
Build and tune continuous batching, scheduling, and preemption to balance throughput
against per-request latency SLAs for interactive workloads
Customize production serving frameworks (e.g., vLLM, PyTorch) for real-time streaming
generative models that fall outside standard LLM serving patterns - sustained low-latency
output under concurrent session load
Implement multi-GPU inference (tensor parallelism, collective communication) for latency-
critical paths, and drive cost toward parity with existing production baselines
Establish latency, throughput, and cost benchmarking, and publish the operational metrics
that gate deployment
Offline Systems: Training, RL & Evaluation Infrastructure
Build and scale the offline inference systems behind post-training - high-throughput rollout
generation and reward-model serving for reinforcement learning (RL/RLHF/RLAIF)
Ensure train/serve consistency - that the inference path used in RL and evaluation
faithfully matches production online behavior (e.g., parity across sampling and logit
processing)
Work with the evaluation team to enable offline inference that captures the quality
dimensions unique to real-time conversation - latency sensitivity, audio quality, and
interaction naturalness

Amazon logo

About Amazon

Sourced by ZipRecruiter

Amazon.com, Inc., commonly known as Amazon, is an American multinational technology company. It was founded by Jeff Bezos in 1994 and initially started as an online marketplace for books. Since then, Amazon has expanded its operations and become one of the largest e-commerce companies in the world. Amazon's primary business is its online retail platform, where customers can purchase a vast array of products, including electronics, clothing, books, home goods, and much more. The company offers a convenient and user-friendly shopping experience, with features such as fast shipping, customer reviews, and personalized recommendations. In addition to its e-commerce platform, Amazon has diversified its business into various other areas. One of its notable ventures is Amazon Web Services (AWS), a comprehensive cloud computing platform that provides services such as storage, compute power, and database management to individuals and businesses. AWS has become a leader in the cloud computing industry, powering many websites and applications worldwide. Amazon has also developed its own consumer electronics, including the popular Amazon Kindle e-reader, Fire tablets, Fire TV streaming devices, and the Alexa-powered Echo smart speakers. The Alexa voice assistant, integrated into these devices, allows users to interact with their devices using voice commands, perform tasks, and access information. Furthermore, Amazon has expanded into media and entertainment. It operates Prime Video, a streaming service that offers a wide range of movies, TV shows, and original content. Amazon Music provides a platform for streaming and purchasing digital music, while Audible offers audiobooks and other audio content. The company's commitment to customer satisfaction and convenience is demonstrated by its membership program, Amazon Prime. Prime members receive various benefits, including free two-day shipping, access to streaming services, exclusive deals, and more.

Industry

It services, book publishers, retail, real estate, computer and electronic product manufacturing and software development

Company size

10,000+ Employees

Headquarters location

Seattle, WA, US

View All Amazon Jobs

What Amazon employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply