1

Ai Rater Jobs in Texas (NOW HIRING)

With over 175+ million users, we're the #1 rated push-to-talk app in the world, delivering 9 ... The AI & Data team has more high-value AI use cases than capacity to build them. Today, the team ...

Software Engineer AI/ML

Fort Worth, TX

$109K - $131K/yr

Implement monitoring and observability for AI/ML systems to track model performance, data drift, prediction latency, and error rates; build automated alerting for model degradation * Design vector ...

Software Engineer AI/ML

Houston, TX

$109K - $131K/yr

Implement monitoring and observability for AI/ML systems to track model performance, data drift, prediction latency, and error rates; build automated alerting for model degradation * Design vector ...

... rates, and token consumption to optimize operational costs. Qualifications : Required : • ... A solid grasp of data privacy laws, data residency rules, and AI ethics. • Compliance with Client ...

Forward Deployed Engineer-AI

Dallas, TX · On-site +1

$165K - $225K/yr

Remote (US or Canada) Rate: $165,000-$225,000 USD (rates vary in Canada) Position Overview As a Forward Deployment Engineer - AI, you will work directly with enterprise clients to design, build ...

AI/ML Engineer Position: AI/ML Engineer Location: Malvern, PA (1st Choice); Charlotte, NC (2nd ... No Pay Rate: $58/Hr on W2 without benefits Bill Rate: $80 EXCLUSIVE OPENING!!! Vanguard Number of ...

Bachelor's degree required Pay Rate: $80/h W2 (TEKsystems) Position Overview We are seeking a highly experienced AI/ML Engineer with a strong background in software development, AI/ML architecture ...

They are seeking an AI Platform Administrator to manage and govern enterprise AI tools, ensuring ... rates, and token consumption to optimize operational costs. Qualifications : Required : • ...

Contract Pay Rate: $75 /Responsibilities: • AI Integration & Development: Design, develop, and implement AI-powered automation and applications using AWS Bedrock, LLMs (Large Language Models), or ...

... ratings, and observations using Google Sheets. - Participate in Google Wallet-related testing ... support AI model improvement and evaluation objectives. Requirements : - Must be based in the ...

New

Senior Applied AI Software Engineer ( AI)

Dallas, TX · On-site +1

$121K - $159K/yr

Experience with AI system evaluation, observability, reliability, fallback strategies, safety guardrails, latency optimization, and rate-limit management within enterprise production environments.

next page

Showing results 1-20

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are the most commonly searched types of Ai Rater jobs in Texas? The most popular types of Ai Rater jobs in Texas are:
What are popular job titles related to Ai Rater jobs in Texas? For Ai Rater jobs in Texas, the most frequently searched job titles are:
What cities in Texas are hiring for Ai Rater jobs? Cities in Texas with the most Ai Rater job openings:
Applied AI Engineer

Applied AI Engineer

Zello Inc

Austin, TX • On-site

Full-time

Posted 26 days ago


Job description

IMPORTANT: Please be aware, scammers may try to impersonate Zello by reaching out regarding job opportunities. We will never ask you for bank account information, checks, or other sensitive information as part of our hiring process. All correspondence will come from the zello.com email domain. If you're unsure, please email recruiting@zello.com with questions.
About Zello
Zello is a voice-first communication platform, powered by our industry-leading push-to-talk technology, to improve collaboration and productivity for desk-less workers. With over 175+ million users, we're the #1 rated push-to-talk app in the world, delivering 9 billion (yes, with a B) messages a month.
At Zello, our company values are at the heart of what we do everyday. We're proud to serve the frontline, we're privileged to connect people in times of crisis across the globe, and we're honored to support first responders.
And this is where you come in.
The AI & Data team has more high-value AI use cases than capacity to build them. Today, the team leads agent development directly alongside many other responsibilities, and this work needs a dedicated builder. This hire will be one of the first few Applied AI Engineers at Zello, responsible for taking AI agents from prototype to production and then owning their ongoing health: monitoring quality, managing human reinforcement workflows, and driving continuous improvement.
After a successful first year, you will
  • Shipped at least 3 production-grade AI agents within your first 90 days that internal teams actively use (Slack-integrated agents, workflow automations, data-driven assistants)
  • Built evaluation harnesses for deployed agents with automated quality scoring and regression detection
  • Integrated AI tools with Zello's existing systems (Slack, Jira, HubSpot, Snowflake) via APIs, with proper logging and monitoring in place
  • Established reusable code patterns and component libraries that make future agent development faster
  • Taken ownership of deployed agent operations: monitoring performance, overseeing human reinforcement workflows, triaging failures, and driving measurable improvement in agent quality over time
  • Independently scoped and shipped AI tools for new use cases, whether identified by stakeholders or discovered on your own

What you'll do
  • Build AI agents and automations end-to-end: from scoping the use case through deployment and ongoing maintenance
  • Write production Python code that integrates LLM APIs (prompt construction, response handling, context management, tool use) into real workflows
  • Connect AI tools with Zello's systems (Slack, Jira, HubSpot, Snowflake) through APIs, handling authentication, rate limits, error cases, and logging
  • Monitor deployed agents in production: track quality metrics, triage failures, and ship improvements based on real usage data
  • Manage human reinforcement operations: review agent outputs, maintain feedback loops, and tune agent behavior based on reinforcement signals
  • Build and maintain evaluation harnesses that catch regressions and measure agent quality programmatically
  • Create reusable components, patterns, and documentation that raise the bar for future development on the team
  • Communicate clearly with technical and non-technical stakeholders about what you've built, what's working, and where things need attention

Who you are
  • You have 2-5 years of professional experience in software engineering, AI engineering, or a related technical role. You're past the point of needing to learn basic professional work habits, but you haven't calcified into a single way of doing things.
  • You've written production Python and can point to real things you've built with it: tools, integrations, automations, shipped products. Not just notebooks or coursework.
  • You understand LLM APIs at a practical level. You can construct prompts, manage context windows, reason about token economics, and work with tool-use patterns.
  • You decompose messy problems into clean components with well-defined interfaces. When you describe a system you've built, people can follow the logic because you think in terms of abstractions, dependencies, and failure modes.
  • You've integrated systems via APIs before. You can read API docs, handle auth, manage rate limits, and deal with the inevitable edge cases of real-world integrations without getting stuck.
  • You have a quality instinct. You naturally ask "how do I know this is working?" and "how will I know when it breaks?" You write tests and build monitoring because you care about what happens after you ship, not because someone told you to.
  • You're comfortable with operational ownership. You don't treat deployment as the finish line. You monitor what you build, notice when things drift, review agent outputs, and do the sometimes unglamorous work of keeping AI systems healthy in production.
  • You pick up new frameworks, APIs, and domains quickly. You can point to examples of going from zero to productive in an unfamiliar area.
  • Your code is clean and documented. Other people can read it, understand it, and extend it without needing a walkthrough from you.

This role is not
  • A research role. We're building on top of foundation model APIs, not training models or publishing papers.
  • A data engineering role. The existing team covers data infrastructure. You'll consume data, not build pipelines.
  • A DevOps or infrastructure role. You'll deploy your own agents, but you won't be managing servers or building CI/CD from scratch.
  • A solo project. You'll work closely with the Data & AI team and cross-functional stakeholders who use what you build.

We hire for potential, passion for our mission, and a knack for solving difficult problems over checking every qualification box. We have competitive pay, equity with significant upside, and intentionally design our benefits to encourage healthy and well-balanced employees, flexible schedules and time off. We even offer a sabbatical after every five years of service so you're able to pursue and enjoy what matters most to you. And of course, we wouldn't be a technology company without a ping-pong table and free snacks in our break room. Join us!
Zello provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
All Zello personnel are required to comply with defined security, privacy, and compliance requirements applicable to their role along with requirements that are applicable to all Zello personnel.