1

Senior Ai Infrastructure Engineer Jobs in Texas (NOW HIRING)

Senior AI Infrastructure Engineer

Austin, TX

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

To learn more, visit Position Overview We are seeking a Senior AI Storage Infrastructure Engineer to build the critical data-delivery fabric of our AI-native NeoCloud. AI model training and inference ...

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

The Senior AI Cloud Infrastructure Engineer is responsible for owning the intake, provisioning, and operational delivery of enterprise AI platforms within the Infrastructure Enterprise Services (IES ...

next page

Showing results 1-20

Senior Ai Infrastructure Engineer information

What does a senior AI infrastructure engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are the key skills and qualifications needed to thrive as a senior AI infrastructure engineer?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.

What are some typical challenges faced by senior AI infrastructure engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in Texas?

The most popular types of Ai Infrastructure Engineer jobs in Texas are:

What are popular job titles related to Senior Ai Infrastructure Engineer jobs in Texas?

For Senior Ai Infrastructure Engineer jobs in Texas, the most frequently searched job titles are:

What job categories do people searching Senior Ai Infrastructure Engineer jobs in Texas look for?

The top searched job categories for Senior Ai Infrastructure Engineer jobs in Texas are:

What cities in Texas are hiring for Senior Ai Infrastructure Engineer jobs?

Cities in Texas with the most Senior Ai Infrastructure Engineer job openings:

Infographic showing various Senior Ai Infrastructure Engineer job openings in Texas as of August 2026, with employment types broken down into 76% Full Time, 6% Part Time, and 18% Contract. Highlights an 70% In-person, 12% Hybrid, and 18% Remote job distribution.

Senior AI Infrastructure Engineer

Seekr

Austin, TX

$107K - $146K/yr

Full-time

Re-posted 29 days ago


Job description

Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI agents.

You will work across distributed systems, Kubernetes, GPU infrastructure, high-performance inference, and enterprise AI platforms to build secure, scalable, and highly reliable systems capable of serving workloads ranging from edge AI deployments to trillion-parameter foundation models.

This role requires deep expertise in distributed systems, cloud-native infrastructure, AI platform engineering, and production software development. You will collaborate with research scientists, software engineers, product teams, and infrastructure engineers to define the architecture and technical direction of Seekr's AI platform.

Duties and Responsibilities

  • Design, develop, deploy, and maintain production AI infrastructure supporting model training, fine-tuning, inference, evaluation, and agentic AI workloads.
  • Design and operate scalable Kubernetes-based infrastructure supporting GPU-accelerated workloads across cloud, on-premises, hybrid, and edge environments.
  • Architect and optimize high-performance inference platforms capable of serving models ranging from resource-constrained edge deployments to trillion-parameter foundation models, with a focus on latency, throughput, scalability, reliability, and cost efficiency.
  • Build and maintain distributed systems that enable reliable scheduling, orchestration, deployment, monitoring, and lifecycle management of AI workloads.
  • Develop enterprise platforms supporting autonomous and multi-agent AI systems, including secure tool execution, orchestration, memory, evaluation, governance, and observability.
  • Design, implement, and automate AI infrastructure using Infrastructure-as-Code, GitOps, CI/CD pipelines, and modern software engineering practices.
  • Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware accelerators, and cloud-native platforms to improve platform performance, scalability, and reliability.
  • Collaborate with engineering, research, product, and cross-functional teams to deliver secure, scalable, and production-ready AI platforms.
  • Lead technical design discussions, perform architecture reviews, mentor engineers, and establish engineering standards and best practices across the AI Infrastructure organization.
  • Participate in production support activities, including troubleshooting complex distributed systems, performance tuning, incident response, and continuous operational improvement.

Skills and Qualifications

  • 5-8 years of professional software engineering experience building distributed systems, cloud infrastructure, or large-scale platform services
  • Strong production ML infra experience, executes complex work independently, owns significant components
  • 4 year or higher degree or additional relevant experience, in addition to years of work experience
  • Demonstrated success designing and operating production Kubernetes environments supporting cloud-native applications and distributed services.
  • Strong software engineering skills using Python and one or more modern programming languages such as Go, Rust, or C++.
  • Proven ability to design, build, and operate production AI or machine learning infrastructure.
  • Expertise developing and optimizing large-scale AI inference platforms, including GPU utilization, distributed inference, batching, caching, quantization, and accelerator performance.
  • Familiarity with modern AI serving technologies such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar platforms.
  • Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure automation using technologies such as Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, and Infrastructure-as-Code tools.
  • Experience developing enterprise AI platforms, autonomous agents, or multi-agent systems, including orchestration, tool execution, governance, observability, and evaluation.
  • Familiarity with event-driven architectures, distributed messaging systems, and public cloud platforms including AWS, Azure, Oracle Cloud Infrastructure, or Google Cloud Platform.
  • Demonstrated technical leadership, including driving architectural decisions, mentoring engineers, and leading complex technical initiatives across cross-functional teams.
  • Demonstrated ability to analyze, profile, and optimize AI systems for performance, scalability, reliability, and cost across distributed compute environments.