ZipRecruiter

Log In

1

Deepspeed Jobs in Texas (NOW HIRING)

Vkore Solutions

GenAI Engineer-W2

Austin, TX · On-site

Train and fine-tune LLMs using PyTorch, DeepSpeed, and LoRA. * Optimize inference using ONNX, vLLM, TensorRT, and GPU acceleration. * Manage datasets, preprocess data, and implement RAG with vector ...

TSMC

Senior AI Model Fine-Tuning Engineer

Austin, TX · On-site

$103K - $142K/yr

... DeepSpeed). • Experience in evaluating model performance, including using metrics like BLEU, ROUGE, perplexity, and custom evaluation frameworks. • Candidates must be willing and able to work on ...

Seekr

AI Site Reliability Engineer

Austin, TX · On-site

$56.50 - $75/hr

Working knowledge of GPU infrastructure, memory management, quantization, distributed training, and frameworks such as PyTorch, DeepSpeed, or FSDP. #LI-CT1 About the Company: Seekr is a leader in ...

webAI Inc

Staff R&D AI Engineer

Austin, TX · On-site

Experience with distributed training frameworks (DeepSpeed, FairScale, Horovod) and large-scale model training * Familiarity with edge AI deployment and model optimization techniques (quantization ...

Koch Industries

Senior LLM Engineer

Austin, TX · On-site

$195K - $255K/yr

Distributed training experience across multi-GPU/multi-node clusters (DeepSpeed, FSDP). * Publications, blog posts, or open-source contributions in generative AI. For this role, we anticipate paying ...

All JobsDeepspeed JobsDeepspeed Jobs in Texas

Deepspeed information

What is DeepSpeed?

Deepspeed is an open-source deep learning optimization library developed by Microsoft, designed to enable distributed training of large-scale models efficiently. It helps researchers and engineers train models that are too large to fit in the memory of a single GPU by offering features like ZeRO optimization, mixed-precision training, and advanced parallelism techniques. Deepspeed is widely used in the machine learning community for its scalability and performance improvements, making it easier to train state-of-the-art models on vast datasets. The library integrates seamlessly with PyTorch and supports training on multiple GPUs and even across multiple machines.

What are some common challenges faced by engineers working with DeepSpeed and how can they be addressed?

Engineers working with DeepSpeed often encounter challenges related to optimizing large-scale model training, such as managing memory efficiency and tuning distributed training parameters. Troubleshooting issues like gradient accumulation, parallelism strategies, and ensuring compatibility with different hardware setups can be complex. Collaborating closely with data scientists, DevOps, and research teams is essential for addressing these challenges, as is staying updated with the latest DeepSpeed releases and documentation. Regular participation in code reviews and knowledge-sharing sessions can also help engineers overcome technical hurdles and continuously improve model performance.

What are the key skills and qualifications needed to thrive as a DeepSpeed engineer, and why are they important?

To thrive as a DeepSpeed Engineer, you need a solid background in machine learning, deep learning frameworks (such as PyTorch), and distributed systems, often supported by a degree in computer science or a related field. Proficiency with DeepSpeed, parallel computing libraries, and cloud platforms, along with familiarity with tools like CUDA and NCCL, is typically expected. Strong problem-solving abilities, collaboration, and adaptability are crucial soft skills for optimizing large-scale AI models and working with cross-functional teams. Mastering these skills ensures efficient development and deployment of high-performance, scalable AI solutions in demanding environments.

What is the difference between Deepspeed vs Data Scientist?

AspectDeepspeedData Scientist
Required credentialsKnowledge of machine learning frameworks, programming skills in Python, experience with AI model trainingDegree in Data Science, Statistics, Computer Science, or related fields; strong analytical skills
Work environmentAI research labs, tech companies, cloud computing environmentsBusiness, tech companies, research institutions
Industry usageAI model training, deep learning optimizationData analysis, predictive modeling, business insights

Deepspeed focuses on optimizing large-scale AI model training and deep learning performance, while Data Scientists analyze data to generate insights and build predictive models. Both roles require technical skills but serve different purposes within the AI and data ecosystem.

What are popular job titles related to Deepspeed jobs in Texas?

For Deepspeed jobs in Texas, the most frequently searched job titles are:

What job categories do people searching Deepspeed jobs in Texas look for?

The top searched job categories for Deepspeed jobs in Texas are:

Deepspeed jobs near you
Infographic showing various Deepspeed job openings in Texas as of August 2026, with employment types broken down into 95% Full Time, 3% Part Time, and 2% Contract. Highlights an 83% Physical, 1% Hybrid, and 16% Remote job distribution.

GenAI Engineer-W2

Austin, TX • On-site

Vkore Solutions
See more jobs at Vkore Solutionsexternal

Contractor

Re-posted 23 days ago

Job description

We are looking for a GenAI Ops Engineer to train, fine-tune, and deploy Generative AI models (LLMs, Diffusion Models, Transformers, etc.). You will optimize model performance, manage training pipelines, and integrate AI solutions into production.

Key Responsibilities:

  • Train and fine-tune LLMs using PyTorch, DeepSpeed, and LoRA.
  • Optimize inference using ONNX, vLLM, TensorRT, and GPU acceleration.
  • Manage datasets, preprocess data, and implement RAG with vector databases (FAISS, Chroma, Pinecone).
  • Automate training workflows using ML flow, Weights & Biases, and Ray.
  • Deploy models using Kubernetes, Docker, and cloud AI services AWS or GCP.
  • Monitor model performance, mitigate drift, and optimize resource utilization.

Requirements:

  • Experience with LLM training, fine-tuning, and inference optimization.
  • Proficiency in Python, cloud AI services, and distributed training.
  • Familiarity with retrieval-augmented generation (RAG) and prompt engineering.
  • Strong problem-solving skills and ability to work in fast-paced AI environments.

Preferred:

  • Experience with open-weight models (LLaMA, Mistral, Gemma, Falcon, etc.).
  • Hands-on knowledge of multi-agent architectures and synthetic data generation.