Job Summary:
webAI is seeking a Senior Machine Learning Engineer to support their Public Sector initiatives focused on building and optimizing production-ready AI systems. The role involves transforming prototype models into scalable and reliable production systems that operate across various hardware environments.
Responsibilities:
• Design, develop, and deploy agentic workflows to orchestrate multi-step reasoning, tool use, and decision-making across production systems.
• Productionize AI models from research prototypes into scalable, deployable systems used in real world applications.
• Engineer adaptive ML systems using LoRA, PEFT, and on-device inference strategies, leveraging PyTorch, TensorFlow, and Hugging Face Transformers for model development, fine-tuning, and optimization.
• Implement model optimization techniques such as quantization, pruning, distillation, and hardware specific acceleration.
• Build and maintain Retrieval Augmented Generation (RAG) pipelines, including vector database integration for contextual retrieval.
• Work with multi-modal AI systems across computer vision, audio, and natural language domains.
• Optimize model execution for distributed and resource constrained environments, ensuring reliability under variable connectivity conditions.
Qualifications:
Required:
• Active US Security clearance
• 4+ years of experience in applied AI, ML engineering, or production AI systems.
• Deep proficiency in PyTorch, TensorFlow, or Hugging Face Transformers.
• Proven experience deploying AI models across cloud, edge, and mobile hardware environments.
• Expertise in model compression and optimization (quantization, pruning, distillation).
• Experience building RAG pipelines and integrating vector databases (e.g., Quadrant, ChromaDB, FAISS, Milvus, Pinecone).
• Familiarity with multi-modal models and synthetic data generation methods.
• Strong algorithmic and problem solving skills, especially in distributed or constrained compute environments.
Preferred:
• Experience with edge AI, federated learning, or offline inference systems.
• Understanding of AI governance and compliance frameworks relevant to public sector deployments.
• Experience integrating models into large scale distributed systems or microservice architectures.
• Excellent communication and technical documentation skills for collaboration across multi disciplinary teams.
• Strong understanding of GPU computing, CUDA, and performance profiling.
Company:
The leader in private AI. Founded in 2020, the company is headquartered in Austin, USA, with a team of 51-200 employees. The company is currently Growth Stage.