1

Ml Inference Jobs in Houston, TX (NOW HIRING)

... inference Qualifications: 6+ years of experience in ML Ops with strong knowledge in Kubernetes, Python, MongoDB and AWS. Good understanding of Apache SOLR. Proficient with Linux administration.

New

This role requires a technical expert who can develop, deploy, and maintain ML systems in ... Strong foundation in statistics, A/B testing, causal inference, and experimental design ...

Technical Architect 8

Houston, TX · On-site +1

$63.25 - $76.50/hr

Familiarity with ML fundamentals: feature engineering, model training pipelines, inference patterns, and vector/embedding-based retrieval * Practical experience with agentic AI or generative AI ...

Senior Software Engineer

Spring, TX

$109K - $143K/yr

Experience running local or on-device inference on NPUs and accelerators (Windows ML/DirectML, OpenVINO, TensorRT, CoreML, or vendor NPU toolchains). * Experience with computer vision - object ...

AI Solutions Architect

Houston, TX · On-site

$120 - $160/hr

Research and assess next‑generation technologies for inference, predictive modeling ... Experience applying AI/ML, optimization, and decision science to oilfield, drilling, completion ...

Showing results 21-40

Ml Inference information

See Houston, TX salary details

$35.8K

$117.2K

$187.7K

How much do ml inference jobs pay per year?

As of Sep 5, 2026, the average yearly pay for ml inference in Houston, TX is $117,212.00, according to ZipRecruiter salary data. Most workers in this role earn between $94,100.00 and $129,900.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What job categories do people searching Ml Inference jobs in Houston, TX look for?

The top searched job categories for Ml Inference jobs in Houston, TX are:

What cities near Houston, TX are hiring for Ml Inference jobs?

Cities near Houston, TX with the most Ml Inference job openings:

Full-time

Re-posted 9 days ago


Job description

NAVA Software solutions is looking for a Staff Data Scientist.
Details:
Staff Data Scientist
Location: Spring TX - Hybrid
Duration: Full time
Role Overview A highly skilled ML/AI Engineer or Data Scientist specializing in agentic AI possesses deep expertise in architecting and developing end-to-end intelligent solutions using AI agents, multi-agent workflows, and modern agentic platforms.
Core Technical Skills
  • Agentic AI & LLMs: Proficient in large language models (LLMs), retrieval-augmented generation (RAG), vector databases, and orchestration frameworks to design autonomous, context-aware systems that reason, plan, and act. Skilled in prompt engineering, model fine-tuning, and integrating emerging AI capabilities - such as tools, function calling, memory, and real-time inference - into robust, production-grade architectures that drive automation and intelligent workflow optimization.
  • Traditional ML: Solid foundation in classical machine learning algorithms including regression, classification, clustering, and ensemble methods (e.g., Random Forest, XGBoost). Able to select, train, and evaluate the right model for structured data problems, applying feature engineering, cross-validation, and hyperparameter tuning while understanding the trade-offs between traditional approaches and deep learning solutions.
  • DevOps & MLOps: Proficient in CI/CD pipelines, containerization (Docker, Kubernetes), and cloud platforms (Databricks, AWS, GCP, Azure). Experienced with infrastructure-as-code, automated testing, and deployment strategies such as blue-green and canary releases. Skilled in MLOps tooling - including experiment tracking (MLflow, Weights & Biases), model registries, and observability stacks - to ensure reliable, scalable, and auditable delivery of AI systems from development to production.

Experience Requirements
  • Overall Experience: 7-10 years of hands-on experience in machine learning, AI engineering, or data science, with a proven track record of delivering end-to-end AI solutions in production environments.
  • Agentic & GenAI Experience: 2-3 years of focused experience working with LLMs, agentic frameworks, and generative AI technologies, including real-world deployment of RAG pipelines or multi-agent systems.

Leadership & Collaboration
  • Team Leadership: Demonstrated experience leading and mentoring cross-functional AI/ML teams of 3-5 engineers, setting technical direction, conducting code reviews, and driving best practices across the team.
  • Stakeholder Management: Ability to communicate complex AI concepts clearly to non-technical stakeholders, align on priorities, and present findings and recommendations to senior leadership.
  • Project Ownership: Proven ability to own the full project lifecycle - from scoping and architecture through to deployment and iteration - while managing timelines, risks, and dependencies in an agile environment.

NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media