1

Ml Inference Jobs in Fort Washington, MD (NOW HIRING)

... inference * Implement MLOps practices using CI/CD, infrastructure as code, automated testing, and ... Optimize AI/ML services and infrastructure for performance, scalability, reliability, and cost ...

... inference * Implement MLOps practices using CI/CD, infrastructure as code, automated testing, and ... Optimize AI/ML services and infrastructure for performance, scalability, reliability, and cost ...

They are seeking AI/ML Engineers to build, deploy, and maintain machine learning models and data ... inference • Collaborate with software and DevOps teams for integration • Monitor model ...

... inference * Implement MLOps practices using CI/CD, infrastructure as code, automated testing, and ... Optimize AI/ML services and infrastructure for performance, scalability, reliability, and cost ...

Senior AI/ML Engineer

Arlington, VA · On-site

$120K - $165K/yr

Experience designing model-serving capabilities for batch and real-time inference * Experience ... Experience architecting AI/ML solutions within AWS, Azure, or Google Cloud * Experience with data ...

Senior AI/ML Engineer

Arlington, VA

$120K - $165K/yr

Experience designing model-serving capabilities for batch and real-time inference * Experience ... Experience architecting AI/ML solutions within AWS, Azure, or Google Cloud * Experience with data ...

Senior AI/ML Engineer

Arlington, VA · On-site

$140 - $210/hr

Experience designing model-serving capabilities for batch and real-time inference * Experience ... Experience architecting AI/ML solutions within AWS, Azure, or Google Cloud * Experience with data ...

Senior AI/ML Engineer

Arlington, VA · On-site

$120K - $165K/yr

Experience designing model-serving capabilities for batch and real-time inference * Experience ... Experience architecting AI/ML solutions within AWS, Azure, or Google Cloud * Experience with data ...

Senior AI Software Engineer

Washington, DC · On-site +1

$180K - $210K/yr

Experience integrating AI/ML inference into operational software systems. * Experience supporting National Security or Federal Civilian customers. Location: Hybrid or Remote with limited travel ...

Closure Technologies is seeking a AI/ML Engineer who will Implement and maintain Retrieval ... Familiarity with model evaluation frameworks, fine-tuning workflows, inference optimization, and AI ...

Showing results 21-40

Ml Inference information

See Fort Washington, MD salary details

$38.6K

$126.4K

$202.4K

How much do ml inference jobs pay per year?

As of Aug 15, 2026, the average yearly pay for ml inference in Fort Washington, MD is $126,427.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,500.00 and $140,100.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.

What cities near Fort Washington, MD are hiring for Ml Inference jobs?

Cities near Fort Washington, MD with the most Ml Inference job openings:

Cybersecurity AI/ML Engineer

Booz Allen Hamilton

Mclean, VA • On-site

Full-time

Re-posted 4 days ago


Booz Allen Hamilton rating

8.9

Company rating: 8.9 out of 10

Based on 49 frontline employees who took The Breakroom Quiz

9th of 72 rated business consultants


Job description

Job Summary:
Booz Allen Hamilton is a leading consulting firm, and they are seeking a Cybersecurity AI/ML Engineer to enhance their Cyber Operations teams. This role focuses on building, scaling, and operationalizing AI/ML systems to improve cybersecurity outcomes through innovative engineering practices and collaboration across various teams.
Responsibilities:
• Design, build, and deploy production AI/ML services for cybersecurity, including supervised and unsupervised detection models, anomaly and behavioral analytics, NLP on security text, retrieval-augmented generation (RAG) pipelines, agentic workflows, and LLM-assisted analyst tooling and own them end-to-end, data ingest → feature pipelines → training and tuning → packaging → deployment → serving → monitoring → retraining.
• Engineer scalable batch and streaming data and feature pipelines over security telemetry including logs, EDR, network, identity, cloud, and threat intel with online and offline parity, feature stores, schema and contract management, and reproducible datasets that power detection, triage, and hunting use cases.
• Build, harden, and operate ML platforms and inference services, including low-latency real-time scoring, batch inference, model packaging and containerization, autoscaling, canary and shadow deployments, observability, and rollback, to meet SOC throughput, latency, and reliability SLOs.
• Apply secure-AI and MLSecOps engineering practices throughout the AI/ML lifecycle, including model and data protection, prompt and inference risk mitigation, evaluation against adversarial inputs such as evasion, poisoning, and prompt injection, model and dataset supply chain security, and responsible AI controls.
• Integrate ML services and analytics into security tools and workflows such as SIEM, SOAR, EDR, IAM, or CSPM via APIs and event-driven architectures extending detection logic, enrichment, and response playbooks with custom ML/LLM capabilities where commercial tooling falls short.
• Develop automation, scripting, and infrastructure-as-code (IaC) to enable repeatable, testable, and version-controlled ML pipelines, model deployments, and security data integrations across cloud and on-prem environments.
• Collaborate across data science, platform, data, threat intelligence, and SOC operations teams to deliver end-to-end solutions, embed ML practices into DevSecOps and MLSecOps pipelines, and drive implementation through measurable operational outcomes.
Qualifications:
Required:
• 5+ years of experience in machine learning engineering, software engineering for ML, or applied AI platform development
• 3+ years of experience building and operating production ML systems including cybersecurity or security operations
• Experience developing, testing, and integrating ML services across security tools and platforms using APIs, automation, and workflow orchestration and applying AI and machine learning to cybersecurity use cases such as threat and anomaly detection, behavioral analytics, alert triage and prioritization, threat hunting support, analyst copilots, and response automation with measurable impact on SOC outcomes
• Experience software engineering in Python for ML and security use cases, including production-quality code, design patterns, unit and integration testing, packaging, version control, CI/CD, Docker containerization, and container orchestration including Kubernetes
• Experience working with the modern AI/ML stack, including PyTorch or TensorFlow, scikit-learn, Hugging Face, LangChain/LlamaIndex, agent frameworks, model serving frameworks, KServe, BentoML, Triton, Ray Serve, embedding-based retrieval, and vector databases such as pgvector, OpenSearch, Pinecone, Milvus
• Experience operationalizing AI/ML systems (MLOps), model versioning, experiment tracking, feature stores, evaluation harnesses, drift and quality monitoring, and CI/CD for models such as MLflow, Weights & Biases, SageMaker, Vertex AI, Azure ML, and Kubeflow
• Knowledge of secure AI implementation practices and frameworks including model and data protection, prompt and inference risk, agent guardrails, evaluation against adversarial inputs, ML supply chain security, and governance controls aligned to NIST AI RMF, OWASP LLM Top 10, and MITRE ATLAS
• Knowledge of modern cybersecurity threats and attack patterns, including ransomware, insider threats, credential abuse, data exfiltration, and AI-enabled attack techniques such as prompt injection, model evasion, data poisoning, and model theft
• Ability to obtain a Secret clearance
• Bachelor's degree
Preferred:
• Experience with programming or scripting languages used in ML, security, and automation environments such as Python, Go, Rust, SQL, PowerShell, and Bash
• Experience designing, deploying, and maintaining enterprise-scale ML and security systems for sensitive or regulated environments including FedRAMP, IL4, IL5, HIPAA, and PCI
• Experience designing and building agentic AI systems for security operations, multi-step reasoning, tool and function calling, retrieval pipelines, and human-in-the-loop workflows
• Experience fine-tuning, distilling, quantizing, or serving LLMs and other models for domain-specific security tasks, including automated eval harnesses and red-teaming AI systems
• Experience evaluating and integrating AI-enabled cybersecurity tooling such as AI-assisted SIEM, SOAR, UEBA, behavioral analytics, model-driven detection workflows into enterprise security operations via APIs and event-driven architectures
• Experience designing and implementing AI/ML services and pipelines over enterprise security telemetry spanning network, endpoint, application, identity, and cloud environments
• Knowledge of AI governance, model risk management, and policy controls aligned to enterprise and regulatory expectations for responsible AI use
• Knowledge of data governance frameworks, data classification standards, and privacy regulations such as GDPR and CCPA
• Knowledge of distributed data and streaming platforms, including Kafka, Kinesis, Spark, and Flink, database structures, data modeling fundamentals, and query optimization, including SQL and NoSQL
• IT Engineering, ML, or Security Certifications such as AWS, GCP, Azure ML Engineer, CKAD, CKA, CISSP, CCSP, CDPSE, cloud security Certifications, or AI security certifications such as ISC2 CAISS or IAPP AIGP Certification
Company:
Booz Allen Hamilton is a consulting firm that specializes in analytics, technology, and engineering. Founded in 1914, the company is headquartered in Mclean, USA, with a team of 10001+ employees. The company is currently Late Stage.

What Booz Allen Hamilton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Booz Allen Hamilton logo

About Booz Allen Hamilton

Sourced by ZipRecruiter

Booz Allen Hamilton is a leading provider of management and technology consulting services to the US government in defense, intelligence, and civil markets. Headquartered in McLean, Virginia, the firm also serves major corporations, institutions, and not-for-profit organizations. Founded in 1914 by Edwin G. Booz, the company has a long-standing tradition of helping clients achieve success by delivering a wide range of consulting services that include strategic planning, human capital and learning, communication, systems development, and others. The company's mission is to empower people to change the world, and it has a reputation for maintaining the highest standards of integrity and-excellence.

Industry

It services

Company size

10,000+ Employees

Headquarters location

McLean, VA, US

Year founded

1914