... g., model inference APIs, decision-support features, anomaly detection workflows) Design and ... delivering AI and ML features to user-facing applications Contribute to technical design ...
... g., model inference APIs, decision-support features, anomaly detection workflows) Design and ... delivering AI and ML features to user-facing applications Contribute to technical design ...
... inference systems and low-latency model serving Knowledge of adversarial ML and AI security/robustness techniques Experience with graph neural networks for network analysis Experience in design ...
... inference systems and low-latency model serving Knowledge of adversarial ML and AI security/robustness techniques Experience with graph neural networks for network analysis Experience in design ...
Experience with real-time inference systems and low-latency model serving * Knowledge of adversarial ML and AI security/robustness techniques * Experience with graph neural networks for network ...
Experience with real-time inference systems and low-latency model serving * Knowledge of adversarial ML and AI security/robustness techniques * Experience with graph neural networks for network ...
Senior Software Engineer
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Senior Software Engineer
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Experience with computer vision, sonar image processing, or onboard ML inference * Exposure to systems like Blue Robotics hardware, Water Linked systems, or similar AUV platforms Background in ...
Experience with computer vision, sonar image processing, or onboard ML inference * Exposure to systems like Blue Robotics hardware, Water Linked systems, or similar AUV platforms Background in ...
Lead ML Ops Engineer
Naples, FL · On-site
$96K - $127K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops Engineer
Naples, FL · On-site
$96K - $127K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops engineer
Orlando, FL · On-site
$95K - $125K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops engineer
Orlando, FL · On-site
$95K - $125K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops Engineer
Orlando, FL · On-site
$95K - $125K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops Engineer
Orlando, FL · On-site
$95K - $125K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Senior Software Engineer
West Palm Beach, FL · On-site
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Senior Software Engineer
West Palm Beach, FL · On-site
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Senior Software Engineer
West Palm Beach, FL · On-site
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Senior Software Engineer
West Palm Beach, FL · On-site
$118K - $156K/yr
Develop and integrate AI/ML inference pipelines on Jetson Orin (TensorRT, DeepStream, ONNX Runtime) for object detection, contact classification, and situational awareness derived from EO/IR, radar ...
Lead AI/ML Software Engineer
Tampa, FL · On-site
Partner with AI/ML engineers on model integration, inference optimization, and the operational deployment of agentic workflows within [R]AIMS * Engage directly with customers and program stakeholders ...
Lead AI/ML Software Engineer
Tampa, FL · On-site
Partner with AI/ML engineers on model integration, inference optimization, and the operational deployment of agentic workflows within [R]AIMS * Engage directly with customers and program stakeholders ...
Autonomy & Software Engineer
Miami, FL · On-site
Experience with computer vision, sonar image processing, or onboard ML inference * Exposure to systems like Blue Robotics hardware, Water Linked systems, or similar AUV platforms Background in ...
Autonomy & Software Engineer
Miami, FL · On-site
Experience with computer vision, sonar image processing, or onboard ML inference * Exposure to systems like Blue Robotics hardware, Water Linked systems, or similar AUV platforms Background in ...
Lead ML Ops engineer
Naples, FL · On-site
$96K - $127K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
Lead ML Ops engineer
Naples, FL · On-site
$96K - $127K/yr
... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... ML platform engineering, spanning MLOps, LLMOps, and AIOps. • Ability to define and enforce ...
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
AI Software Engineer
Sarasota, FL · On-site
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
AI Software Engineer
Sarasota, FL · On-site
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
... inference systems and low-latency model serving Knowledge of adversarial ML and AI security/robustness techniques Experience with graph neural networks for network analysis Experience in design ...
... inference systems and low-latency model serving Knowledge of adversarial ML and AI security/robustness techniques Experience with graph neural networks for network analysis Experience in design ...
AI Software Engineer
Sarasota, FL · On-site
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
Quick apply
AI Software Engineer
Sarasota, FL · On-site
... inference in dynamic mission environments. Job Responsibilities * SIGINT Processing: Design and implement AI/ML models for event characterization, pattern recognition, and anomaly detection within ...
Experience with real-time inference systems and low-latency model serving * Knowledge of adversarial ML and AI security/robustness techniques * Experience with graph neural networks for network ...
Experience with real-time inference systems and low-latency model serving * Knowledge of adversarial ML and AI security/robustness techniques * Experience with graph neural networks for network ...
Principal MLOps Engineer
Tampa, FL · On-site
Support model serving and inference infrastructure for a range of ML use cases, including traditional ML, computer vision, speech/audio, and LLM-based systems * Build and maintain CI/CD workflows for ...
Principal MLOps Engineer
Tampa, FL · On-site
Support model serving and inference infrastructure for a range of ML use cases, including traditional ML, computer vision, speech/audio, and LLM-based systems * Build and maintain CI/CD workflows for ...
Ml Inference information
What is ML inference?
ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.
What is the difference between Ml Inference vs Data Scientist?
| Aspect | ML Inference | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of machine learning models, programming skills | Degree in data science, statistics, or related fields |
| Work Environment | Deploying models in production, real-time data processing | Data analysis, model development, research |
| Industry Usage | AI product deployment, software companies | Research institutions, tech firms, consulting |
ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.
Which 3 jobs will survive AI?
For ML Inference roles, jobs that require complex problem-solving, creativity, and emotional intelligence are more likely to persist, such as data scientists, AI ethics specialists, and machine learning engineers. These roles involve tasks that are difficult to automate and often require specialized skills, domain knowledge, and critical thinking. Continuous learning and expertise in AI tools and programming languages like Python or TensorFlow can also enhance job security in this field.
What engineers make $500,000?
Senior machine learning engineers with extensive experience, specialized skills in deep learning, and strong industry demand can earn $500,000 or more annually, especially in high-cost-of-living areas or within top tech companies. Achieving this level typically requires advanced degrees, certifications, and a proven track record of impactful projects.
What is a $900,000 AI job?
A $900,000 AI job typically refers to high-level roles in artificial intelligence, such as senior machine learning engineers or AI research directors, often requiring advanced skills in deep learning, data science, and experience with tools like TensorFlow or PyTorch. These positions usually involve leadership responsibilities, strategic planning, and may require multiple years of specialized experience or advanced degrees.
Is ML a high paying job?
Machine Learning (ML) inference roles are generally well-paid due to the specialized skills required, such as knowledge of algorithms, programming, and data analysis. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech positions. Advanced roles often require proficiency with tools like TensorFlow or PyTorch and may include certifications or advanced degrees.
What are some common challenges faced by ML Inference Engineers when deploying models to production?
ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.
What are the key skills and qualifications needed to thrive in ML Inference, and why are they important?
To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.
What are popular job titles related to Ml Inference jobs in Florida? For Ml Inference jobs in Florida, the most frequently searched job titles are:
What job categories do people searching Ml Inference jobs in Florida look for? The top searched job categories for Ml Inference jobs in Florida are:
What cities in Florida are hiring for Ml Inference jobs? Cities in Florida with the most Ml Inference job openings:
$114K - $151K/yr
Other
Medical, Dental, Vision, Life, Retirement, PTO
Posted 28 days ago
Job description
540 is seeking a Senior Software Engineer (AI/ML) to support our partnership with Google and the Department of Defense in advancing mission-critical capabilities for a global data processing platform. This platform leverages Machine Learning, modern cloud and containerized technologies to ingest, process, and analyze high-volume, time-series data. The system leverages cloud-native infrastructure, while incorporating AI/ML capabilities to enhance signal analysis, anomaly detection, and data-driven insights. Engineers on this team build and scale full-stack features across user interfaces, backend services, and data pipelines that power mission-critical analytics. You’ll play a key role in integrating AI/ML-driven capabilities into production systems, enabling faster, more accurate operational decision-making. Location: Patrick SFB, FL or Arlington, VA. Candidates should be local to either location. Onsite support may be required based on mission and customer needs. Travel up to 25%.
Citizenship & Clearance Requirement: Per client requirements, candidates must be U.S. Citizens with an active DoD clearance with TS/SCI eligibility
Education Requirement: Bachelor's Degree in Computer Science or related field (preferred)
540 Internal Thrive Level: Senior Software Engineer WHY 540? 540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems. HOW YOU’LL DRIVE IMPACT Design and develop machine learning models and applications for deployment to cloud-native services
Collaborate with data engineers and data scientists to productionize machine learning models and data pipelines
Collaborate with a cross-functional team of architects, engineers, and scientists to design and deploy Machine Learning Operations (MLOps) at scale Integrate AI/ML capabilities into production systems (e.g., model inference APIs, decision-support features, anomaly detection workflows)
Design and optimize data models and persistence layers to support both transactional and analytical workloads
Enable intelligent application behavior by delivering AI and ML features to user-facing applications
Contribute to technical design documentation and system architecture artifacts
Lead or participate in code reviews, testing, and troubleshooting to ensure high-quality software
Drive system reliability through robust testing
Improve system performance, scalability, and reliability as the platform evolves REQUIRED SKILLS & EXPERIENCE 8+ years of professional software development experience
Experience developing microservices in containerized environments
Experience with, or a strong conceptual understanding of, LLM-based applications, RAG pipelines, and AI-driven decision systems
Experience with Python
Experience working with relational databases and data warehouses
Experience integrating AI/ML capabilities into applications (e.g., working with model inference APIs, ML pipelines, or data-driven features)
Ability to produce technical design documentation (system diagrams, architecture artifacts)
Familiarity with MLOps concepts (model deployment, monitoring, versioning)
Ability to design with future scalability and platform evolution in mind Demonstrated ownership and ability to drive work from concept to production
Strong problem-solving skills and ability to navigate ambiguity
Excellent communication skills, including working directly with stakeholders or clients NICE TO HAVE Experience with Google Cloud Platform (GCP) or similar cloud environments
Experience designing and consuming RESTful APIs
Experience with API gateways and API management platforms, such as Google Apigee
Familiarity with API authentication and authorization (PKI, OAuth2, JWT, LDAP, SAML, etc.)
Experience working on U.S. Federal Government programs, particularly DoD environments
Google Cloud Professional-level certifications BENEFITS & PERKS Flexible PTO + all Federal holidays off
Health, dental and vision insurance plans
Flexible Spending Account (FSA)
401k with employer match
Company-sponsored life insurance, short- and long-term disability Professional development (training, certifications, conferences)
Paid cloud developer accounts
Referral bonuses
HQ office perks (parking / metro reimbursement, nitro coffee & lunches) Annual social events (540 Week, hackathon, charity golf tournament, etc.)
Access to 540’s Washington Capitals & Nationals tickets EQUAL EMPLOYMENT OPPORTUNITY (EEO) 540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
Citizenship & Clearance Requirement: Per client requirements, candidates must be U.S. Citizens with an active DoD clearance with TS/SCI eligibility
Education Requirement: Bachelor's Degree in Computer Science or related field (preferred)
540 Internal Thrive Level: Senior Software Engineer WHY 540? 540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems. HOW YOU’LL DRIVE IMPACT Design and develop machine learning models and applications for deployment to cloud-native services
Collaborate with data engineers and data scientists to productionize machine learning models and data pipelines
Collaborate with a cross-functional team of architects, engineers, and scientists to design and deploy Machine Learning Operations (MLOps) at scale Integrate AI/ML capabilities into production systems (e.g., model inference APIs, decision-support features, anomaly detection workflows)
Design and optimize data models and persistence layers to support both transactional and analytical workloads
Enable intelligent application behavior by delivering AI and ML features to user-facing applications
Contribute to technical design documentation and system architecture artifacts
Lead or participate in code reviews, testing, and troubleshooting to ensure high-quality software
Drive system reliability through robust testing
Improve system performance, scalability, and reliability as the platform evolves REQUIRED SKILLS & EXPERIENCE 8+ years of professional software development experience
Experience developing microservices in containerized environments
Experience with, or a strong conceptual understanding of, LLM-based applications, RAG pipelines, and AI-driven decision systems
Experience with Python
Experience working with relational databases and data warehouses
Experience integrating AI/ML capabilities into applications (e.g., working with model inference APIs, ML pipelines, or data-driven features)
Ability to produce technical design documentation (system diagrams, architecture artifacts)
Familiarity with MLOps concepts (model deployment, monitoring, versioning)
Ability to design with future scalability and platform evolution in mind Demonstrated ownership and ability to drive work from concept to production
Strong problem-solving skills and ability to navigate ambiguity
Excellent communication skills, including working directly with stakeholders or clients NICE TO HAVE Experience with Google Cloud Platform (GCP) or similar cloud environments
Experience designing and consuming RESTful APIs
Experience with API gateways and API management platforms, such as Google Apigee
Familiarity with API authentication and authorization (PKI, OAuth2, JWT, LDAP, SAML, etc.)
Experience working on U.S. Federal Government programs, particularly DoD environments
Google Cloud Professional-level certifications BENEFITS & PERKS Flexible PTO + all Federal holidays off
Health, dental and vision insurance plans
Flexible Spending Account (FSA)
401k with employer match
Company-sponsored life insurance, short- and long-term disability Professional development (training, certifications, conferences)
Paid cloud developer accounts
Referral bonuses
HQ office perks (parking / metro reimbursement, nitro coffee & lunches) Annual social events (540 Week, hackathon, charity golf tournament, etc.)
Access to 540’s Washington Capitals & Nationals tickets EQUAL EMPLOYMENT OPPORTUNITY (EEO) 540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
About 540.co
Sourced by ZipRecruiter