1

Ml Inference Jobs in Canton, GA (NOW HIRING)

Staff Machine Learning Engineer - Leasing

Atlanta, GA · On-site

$16.25 - $19.25/hr

... ML systems at scale. * Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making. * Inference & Training: Has ...

Machine Learning Platform Engineer

Atlanta, GA · On-site +1

$155K - $185K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... inference in * MLOps Expertise , deep experience building a platform for managing the full ML lifecycle (training, deploying, monitoring) using tools like SageMaker, VertexAI, Vector DBs, Graph ...

Machine Learning Platform Engineer

Atlanta, GA · On-site

$155K - $185K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... inference in * MLOps Expertise , deep experience building a platform for managing the full ML lifecycle (training, deploying, monitoring) using tools like SageMaker, VertexAI, Vector DBs, Graph ...

Technical Hardware Product Manager

Atlanta, GA · On-site

$130 - $137/hr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Prior exposure to video analytics, facial or plate recognition, or edge ML inference is a plus. * You've shipped hardware at scale and lived through NPI (New Product Introduction) with contract ...

Technical Hardware Product Manager

Atlanta, GA · On-site

$110 - $140/hr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Prior exposure to video analytics, facial or plate recognition, or edge ML inference is a plus.You've shipped hardware at scale and lived through NPI (New Product Introduction) with contract ...

Be Seen First

Technical Hardware Product Manager

Atlanta, GA · On-site

$130K - $140K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Prior exposure to video analytics, facial or plate recognition, or edge ML inference is a plus. * You've shipped hardware at scale and lived through NPI (New Product Introduction) with contract ...

Deliver governed datasets and feature engineering/serving for ML training and real-time inference (online/offline consistency, caching, latency SLOs, backfills). A successful candidate would possess ...

Deliver governed datasets and feature engineering/serving for ML training and real-time inference (online/offline consistency, caching, latency SLOs, backfills). A successful candidate would possess ...

Stay current with developments in AI/ML, including emerging architectures and edge inference techniques, and translate industry trends into practical, production oriented recommendations for ...

Staff Machine Learning Engineer

Atlanta, GA · On-site +1

$220K - $280K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Proficient in streaming architectures (Kafka/Flink/PubSub) and building low-latency services to serve model inference in * MLOps Expertise: Deep experience managing the full ML lifecycle (training ...

Staff Machine Learning Engineer

Atlanta, GA · On-site

$220K - $280K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Proficient in streaming architectures (Kafka/Flink/PubSub) and building low-latency services to serve model inference in * MLOps Expertise: Deep experience managing the full ML lifecycle (training ...

... inference on NVIDIA DGX Spark. Understanding of FDA regulatory requirements for AI/ML in medical devices Experience with MLOps tools (MLflow, Kubeflow) and model versioning practices Develop tools ...

Gen AI Engineer

Atlanta, GA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... for inference optimization; RAG architecture design and implementation. * Advanced cloud infrastructure (AWS EKS/ECS, GCP GKE, Azure AKS) knowledge. * Containerization strategies for ML workloads;

Gen AI Engineer

Atlanta, GA · Hybrid

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... for inference optimization; RAG architecture design and implementation. * Advanced cloud infrastructure (AWS EKS/ECS, GCP GKE, Azure AKS) knowledge. * Containerization strategies for ML workloads;

Showing results 21-40

Ml Inference information

See Canton, GA salary details

$35.4K

$115.9K

$185.5K

How much do ml inference jobs pay per year?

As of Aug 15, 2026, the average yearly pay for ml inference in Canton, GA is $115,888.00, according to ZipRecruiter salary data. Most workers in this role earn between $93,000.00 and $128,400.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.

What are popular job titles related to Ml Inference jobs in Canton, GA?

For Ml Inference jobs in Canton, GA, the most frequently searched job titles are:

What cities near Canton, GA are hiring for Ml Inference jobs?

Cities near Canton, GA with the most Ml Inference job openings:

Staff Machine Learning Engineer - Leasing

AppFolio

Atlanta, GA • On-site

$16.25 - $19.25/hr

Full-time

This job post has expired today. Applications are no longer accepted.


AppFolio rating

7.2

Company rating: 7.2 out of 10

Based on 8 frontline employees who took The Breakroom Quiz

184th of 244 rated software companies


Job description

Hi, We're AppFolio

We're innovators, changemakers, and collaborators. We're more than just a software company — we're building the AI-native platform where the real estate industry comes to do business. We're transforming property management: how properties are leased, how residents find their homes, and how intelligence flows across an entire portfolio.

Realm-X is AppFolio's AI-native platform powering this transformation. Within it, Realm-X Leasing Performer is an autonomous AI agent that handles the end-to-end leasing lifecycle — lead management, tour scheduling, follow-up, application processing, etc. — on behalf of property managers and leasing teams. It's one of AppFolio's most ambitious bets on autonomous AI, and it needs ML engineering worthy of that ambition.

Who We Are Looking For

We're hiring a Staff Machine Learning Engineer to own the ML strategy and execution that makes the Realm-X Leasing Performer production-grade, observable, and continuously improving. You'll sit at the intersection of applied ML, agent systems, and leasing domain expertise — working directly with Leasing Engineering, Voice & Agents, and Research ML to translate prototypes into systems our customers can depend on every day.

This isn't a platform-only role. You'll be close enough to the product to shape how the Leasing Performer reasons, acts, and learns — and close enough to infrastructure to make sure it's reliable, cost-efficient, and safe at scale.

Your Impact
  • Own the ML Strategy for Leasing: Define and drive the machine learning roadmap across Leasing products — identifying where ML creates the most leverage, making the right model and architecture bets, and working closely with Product and Engineering leadership to align the team around a coherent technical vision that reflects real customer outcomes.

  • Drive the Development & Architecture for Autonomous AI Agents: Be the ML lead for AppFolio's autonomous leasing agent — shaping how it communicates with prospective tenants and helps streamline leasing operations. You'll own the model quality, evaluation framework, and continuous improvement loop that makes the Performer better over time.

  • Translate Research into Product: Partner with Voice & Agents and Research ML to evaluate new capabilities — fine-tuning approaches, retrieval strategies, agentic patterns — and make the call on what's ready to ship and what needs more hardening before it reaches customers.

  • Drive Model Quality and Evaluation: Build the evaluation and experimentation infrastructure that lets the Leasing team ship ML changes with confidence — defining what "better" looks like for leasing-specific tasks and owning the metrics that reflect real customer outcomes.

  • Set the ML Bar for Leasing Engineering: Establish the patterns, standards, and practices that the broader Leasing Engineering team follows when integrating ML — from prompt engineering and RAG to fine-tuning and model selection. Be the person the team comes to when the ML question is hard.

  • Operate with Production Discipline: Ensure that ML systems powering the Leasing Performer meet the reliability bar that production SaaS demands — SLOs, observability, cost discipline, and a clear on-call posture. You don't have to build all of it, but you own the outcomes.

Qualifications
  • Systems thinker: You think in terms of platforms and long-term leverage, not just features. You understand how ML infrastructure decisions compound over time.

  • Production builder: You've built and scaled ML infrastructure in production with meaningful business impact — and you treat it like any other production system.

  • Domain curiosity: You take time to understand the business workflows your systems serve — in this case, leasing — and use that understanding to make better technical bets.

  • Ambiguity: You operate effectively in high ambiguity, turning unclear infra problems into clear direction.

  • Owner-operator: You take ownership with a founder mindset, act with urgency, and focus on outcomes.

  • Collaboration: You are humble, collaborative, and low-ego — you elevate those around you and work fluidly across ML, product, and engineering.

  • Reliability mindset: You treat ML infra like any other production system: SLOs, on-call, observability, postmortems.

  • Sustainability: You value work-life balance as a foundation for sustained high performance.

Must Have
  • ML Development at scale: Has built and supported production ML systems at scale.

  • Architectural Leadership: You have experience leading architectural discussions, defining system design, and guiding technical decision-making.

  • Inference & Training: Has trained or fine-tuned language models end-to-end; comfortable with deep learning, evaluation, and inference.

  • Training capability: Has trained or fine-tuned language models end-to-end; comfortable with deep learning, evaluation, and inference.

  • RAG & agents: Hands-on experience with LangChain / LangGraph and modern RAG patterns over structured and unstructured data.

  • AI safety & authorization: Hands-on experience operating AI guardrails, scoped tool permissions, and authorization layers for production AI systems — especially in agentic contexts.

Nice to Have
  • Experience building ML systems for conversational AI, leasing, or CRM-adjacent workflows.

  • GPU performance tuning (vLLM, TensorRT, Triton, or similar).

  • Experience with ontology-driven systems or knowledge graphs supporting AI applications.

  • Familiarity with real estate, property management, or leasing workflows.

  • Contributions to open-source ML infrastructure or LLM tooling.

Location
Find out more about our locations by visiting our site. 
All late-stage candidates complete an in-person meeting with an AppFolian as part of our hiring process.
Compensation & Benefits
The compensation that we reasonably expect to pay for this role is: $200,000 - 250,000 base pay. The actual compensation for this role will be determined by a variety of factors, including but not limited to the candidate’s skills, education, experience, and internal equity.
Please note that compensation is just one aspect of a comprehensive Total Rewards package. The compensation range listed here does not include additional benefits or any discretionary bonuses you may be eligible for based on your role and/or employment type.
Regular full-time employees are eligible for benefits - see here.
style="color:#ffffff;">#LI-KB1

What AppFolio employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom