ZipRecruiter

Log In

1

Ml Inference Jobs in Framingham, MA (NOW HIRING)

Generalist

Software Engineer: ML Infra

Somerville, MA · On-site

$120 - $160/hr

You will also own inference infrastructure. For our robots this is a fleet of on-prem GPUs attached ... Optimizing and improving ML data loading transport and storage in highly distributed fully utilized ...

Catalyst Labs

ML Engineer

Boston, MA · On-site

... inference, and monitoring in production environments. • Participate in continuous improvement of the ML infrastructure and processes for scalability and performance. Qualifications : Required : • ...

CookUnity

Director, Data Science/ML

Boston, MA · On-site

Develop causal inference methodologies to understand true incrementality of product changes ... Proven track record building and deploying ML models in production , particularly in ...

previous pagenext page

Showing results 21-40

All JobsMl Inference JobsMl Inference Jobs in Framingham, MA

Ml Inference information

See Framingham, MA salary details

$38.6K

$126.3K

$202.1K

How much do ml inference jobs pay per year?

As of Aug 24, 2026, the average yearly pay for ml inference in Framingham, MA is $126,251.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,300.00 and $139,900.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What job categories do people searching Ml Inference jobs in Framingham, MA look for?

The top searched job categories for Ml Inference jobs in Framingham, MA are:

Ml Inference jobs near you

Distinguished Systems Developer - SQL Engine

Boston, MA • On-site

InterSystems
See more jobs at InterSystemsexternal

$49.25 - $67.25/hr

Full-time

Re-posted 22 days ago

Job description

Job Summary:
InterSystems is a creative data technology provider redefining the future of analytics and intelligent data platforms. As a Distinguished Developer in the SQL Engine group, you'll design and implement next-generation query processing stacks that optimize both traditional analytics and emerging AI-driven workloads.
Responsibilities:
• Architect and implement query optimization and execution components that scale across petabytes
• Design tooling and frameworks that make AI and analytics convergence seamless
• Collaborate with platform and storage teams to leverage multi-model indexing and caching strategies
• Contribute to building programmable, intelligent data pipelines that drive downstream ML model performance
• Mentor engineers, guide technical debates, and influence long-term system direction
• Champion a culture of quality, rigor, and innovation
Qualifications:
Required:
• 10+ years of experience in systems-level or database internals engineering
• Proven expertise in SQL query engines, optimizers, execution runtimes, or data compiler toolchains
• Experience with multi-model data systems (SQL + JSON, vector search, graph traversal)
• Expert in at least one systems programming languages, or LLVM-based codegen environments
• Strong grasp of relational algebra, compiler construction, and data-intensive workloads
• Passion for designing software that balances performance, correctness, and usability
• PHD degree or published research experience is highly advantageous.
Preferred:
• Familiarity with AI infrastructure or ML inference pipelines is a strong plus.
Company:
InterSystems is a vendor of software and technology for high-performance database management, integration, and health information systems. Founded in 1978, the company is headquartered in Cambridge, USA, with a team of 1001-5000 employees. The company is currently Late Stage.

Apply