1

Machine Learning Architect Jobs in Massachusetts

... architecture based on insights learned through model training and experimentation. * Maintain a deep curiosity about what makes machine learning systems work - and bring that curiosity to bear on how ...

Lead Machine Learning Engineer

Cambridge, MA · On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer (IC)

Cambridge, MA · On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

New

Sr. Lead Machine Learning Engineer

Cambridge, MA · On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

You will lead the design and delivery of complex ML systems, architect integrations across our tech stack, and set the engineering standard for how we build and deploy machine learning solutions at ...

You will lead the design and delivery of complex ML systems, architect integrations across our tech stack, and set the engineering standard for how we build and deploy machine learning solutions at ...

The Alexa AI team is looking for a passionate, talented, and inventive Machine Learning Engineer ... architecture (design patterns, reliability and scaling) of new and existing systems experience ...

Senior Machine Learning Engineer

Andover, MA · On-site

$105K - $145K/yr

Rockstar Games is on the lookout for a skilled Senior Machine Learning Engineer with strong ... architecture to evolve for the needs of tomorrow. * Contribute to the technical strategy and ...

next page

Showing results 1-20

Machine Learning Architect information

See Massachusetts salary details

$50.8K

$140.6K

$220.1K

How much do machine learning architect jobs pay per year?

As of Aug 7, 2026, the average yearly pay for machine learning architect in Massachusetts is $140,617.00, according to ZipRecruiter salary data. Most workers in this role earn between $99,400.00 and $181,300.00 per year, depending on experience, location, and employer.

What is the salary of a machine learning architect?

The salary of a machine learning architect typically ranges from $100,000 to $160,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in deep learning, cloud platforms, or data engineering may earn higher compensation. Certifications and a strong portfolio can also influence salary levels.

What does a machine learning architect do?

A Machine Learning Architect designs and oversees the implementation of machine learning systems, ensuring they are scalable, efficient, and aligned with business goals. They collaborate with data scientists, engineers, and stakeholders to define system architecture, select appropriate technologies, and optimize model deployment. Their role includes managing ML workflows, ensuring data pipeline integrity, and addressing challenges like model performance, scalability, and reliability.

What skills and qualifications are needed to be a machine learning architect?

To thrive as a Machine Learning Architect, you need deep expertise in machine learning algorithms, data science, and software engineering, typically backed by an advanced degree in computer science or a related field. Familiarity with cloud platforms (like AWS, Azure, or GCP), ML frameworks (such as TensorFlow and PyTorch), and professional certifications in machine learning or data engineering is highly valuable. Exceptional problem-solving, leadership, and cross-functional communication skills help you effectively design solutions and collaborate with diverse technical teams. These skills are essential for architecting robust, scalable ML systems that align with business objectives and drive innovation.

What are the most commonly searched types of Machine Learning Architect jobs in Massachusetts? The most popular types of Machine Learning Architect jobs in Massachusetts are:
Infographic showing various Machine Learning Architect job openings in Massachusetts as of August 2026, with employment types broken down into 90% Full Time, 7% Part Time, and 3% Temporary. Highlights an 83% In-person, 4% Hybrid, and 13% Remote job distribution, with an average salary of $140,617 per year, or $67.6 per hour.

Machine Learning Architect

Ayo Semiconductor

Boston, MA • On-site

Full-time

Medical, Dental, Vision

Re-posted 20 days ago


Job description

About Ayo

We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitude improvement in speed and power efficiency with a goal of unseating the GPU as the dominant computing platform for AI.

The Role

We are seeking a deep ML practitioner to join as a founding team member - someone with hands-on experience working on or alongside a foundation model at scale, who understands what happens under the hood when splitting jobs across thousands of GPUs, and who is excited to bring that depth to novel hardware. They have a full-stack understanding of machine learning architectures, love to optimize algorithms across disciplinary boundaries, and will deploy and train models directly on our prototype chips to help us prove out what our processor can do - no prior hardware experience required.

What You’ll Do:

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on our chips.

  • Develop and adapt algorithms to train models on novel processing environments, including our prototype hardware.

  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.

  • Maintain a deep curiosity about what makes machine learning systems work - and bring that curiosity to bear on how they run on new hardware.

  • Support go-to-market strategy development

What We’re Looking For:

  • PhD in machine learning, representation learning, theory of computation, or a related field - or equivalent industry experience working on foundation models at scale.

  • Experience training models at scale - distributed training across many GPUs, working with large datasets and compute.

  • Has built and trained neural networks from scratch

  • Deep knowledge of the structure and internal operation of neural networks - including how and why they behave the way they do (e.g. interpretability or explainability work is a plus).

  • Excitement about applying deep AI expertise to new and novel hardware environments - you don’t need prior experience with photonics or silicon, but you want to learn.

  • Fluent knowledge of Python

  • Fluency in PyTorch (preferred), TensorFlow, JAX, or other industry-standard ML software libraries

Why Ayo

  • You'll be a founding AI team member - shaping how we think about and deploy AI as a company.

  • We are working on a genuinely hard and interesting problem: unseating the GPU as the dominant AI compute platform.

  • Early-stage means real ownership, real impact, and meaningful equity.

  • Competitive salary. Equity commensurate with stage and seniority. Benefits package including health, dental, and vision.

  • Fully onsite in Boston - we are a collaborative, in-person team.