1

Machine Learning Architect Jobs in New York (NOW HIRING)

Understanding of data structures, data modelling and software architecture * Deep knowledge of math ... Familiarity with machine learning frameworks (like Keras or PyTorch) and libraries (like scikit ...

Machine Learning Researcher

New York, NY ยท On-site

$200K - $300K/yr

As a Machine Learning Researcher at Virtu, you'll pursue high-impact research opportunities within ... learning architecture design to training dynamics and execution strategy. Your innovations will ...

Machine Learning Researcher

New York, NY ยท On-site

$200K - $300K/yr

As a Machine Learning Researcher at Virtu, you'll pursue high-impact research opportunities within ... learning architecture design to training dynamics and execution strategy. Your innovations will ...

Architect Physics Foundation Models: Design and train deep learning models. * Build the ECAD Data ... Scientific Machine Learning (SciML). * Deep Learning Frameworks: 4+ years of expert-level ...

Architect robust, high-performance ML infrastructure and data pipelines that support training ... machine learning models in production, with a track record of delivering largeโ€‘scale systems.

New

Lead Machine Learning Engineer

New York, NY ยท On-site

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer

New York, NY ยท On-site

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer

Manhattan, NY ยท On-site

$112K - $148K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer

New York, NY ยท On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer

Manhattan, NY ยท On-site +1

$112K - $148K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Lead Machine Learning Engineer

Manhattan, NY ยท On-site +1

$112K - $148K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Our highly motivated Machine Learning Engineers work on these challenging problems and define ... This role requires a strategic thinker who can balance high-level system architecture with hands-on ...

Lead Machine Learning Engineer

New York, NY ยท On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

Our highly motivated Machine Learning Engineers work on these challenging problems and define ... This role requires a strategic thinker who can balance high-level system architecture with hands-on ...

Lead Machine Learning Engineer

New York, NY ยท On-site +1

$112K - $147K/yr

You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have ...

next page

Showing results 1-20

Machine Learning Architect information

See New York salary details

$50.9K

$140.9K

$220.4K

How much do machine learning architect jobs pay per year?

As of Sep 13, 2026, the average yearly pay for machine learning architect in New York is $140,863.00, according to ZipRecruiter salary data. Most workers in this role earn between $99,600.00 and $181,600.00 per year, depending on experience, location, and employer.

What does a machine learning architect do?

A Machine Learning Architect designs and oversees the implementation of machine learning systems, ensuring they are scalable, efficient, and aligned with business goals. They collaborate with data scientists, engineers, and stakeholders to define system architecture, select appropriate technologies, and optimize model deployment. Their role includes managing ML workflows, ensuring data pipeline integrity, and addressing challenges like model performance, scalability, and reliability.

What skills and qualifications are needed to be a machine learning architect?

To thrive as a Machine Learning Architect, you need deep expertise in machine learning algorithms, data science, and software engineering, typically backed by an advanced degree in computer science or a related field. Familiarity with cloud platforms (like AWS, Azure, or GCP), ML frameworks (such as TensorFlow and PyTorch), and professional certifications in machine learning or data engineering is highly valuable. Exceptional problem-solving, leadership, and cross-functional communication skills help you effectively design solutions and collaborate with diverse technical teams. These skills are essential for architecting robust, scalable ML systems that align with business objectives and drive innovation.

What is the salary of a machine learning architect?

The salary of a machine learning architect typically ranges from $100,000 to $160,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in deep learning, cloud platforms, or specific tools may earn higher compensation, often exceeding $180,000 per year.
Infographic showing various Machine Learning Architect job openings in New York as of September 2026, with employment types broken down into 1% Internship, 1% As Needed, 74% Full Time, 22% Part Time, and 2% Contract. Highlights an 83% Physical, 2% Hybrid, and 15% Remote job distribution, with an average salary of $140,863 per year, or $67.7 per hour.

Agentic AI / Machine Learning Architect - Senior Principal

Manhattan, NY โ€ข On-site

Slalom Build
IT Servicesย โ€ขย 5 - 10K employees

Other

Medical, Dental, Vision, Life, Retirement

Posted 20 days ago


Job description

At Slalom, we co-create modern technology and software products with clients who are accelerating their digital transformation journeys. We blend design, product engineering, analytics, automation, and AI-native delivery to build intelligent products and platforms that can operate safely at enterprise scale. As an AI/ML Architect, youโ€™ll design and deliver production-grade AI systems that combine machine learning, generative AI, agentic workflows, modern data platforms, and cloud-native engineering across AWS, Azure, and Google Cloud. Youโ€™ll partner with clients to shape strategy, define secure and governed architectures, and move AI solutions from experimentation into reliable business operations.

What Youโ€™ll Do
  • Set technical direction for enterprise-scale AI systems spanning data products, retrieval pipelines, model orchestration, agentic workflows, evaluation, deployment, monitoring, optimization, and lifecycle management.
  • Define secure, scalable, cloud-native and hybrid reference architectures across AWS, Azure, and Google Cloud, including modern AI platform services such as Amazon Bedrock, Azure AI Foundry, Google Vertex AI, and enterprise data platforms.
  • Guide applied AI strategy and delivery across generative AI, agentic AI, multimodal AI, advanced RAG, knowledge assistants, prediction, optimization, computer vision, and decision-support use cases.
  • Lead enterprise adoption of production GenAI and agentic AI, including advanced RAG, tool/function calling, structured outputs, workflow orchestration, model routing, prompt and context engineering, memory patterns, and human-in-the-loop controls.
  • Establish AI evaluation, observability, and reliability standards, including offline test sets, automated evals, tracing, hallucination detection, quality scoring, latency/cost monitoring, feedback loops, and regression testing.
  • Champion Responsible AI, AI security, and governance-by-design practices, including explainability, privacy, bias mitigation, guardrails, data protection, threat modeling, access controls, auditability, and compliance alignment.
  • Evaluate emerging models, platforms, frameworks, standards, and deployment patterns, providing executive-ready recommendations based on use case fit, enterprise readiness, cost, risk, and operational complexity.
  • Lead and mentor cross-functional delivery teams of data engineers, AI engineers, ML engineers, software engineers, architects, and consultants, ensuring consistent quality across complex programs.
  • Drive business development through proposals, executive client pitches, solution accelerators, reference architectures, technical points of view, and thought leadership.
  • Develop senior practitioners and practice capability, fostering a culture of continuous learning, engineering discipline, responsible innovation, and practical AI adoption across the AI/ML practice.
  • Help to hire, lead, mentor, and retain a high-performing, inclusive team of AI/ML engineers, architects, and data scientists. Set clear expectations, provide timely feedback, and create meaningful development and stretch opportunities.
What Youโ€™ll Bring
  • 9+ years of experience implementing ML/AI solutions in production, including classical ML, deep learning, generative AI, or agentic AI systems.
  • 5+ years of experience in professional consulting or IT services, with proven ability to lead complex client-facing technical engagements.
  • Proven ability to design and govern production AI systems that combine models, data, retrieval, orchestration, APIs, security controls, observability, operating model, and user experience into an end-to-end enterprise architecture.
  • Deep expertise in modern GenAI patterns, including advanced RAG, embeddings, vector and hybrid search, re-ranking, knowledge graphs, tool/function calling, structured outputs, context engineering, and multimodal inputs.
  • Experience defining agentic AI architecture patterns, including single-agent and multi-agent workflows, supervisor/worker patterns, state and memory management, workflow orchestration, human approval gates, and safe action execution.
  • Proficiency with modern AI engineering frameworks and tools such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, Haystack, CrewAI, Hugging Face, or comparable open-source and cloud-native frameworks.
  • Strong programming skills in Python and modern software engineering practices, with familiarity in APIs, event-driven patterns, test automation, infrastructure as code, and scalable service design.
  • Proficiency in cloud AI/ML platforms and services such as Amazon Bedrock, AWS SageMaker, Azure AI Foundry, Azure Machine Learning, Google Vertex AI, and related model hosting, retrieval, agent, and evaluation capabilities.
  • Experience with enterprise data and AI ecosystems such as Databricks, Snowflake, Spark, Kafka, dbt, vector databases, lakehouse architectures, and modern data governance patterns.
  • Experience setting standards for MLOps, LLMOps, CI/CD, model and prompt versioning, automated evaluation, observability, containerization, Kubernetes, serverless deployment, and cost/performance optimization.
  • Strong understanding of AI architecture tradeoffs, including model selection, retrieval strategy, latency, accuracy, security, privacy, scalability, cost, vendor lock-in, and operating model implications.
  • Ability to communicate complex AI concepts to technical and non-technical stakeholders, translating architecture choices into business value, delivery risk, governance requirements, and executive-level decisions.
  • Experience managing senior delivery teams and shaping enterprise AI/ML roadmaps, reference architectures, implementation backlogs, governance models, and adoption plans for enterprise clients.
  • Strong problem-solving, critical thinking, and business acumen, with the judgment to distinguish viable production solutions from prototype-only patterns and to guide clients through tradeoffs pragmatically.
About Us

Slalom is a fiercely human business and technology consulting company that leads with outcomes to bring more value, in all ways, always. From strategy through delivery, our agile teams across 52 offices in 12 countries partner with clients to co-create powerful customer experiences, modern ways of working, and meaningful impact.

What sets us apart? We believe work should be challenging and fulfilling, not perfect, but possible. Thatโ€™s why we prioritize purpose, flexibility, connection, and recognition, so our people can thrive and love what they do, most days.

Compensation and Benefits

Slalom prides itself on helping team members thrive in their work and life. As a result, Slalom is proud to invest in benefits that includemeaningful time off and paid holidays, parental leave, 401(k) with a match, a range of choices for highly subsidized health, dental, & vision coverage, adoption and fertility assistance, and short/long-term disability. We also offer yearly $350 reimbursement account for any well-being-related expenses, as well as discounted home, auto, and pet insurance.

Slalom is committed to fair and equitable compensation practices.For this role, we are hiring at the following levels and targeted base pay salary ranges:

For Boston, New York, Washington D.C.:

The targeted base salary pay range for a Sr. Principal is $215,000 to $275,000.

For Atlanta, Charlotte, Philadelphia, Miami:

The targeted base salary pay range for a Sr. Principal is $200,000 to $250,000.

In addition, individuals may be eligible for an annual discretionary bonus . Actual compensation will depend upon an individualโ€™s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time.

EEO and Accommodations

Slalomisanequalopportunityemployerandiscommittedtoattracting,developingandretaininghighlyqualifiedtalentwhoempowerourinnovativeteamsthroughuniqueperspectivesandexperiences.Allqualifiedapplicantswillreceiveconsiderationforemploymentwithoutregardtorace,color,religion,sex,nationalorigin,disabilitystatus,protectedveteransโ€™status,oranyothercharacteristicprotectedbyfederal,state,orlocallaws.Slalomwillalsoconsiderqualifiedapplicationswithcriminalhistories,consistentwithlegalrequirements.Slalomwelcomesandencouragesapplicationsfromindividualswithdisabilities.Reasonableaccommodationsareavailableforcandidatesduringallaspectsoftheselectionprocess.Pleaseadvisethetalentacquisitionteamorcontact accomodationrequest@slalom.com ifyourequireaccommodationsduringtheinterviewprocess.

If you're using NVDA, press NVDA key + space to enable focus mode to read the slider properly.

#J-18808-Ljbffr