1

Databricks Architect Jobs in Rochester, NY (NOW HIRING)

Lead AI and Data Science Engineer II

Rochester, NY · On-site

$101K - $133K/yr

Partner with data engineering teams on pipeline architecture and infrastructure, using knowledge of ... Databricks environments * Experience developing artificial intelligence (AI) or generative ...

Showing results 21-21

Databricks Architect information

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.

What are the key skills and qualifications needed to thrive as a Databricks Architect?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are popular job titles related to Databricks Architect jobs in Rochester, NY?

For Databricks Architect jobs in Rochester, NY, the most frequently searched job titles are:

What job categories do people searching Databricks Architect jobs in Rochester, NY look for?

The top searched job categories for Databricks Architect jobs in Rochester, NY are:

What cities near Rochester, NY are hiring for Databricks Architect jobs?

Cities near Rochester, NY with the most Databricks Architect job openings:

Infographic showing various Databricks Architect job openings in Rochester, NY as of August 2026, with employment types broken down into 90% Full Time, 1% Part Time, and 9% Contract. Highlights an 80% Physical, 5% Hybrid, and 15% Remote job distribution.

Lead AI and Data Science Engineer II

Deloitte

Rochester, NY • On-site

$101K - $133K/yr

Full-time

This job post has expired today. Applications are no longer accepted.


Deloitte rating

8.2

Company rating: 8.2 out of 10

Based on 92 frontline employees who took The Breakroom Quiz

44th of 150 rated financial services


Job description

Lead AI and Data Science Engineer II

Drive the design and delivery of advanced analytics, artificial intelligence (AI), and generative artificial intelligence (GenAI) solutions that inform Talent strategy and workforce decisions. In this role, you will lead complex data science work that combines research design, statistical analysis, machine learning, and application development to solve high-priority people challenges. You will also partner with business, Talent, and technology stakeholders to translate workforce data into actionable insights, tools, and recommendations.

Recruiting for this role ends on August 10, 2026.

Work You'll Do

In this role, you will lead the data science dimension of that work, shaping research design, analytical methodology, and solution development while helping develop junior data scientists across the full analytics lifecycle.

Strategy & Stakeholder Partnership

  • Partner with the Advanced Analytics & AI leader to help shape and execute the People Analytics portfolio, using data-driven insights to inform Talent strategy, establish priorities, and manage multiple initiatives.
  • Collaborate with stakeholders across Talent, business leadership, and ITS to define business needs, identify analytics opportunities, communicate complex technical concepts, and advise on the benefits and limitations of automation and artificial intelligence (AI).
  • Develop and drive strategy to understand and improve data quality across relevant Talent data assets.

Analytics & Data Science

  • Design and structure analytical work, including research design, project planning, and use case development, and apply advanced statistical and machine learning methods to generate rigorous, actionable insights.
  • Perform analytics in cloud-based environments, support the development of clear leadership-ready presentations, and stay current on developments in data science, behavioral science, and adjacent disciplines.

Software & Data Engineering

  • Develop full-stack, web-based data and generative artificial intelligence (GenAI) applications that improve Talent reporting and business operations.
  • Partner with data engineering teams on pipeline architecture and infrastructure, using knowledge of extract, transform, load (ETL), version control, and continuous integration and continuous delivery (CI/CD) concepts to inform technical decisions.

People Leadership

  • Mentor junior and mid-level data scientists across the analytics lifecycle, from problem framing and data collection through analysis and synthesis of findings.
  • Provide structure and oversight for analytically complex projects, while assessing talent, delivering developmental feedback, and contributing to a high-performing analytics team.

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to mentor and provide clear guidance to others

The team

The Talent Experience & Engagement, People Analytics - Advanced Analytics & AI team helps the firm make informed people and business decisions by translating workforce data into actionable insights, tools, and strategies. The team combines behavioral science, organizational research, advanced analytics, and artificial intelligence (AI) to address leadership questions, improve decision-making, and create scalable solutions with measurable impact.

The work is delivered through two connected capabilities. Organizational research and storytelling ground analyses in rigorous social science and clear, decision-oriented narratives. Data science applies statistical analysis, machine learning, and AI to identify meaningful patterns in workforce data, build data and generative artificial intelligence (GenAI) applications, and partner with Talent data engineering teams on pipelines and infrastructure.

Qualifications

Required:

  • Graduate degree in Applied Statistics, Computer Science, Life Sciences, Industrial-Organizational Psychology, Organizational Behavior, Sociology, Economics, Anthropology, or another quantitative discipline
  • 6+ years of experience in data science, analytics, or applied research
  • Experience using Python and Structured Query Language (SQL), with working knowledge of JavaScript, TypeScript, HyperText Markup Language (HTML), and Cascading Style Sheets (CSS)
  • Experience applying multivariate statistics and machine learning methods, including regression, structural equation modeling, factor analysis, decision trees, clustering, and dimension reduction, in Apache Spark or Databricks environments
  • Experience developing artificial intelligence (AI) or generative artificial intelligence (GenAI) applications and working with extract, transform, load (ETL), pipeline design, and orchestration concepts
  • Demonstrated experience leading AI strategy and enabling adoption of AI or data engineering tools within a complex organizational environment
  • Mentorship of junior and mid-level analysts, providing guidance across the analytics lifecycle from conception through data mining/analysis and synthesis of results
  • Ability to travel 0-10%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

Preferred:

  • Doctor of Philosophy (PhD) in Applied Statistics, Computer Science, Life Sciences, Industrial-Organizational Psychology, Organizational Behavior, Sociology, Economics, Anthropology, or another quantitative discipline
  • Experience in a professional services organization or large matrixed organization
  • Experience designing and building end-to-end data pipelines for reporting and analytics
  • Experience applying behavioral science frameworks to interpret workforce data and generate insight - not solely technical or statistical proficiency
  • Experience with talent systems such as OneModel or SAP

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $118700 to $218600.

Qualifications:

Lead AI and Data Science Engineer II

Drive the design and delivery of advanced analytics, artificial intelligence (AI), and generative artificial intelligence (GenAI) solutions that inform Talent strategy and workforce decisions. In this role, you will lead complex data science work that combines research design, statistical analysis, machine learning, and application development to solve high-priority people challenges. You will also partner with business, Talent, and technology stakeholders to translate workforce data into actionable insights, tools, and recommendations.

Recruiting for this role ends on August 10, 2026.

Work You'll Do

In this role, you will lead the data science dimension of that work, shaping research design, analytical methodology, and solution development while helping develop junior data scientists across the full analytics lifecycle.

Strategy & Stakeholder Partnership

  • Partner with the Advanced Analytics & AI leader to help shape and execute the People Analytics portfolio, using data-driven insights to inform Talent strategy, establish priorities, and manage multiple initiatives.
  • Collaborate with stakeholders across Talent, business leadership, and ITS to define business needs, identify analytics opportunities, communicate complex technical concepts, and advise on the benefits and limitations of automation and artificial intelligence (AI).
  • Develop and drive strategy to understand and improve data quality across relevant Talent data assets.

Analytics & Data Science

  • Design and structure analytical work, including research design, project planning, and use case development, and apply advanced statistical and machine learning methods to generate rigorous, actionable insights.
  • Perform analytics in cloud-based environments, support the development of clear leadership-ready presentations, and stay current on developments in data science, behavioral science, and adjacent disciplines.

Software & Data Engineering

  • Develop full-stack, web-based data and generative artificial intelligence (GenAI) applications that improve Talent reporting and business operations.
  • Partner with data engineering teams on pipeline architecture and infrastructure, using knowledge of extract, transform, load (ETL), version control, and continuous integration and continuous delivery (CI/CD) concepts to inform technical decisions.

People Leadership

  • Mentor junior and mid-level data scientists across the analytics lifecycle, from problem framing and data collection through analysis and synthesis of findings.
  • Provide structure and oversight for analytically complex projects, while assessing talent, delivering developmental feedback, and contributing to a high-performing analytics team.

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to mentor and provide clear guidance to others

The team

The Talent Experience & Engagement, People Analytics - Advanced Analytics & AI team helps the firm make informed people and business decisions by translating workforce data into actionable insights, tools, and strategies. The team combines behavioral science, organizational research, advanced analytics, and artificial intelligence (AI) to address leadership questions, improve decision-making, and create scalable solutions with measurable impact.

The work is delivered through two connected capabilities. Organizational research and storytelling ground analyses in rigorous social science and clear, decision-oriented narratives. Data science applies statistical analysis, machine learning, and AI to identify meaningful patterns in workforce data, build data and generative artificial intelligence (GenAI) applications, and partner with Talent data engineering teams on pipelines and infrastructure.

Qualifications

Required:

  • Graduate degree in Applied Statistics, Computer Science, Life Sciences, Industrial-Organizational Psychology, Organizational Behavior, Sociology, Economics, Anthropology, or another quantitative discipline
  • 6+ years of experience in data science, analytics, or applied research
  • Experience using Python and Structured Query Language (SQL), with working knowledge of JavaScript, TypeScript, HyperText Markup Language (HTML), and Cascading Style Sheets (CSS)
  • Experience applying multivariate statistics and machine learning methods, including regression, structural equation modeling, factor analysis, decision trees, clustering, and dimension reduction, in Apache Spark or Databricks environments
  • Experience developing artificial intelligence (AI) or generative artificial intelligence (GenAI) applications and working with extract, transform, load (ETL), pipeline design, and orchestration concepts
  • Demonstrated experience leading AI strategy and enabling adoption of AI or data engineering tools within a complex organizational environment
  • Mentorship of junior and mid-level analysts, providing guidance across the analytics lifecycle from conception through data mining/analysis and synthesis of results
  • Ability to travel 0-10%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

Preferred:

  • Doctor of Philosophy (PhD) in Applied Statistics, Computer Science, Life Sciences, Industrial-Organizational Psychology, Organizational Behavior, Sociology, Economics, Anthropology, or another quantitative discipline
  • Experience in a professional services organization or large matrixed organization
  • Experience designing and building end-to-end data pipelines for reporting and analytics
  • Experience applying behavioral science frameworks to interpret workforce data and generate insight - not solely technical or statistical proficiency
  • Experience with talent systems such as OneModel or SAP

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to ski...


What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom