ZipRecruiter

Log In

1

Databricks Data Engineer Jobs in Boston, MA (NOW HIRING)

Cedent

Senior Data Engineer (Boston, MA)

Boston, MA · On-site

$124K - $149K/yr

Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages ... Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross ...

Databricks

Sr. Solutions Engineer - MFG

Boston, MA · On-site

$152K - $209K/yr

An ability in data-driven business transformation, and driving change with data. * Production programming experience in Python, R, Scala or Java * Nice to have: Databricks, Snowflake, AWS or Azure ...

CEDENT

Senior Data Engineer (Boston, MA)

Boston, MA · On-site

$124K - $149K/yr

Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages ... Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross ...

Cedent

Senior Data Engineer (Boston, MA)

Boston, MA · On-site

$124K - $149K/yr

Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages ... Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross ...

CEDENT

Senior Data Engineer (Boston, MA)

Boston, MA · On-site

$124K - $149K/yr

Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages ... Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross ...

Stellar IT Group

Azure Data Engineer

Wilmington, MA · On-site

$125K - $150K/yr

Azure Data Engineer Location: Wilmington, MA (Hybrid - 2 days onsite, remainder remote; must be ... Continuously learn and apply emerging Azure technologies (Databricks, Fabric, Power BI) to improve ...

Magna

Manager Data Analytics & Engineering

Lowell, MA

$105K - $196K/yr

The ideal candidate combines strong data engineering ability (Databricks, data pipelines) with data science and algorithmic thinking and has experience delivering business intelligence dashboards ...

Stellar IT Group

Azure Data Engineer

Wilmington, MA · On-site

$125K - $150K/yr

Azure Data Engineer Location: Wilmington, MA (Hybrid - 2 days onsite, remainder remote; must be ... Continuously learn and apply emerging Azure technologies (Databricks, Fabric, Power BI) to improve ...

Consigli Construction

Senior Data Engineer

Boston, MA · On-site

$100K - $120K/yr

The Senior Data Engineer supports the design, build, and optimization of our analytical data ... Contribute to the design and evolution of Consigli's lakehouse architecture (Databricks, Azure ...

Paul Hastings

Senior Data Engineer

Boston, MA

$194K/yr

The Senior Data Engineer is responsible for designing, building and maintaining modern data ... Advanced proficiency inAzure Data Factory,Azure Data Lake Storage (Gen2) andAzure Databricks;

Consigli Construction

Senior Data Engineer

Milford, MA · On-site

$100K - $120K/yr

The Senior Data Engineer supports the design, build, and optimization of our analytical data ... Contribute to the design and evolution of Consigli's lakehouse architecture (Databricks, Azure ...

Consigli Construction

Senior Data Engineer

Boston, MA · On-site

$100K - $120K/yr

The Senior Data Engineer supports the design, build, and optimization of our analytical data ... Contribute to the design and evolution of Consigli's lakehouse architecture (Databricks, Azure ...

Magna

Manager Data Analytics & Engineering

Lowell, MA · On-site

$105K - $196K/yr

The ideal candidate combines strong data engineering ability (Databricks, data pipelines) with data science and algorithmic thinking and has experience delivering business intelligence dashboards ...

Consigli Construction

Senior Data Engineer

Milford, MA · On-site

$100K - $120K/yr

The Senior Data Engineer supports the design, build, and optimization of our analytical data ... Contribute to the design and evolution of Consigli's lakehouse architecture (Databricks, Azure ...

Consigli Construction

Senior Data Engineer

Milford, MA · On-site

$100K - $120K/yr

The Senior Data Engineer supports the design, build, and optimization of our analytical data ... Contribute to the design and evolution of Consigli's lakehouse architecture (Databricks, Azure ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsDatabricks Data Engineer Jobs in Boston, MA

Databricks Data Engineer information

See Boston, MA salary details

$48.3K

$140.9K

$192.8K

How much do databricks data engineer jobs pay per year?

As of Jul 4, 2026, the average yearly pay for databricks data engineer in Boston, MA is $140,906.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,400.00 and $149,400.00 per year, depending on experience, location, and employer.

What is a Databricks Data Engineer job?

A Databricks Data Engineer is responsible for designing, building, and maintaining scalable data pipelines on the Databricks platform. They work with Apache Spark, Delta Lake, and cloud services to process large datasets efficiently. Their role involves data ingestion, transformation, optimization, and ensuring data quality for analytics and machine learning. Additionally, they collaborate with data scientists, analysts, and business teams to deliver reliable data solutions.

What does a typical day look like for a Databricks Data Engineer?

A typical day for a Databricks Data Engineer involves developing and maintaining scalable data pipelines, optimizing big data workflows using Spark, and collaborating with data scientists, analysts, and other engineers. You will regularly work within cloud environments to manage and process large datasets, conduct troubleshooting, and ensure data reliability and performance. Daily tasks may also include writing code, participating in team meetings, and implementing best practices for data security and governance. This role is highly collaborative, requiring frequent communication to align on project goals and address any technical challenges. The dynamic, project-based structure helps expand your skills and offers growth opportunities into senior engineering or data architecture roles.

What are the key skills and qualifications needed to thrive in the Databricks Data Engineer position, and why are they important?

To thrive as a Databricks Data Engineer, you need strong expertise in data engineering concepts, big data processing, and programming languages such as Python, Scala, or SQL, often supported by a degree in computer science or a related field. Proficiency in Databricks, Apache Spark, cloud platforms (like AWS, Azure, or GCP), and relevant certifications such as Databricks Certified Data Engineer are highly valued. Effective problem-solving, collaboration, and clear communication skills help engineers work efficiently within cross-functional teams. These skills are essential for designing scalable data pipelines, ensuring data quality, and delivering actionable analytics in dynamic business environments.

What are the most commonly searched types of Databricks Data Engineer jobs in Boston, MA? The most popular types of Databricks Data Engineer jobs in Boston, MA are:
What are popular job titles related to Databricks Data Engineer jobs in Boston, MA? For Databricks Data Engineer jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Databricks Data Engineer jobs in Boston, MA look for? The top searched job categories for Databricks Data Engineer jobs in Boston, MA are:
What cities near Boston, MA are hiring for Databricks Data Engineer jobs? Cities near Boston, MA with the most Databricks Data Engineer job openings:
Databricks Data Engineer jobs near you
Senior Data Lakehouse Architect (Databricks), Vice President

Senior Data Lakehouse Architect (Databricks), Vice President

State Street Corporation

Quincy, MA • On-site

$70.75 - $94.75/hr

Other

Medical, Dental, Vision, Life, Retirement, PTO

This job post has expired today. Applications are no longer accepted.

Job description

Senior Data Lakehouse Architect (Databricks), Vice President
Corporate Functions Technology
Who We Are Looking For
We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of a Legal Data Lakehouse platform on AWS and Databricks. This role will drive the architecture, engineering, and governance of scalable, secure, and compliant data capabilities supporting legal operations, contract intelligence, eDiscovery, and AI/ML use cases.
The ideal candidate brings deep expertise in Databricks, AWS data platforms, and enterprise data architecture, with experience delivering solutions in regulated environments aligned to security, compliance, and audit requirements.
Why This Role Is Important to Us
State Street's Legal function operates across a broad set of contracts, matters, regulatory obligations, documents, and workflows that are distributed across multiple systems and formats. Building a modern Legal Data Lakehouse is critical to creating a trusted, governed foundation that brings these data sources together-making legal information easier to access, analyze, and use at scale.
This role is critical to establishing a secure and scalable data foundation that enables legal analytics and AI use cases while strengthening governance, auditability, and global consistency across Legal.
What You Will Be Responsible For
1. Architecture & Platform Design
  • Define and implement the end-to-end Legal Data Lakehouse architecture using Databricks (Delta Lake, Unity Catalog, Workflows) on AWS
  • Design multi-layered data architecture (Bronze, Silver, Gold) to support:
    • Contract metadata and document ingestion
    • Legal matter management data
    • eDiscovery datasets
    • External regulatory and compliance feeds
  • Establish scalable ingestion frameworks (batch and streaming) for structured and unstructured legal data (PDFs, contracts, emails)
2. Data Engineering & Integration
  • Lead development of ETL/ELT pipelines using Databricks, Spark, and Python/SQL
  • Integrate with enterprise platforms, including:
    • Contract lifecycle management systems
    • AI platforms and LLM pipelines
    • Document repositories and enterprise content systems
  • Design patterns for extracting structured data from unstructured legal documents and persisting into Delta Lake
  • Enable downstream integration with enterprise data platforms, analytics tools, and AI/ML pipelines
3. Governance, Security & Compliance
  • Implement data governance frameworks using Databricks Unity Catalog and AWS-native controls (IAM, KMS)
  • Establish:
    • Fine-grained access controls (row/column-level security)
    • Data lineage and auditability
  • Ensure compliance with:
    • Data privacy regulations (e.g., GDPR)
    • Internal security and audit requirements
  • Partner with IAM teams to integrate with enterprise identity providers (e.g., Entra ID / Azure AD)
4. AI/ML & Advanced Analytics Enablement
  • Architect data models supporting:
    • Contract analytics, clause extraction, and obligation tracking
    • Legal AI use cases (contract review, litigation insights, compliance monitoring, legal spend analytics)
  • Design search and retrieval architectures (RAG) for enterprise legal knowledge bases
  • Enable entity extraction and knowledge graph frameworks
  • Integrate with LLM/GenAI platforms to support capabilities such as document summarization, Q&A, and workflow automation
5. DevOps & Platform Operations
  • Establish CI/CD pipelines and infrastructure-as-code (Terraform, Git-based workflows)
  • Define standards for:
    • Code quality and versioning
    • Environment promotion (Dev / QA / Prod)
  • Implement observability and alerting for platform health and reliability
6. Leadership & Stakeholder Engagement
  • Partner with Legal and Technology leadership to define platform roadmap and priorities
  • Provide architectural governance and design oversight
  • Mentor data engineers and platform teams
  • Translate business and legal requirements into scalable, enterprise-grade solutions
  • Operate within a federated data and platform model, collaborating across engineering, security, and domain teams
What We Value
The skills that will help you succeed in this role include:
  • 10+ years of experience in data architecture, engineering, or analytics platforms
  • 5+ years of hands-on experience with Databricks and Apache Spark
  • Strong experience with AWS-based data platforms
  • Expertise in data governance, security, and compliance in regulated environments
  • Experience working with unstructured data and NLP/document processing pipelines
Education & Preferred Qualifications
Education
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline
  • Relevant certifications strongly preferred:
    • Databricks Certified Data Engineer / Architect
    • AWS Certified Solutions Architect (Associate or Professional)
Preferred Qualifications (Core - Databricks, AWS, Data Lakehouse)
  • Strong hands-on experience with the Databricks Lakehouse platform, including Delta Lake, Unity Catalog, Workflows, and MLflow
  • Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM
  • Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks
  • Advanced proficiency in Apache Spark (PySpark/Scala), SQL, and Python
  • Strong understanding of data governance and security, including access controls, metadata management, and encryption (KMS, CMK/BYOK)
  • Experience building end-to-end data pipelines (batch and streaming) and supporting AI/ML workloads within a lakehouse architecture
Nice to Have (Domain & Industry Experience)
  • Experience in Legal, Compliance, Financial Services, or other regulated industries
  • Understanding of legal data constructs, including contracts, clauses, obligations, and matters
  • Experience supporting legal AI use cases (contract analytics, document summarization, compliance monitoring)
  • Experience handling sensitive data in highly regulated, audit-driven environments

Salary Range:
$120,000 - $202,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.
For a full overview, visit https://hrportal.ehr.com/statestreet/Home.
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
Job Application Disclosure:
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
State Street logo

About State Street

Sourced by ZipRecruiter

State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

Industry

Finance and insurance

Company size

10,000+ Employees

Headquarters location

Boston, MA, US

Year founded

1792

Social media

FacebookTwitter

View All State Street Jobs

Apply