ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in New Jersey

Pwc

Data Engineer - Senior Manager

Florham Park, NJ

$124K - $280K/yr

Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Manager ... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data ...

Pwc

Data Engineer - Senior Associate

Florham Park, NJ · On-site

$77K - $202K/yr

Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate ... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data ...

Campbell Soup Company

Data Engineer

Camden, NJ · On-site

$110K - $152K/yr

... Databricks platform. In this role, you will work closely with senior data engineers, solution architects, and business partners to build reliable data pipelines, contribute to analytics-ready data ...

New

Pepperidge Farm, Incorporated

Data Engineer

Camden, NJ · On-site +1

$110K - $152K/yr

... Databricks platform. In this role, you will work closely with senior data engineers, solution architects, and business partners to build reliable data pipelines, contribute to analytics-ready data ...

New

Campbell\'s

Data Engineer

Camden, NJ · On-site +1

$110K - $152K/yr

... Databricks platform. In this role, you will work closely with senior data engineers, solution architects, and business partners to build reliable data pipelines, contribute to analytics-ready data ...

Campbell's

Data Engineer

Camden, NJ · On-site +1

$110K - $152K/yr

... Databricks platform. In this role, you will work closely with senior data engineers, solution architects, and business partners to build reliable data pipelines, contribute to analytics-ready data ...

New

Accord Technologies Inc.

Senior Data Engineer

Iselin, NJ · On-site

$107K - $146K/yr

Title: Senior Data Engineer Location: Iselin, NJ ( Need Onsite day 1, Hybrid 3 days from office ... W2 contract We are seeking a skilled Data Engineer with expertise in Databricks, Snowflake, Python ...

Accord Technologies Inc.

Sr. Big Data Engineer

Weehawken, NJ · On-site

$60.50 - $80.25/hr

Sr. Big Data Engineer Weehawken, NJ Strong Banking Domain experience is required Only Local ... Develop, optimize, and maintain big data pipelines using Apache Spark, Azure Databricks, and ...

TiltEdge Solutions LLC

Data Engineer

Jersey City, NJ · On-site

$75/hr

Job Title: Sr Data Engineer Location: Jersey City, NJ(Hybrid). Duration: 6-12 Months Rate: DOE : We ... Experience with orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake ...

Deloitte

Senior Data Engineer

Princeton, NJ · Hybrid

$111K - $151K/yr

Design Databricks cluster policies, autoscaling configurations, and cost optimization strategies ... As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate ...

Deloitte

Senior Data Engineer

Jersey City, NJ · Hybrid

$110K - $150K/yr

Design Databricks cluster policies, autoscaling configurations, and cost optimization strategies ... As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate ...

Deloitte

Senior Data Engineer

Morristown, NJ · Hybrid

$109K - $148K/yr

Design Databricks cluster policies, autoscaling configurations, and cost optimization strategies ... As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in New Jersey

Senior Databricks Data Engineer information

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.
What are the most commonly searched types of Databricks Data Engineer jobs in New Jersey? The most popular types of Databricks Data Engineer jobs in New Jersey are:
What are popular job titles related to Senior Databricks Data Engineer jobs in New Jersey? For Senior Databricks Data Engineer jobs in New Jersey, the most frequently searched job titles are:
What job categories do people searching Senior Databricks Data Engineer jobs in New Jersey look for? The top searched job categories for Senior Databricks Data Engineer jobs in New Jersey are:
What cities in New Jersey are hiring for Senior Databricks Data Engineer jobs? Cities in New Jersey with the most Senior Databricks Data Engineer job openings:
Senior Databricks Data Engineer jobs near you
Infographic showing various Senior Databricks Data Engineer job openings in New Jersey as of August 2026, with employment types broken down into 29% Full Time, and 71% Contract. Highlights an 86% In-person, and 14% Hybrid job distribution.

Databricks Data Architect (AWS)

Lorven Technologies

Ridgefield Park, NJ • On-site

$69.50 - $91.25/hr

Full-time

Re-posted 2 days ago

Job description

Role: Senior Databricks Data Architect (AWS)
Location: Ridgefield Park, New Jersey 07660
12 Contract onsite position - This role requires 100% onsite presence Monday through Friday and will cover core business hours based on the EST timezone.
JOB DESCRIPTION
JOB TITLE: Senior Databricks Data Architect (AWS) - Hands-On Technical Lead
PURPOSE OF THE JOB:
  • Lead the strategic design and architectural roadmap of the Enterprise Data Platform on Databricks/AWS while remaining actively hands-on in design, prototyping, coding, and performance tuning.
  • To provide high-level technical consultancy and solution design to internal business stakeholders and external partners, acting as the bridge between complex business requirements and technical implementation.
  • To govern the technical quality of the platform by establishing design standards, conducting code reviews, and guiding the engineering team on best practices for Databricks Serverless and AWS integration.
  • As part of the role, you will be required to provide technical assurance for all major data initiatives, ensuring that solutions are robust, cost-effective, and compliant with enterprise security standards.

KEY ACCOUNTABILITIES:
  • Lead all architecture design and review sessions for strategic Databricks initiatives.
  • Actively contribute code to critical architectural components, building complex frameworks, reusable libraries, and core ETL/ELT pipelines using Python and PySpark.
  • Lead by example by prototyping Proof of Concepts (PoCs) for new features (e.g., Databricks Asset Bundles, Delta Live Tables) before handing them off for wider team implementation.
  • Perform hands-on performance tuning and debugging of high-latency jobs by deep-diving into Spark UI, execution plans, and spill logs.
  • Defining and enforcing coding standards, data modeling best practices (Medallion Architecture), and CI/CD protocols for the development team to follow.
  • conducting deep-dive technical reviews of designs and code produced by the engineering team to ensure efficiency, maintainability, and security.
  • Designing the strategy for Unity Catalog governance, ensuring granular data access controls and compliance with data privacy regulations.
  • Acting as the Technical Design Authority for the Databricks platform, making high-level decisions regarding the adoption of new Serverless features and AWS services.
  • Mentoring and coaching Senior and Junior engineers, fostering a culture of technical excellence and continuous improvement.
  • Own the technical relationship with key business stakeholders and translate business strategy into robust data architecture
  • Engage and collaborate with Executive Stakeholders to present technical roadmaps and demonstrate the business value of data initiatives.
  • Actively seeks opportunities to develop knowledge in emerging technologies (e.g., Generative AI on Databricks, Vector Databases) and evaluate their impact on the business.
  • Provide guidance to the Change Management board regarding the risk and technical impact of proposed architectural changes.
  • Develop strategies to architect resilience, high availability, and disaster recovery into the data platform.
  • Develop clear communication channels with C-level executives and Product Managers to ensure technical strategies align with business goals.

KEY LIAISONS:
  • Head of Data & Analytics / CIO
  • Business Unit Directors & Product Managers
  • Lead Data Engineers and Data Scientists
  • Enterprise Security & Infrastructure Architects

DIMENSIONS:
  • Ownership of the Technical Roadmap and Architecture for the Data Estate
  • Maintain excellent relationships with all key liaisons
  • Responsible for architectural decisions impacting critical data assets
  • Primary Technical Advisor in the CST timezone

EDUCATION:
  • Educated to degree level in Computer Science, Engineering, or equivalent (Master's degree preferred)

SKILLS AND ATTRIBUTES:
Essential -
  • Exceptional "Customer Facing" skills: proven ability to lead workshops, manage stakeholder expectations, and present complex technical solutions to non-technical audiences.
  • Minimum 8-10 years' experience in Data Engineering/Architecture, with at least 4 years specialized in Databricks and AWS.
  • Expert-level knowledge of Data Lakehouse Architecture, Delta Lake internals, and Spark optimization strategies.
  • Proven experience in Data Modeling (Dimensional, Vault, Relational) and designing complex ETL/ELT pipelines.
  • Advanced hands-on coding proficiency in Python and SQL, with the ability to write clean, production-ready, and testable code.
  • Strong experience with Databricks Serverless architecture, Unity Catalog implementation, and security patterns.
  • Deep understanding of Cloud Architecture (AWS Well-Architected Framework), including networking, storage (S3), and IAM.
  • Experience in Design Review and Code Review processes, capable of constructive critique and enforcing standards.
  • Detailed knowledge of DevOps principles (IaC with Terraform, CI/CD pipelines).
  • Knowledge of the MS Office suite (Word, Excel, PowerPoint, Outlook) - specifically for creating architectural diagrams and presentations.
  • Very strong relationship building and influencing skills at a senior level.
  • Strategic thinking with the ability to balance immediate business needs with long-term architectural vision.

EXPERIENCE:
Essential -
  • 8+ years of experience in Data Architecture and Engineering.
  • Extensive experience designing solutions on the Databricks platform.

Advantage -
  • Strong experience working with large-scale enterprises or as a Consultant for big agencies.
  • Certified Databricks Data Architect or AWS Solutions Architect (Professional).
  • Excellent organizational and planning skills, with an ability to manage architectural backlogs.
  • A best-in-class technical leader proactively driving business innovation and process improvements.
  • Languages: Python, SQL, Scala.
  • Experience designing APIs for data consumption.
  • Experience with Enterprise Architecture frameworks (TOGAF).
Lorven technologies logo

About Lorven technologies

Sourced by ZipRecruiter

Lorven Technologies, headquartered in Plainsboro, New Jersey, United States, is a reputable company in the technology industry, specializing in providing effective IT solutions and consulting services. The company's official website, lorventech.com, offers comprehensive insights into its offerings which include but are not limited to software development, IT consulting, project management, and business analysis. Since its inception, Lorven Technologies has been committed to ensuring efficiency and reliability in delivering IT services to its global clientele, establishing itself as a trusted name in the industry.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

2001

Social media

FacebookTwitter

View All Lorven technologies Jobs

Apply