1

Databricks Software Jobs in New Jersey (NOW HIRING)

Hands-on experience building and operating a Databricks Lakehouse Hosted in AWS * Deep experience with Delta Lake (ACID tables, partitioning, schema evolution, * Proven experience with Spark on ...

Hands-on experience building and operating a Databricks Lakehouse Hosted in AWS * Deep experience with Delta Lake (ACID tables, partitioning, schema evolution, * Proven experience with Spark on ...

Showing results 41-60

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What are popular job titles related to Databricks Software jobs in New Jersey? For Databricks Software jobs in New Jersey, the most frequently searched job titles are:
What cities in New Jersey are hiring for Databricks Software jobs? Cities in New Jersey with the most Databricks Software job openings:

Senior Lead Software Engineer- Manager

JPMorgan Chase & Co

Jersey City, NJ • On-site

Full-time

Medical, Retirement

Re-posted 29 days ago


JPMorgan Chase & Co. rating

8.0

Company rating: 8.0 out of 10

Based on 492 frontline employees who took The Breakroom Quiz

73rd of 170 rated banks


Job description

As a Senior Lead Software Engineer at JPMorgan Chase within Enterprise technology  AI/ML Data Platforms team,  you will be instrumental in building scalable, resilient and market-leading data solutions. You will engage in root cause analysis, production changes, budgetary considerations, and staffing challenges. Your experience will be vital in managing and mentoring team members to drive strategic change, both within your team and in partnership with colleagues across JPMorgan Chase & Co.'s global network of innovators.

Job Responsibilities:

  • Expertise in application development and support with multiple technologies such as Databricks, Snowflake, AWS, Kubernetes, etc.

  • Coordinate incident management coverage to ensure effective resolution of application issues.

  • Collaborate with cross-functional teams to perform root cause analysis and implement production changes.

  • Mentor and guide team members to foster innovation and strategic change.

  • Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.

  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities, to improve the value realized by automation at scale.

  • Develop and support AI/ML solutions for troubleshooting and incident resolution.

Required qualification, skills and capabilities:

  • Proficient in site reliability culture and principles and familiarity with how to implement site reliability within an application or platform

  • Proficiency in running production incident calls and managing incident resolution.

  • Experience in observability such as white and black box monitoring, service level objective alerting, and telemetry collection using tools such as Grafana, Dynatrace, Prometheus, Datadog, Splunk, and others

  • Strong understanding of SLI/SLO/SLA and Error Budgets

  • Proficiency in Python or PySpark for AI/ML modeling.

  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security

  • Must be able to reduce toil by building new tools to automate repeated tasks.

  • Hands-on experience in system design, resiliency, testing, operational stability, and disaster recovery

  • Understanding of network topologies, load balancing, and content delivery networks.

  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.

Preferred Qualifications

  • 10+ years in an SRE or production support role with AWS Cloud, Databricks, Snowflake or similar Technologies.
  • AWS, Snowflake or Databricks certifications.
  • Awareness of risk controls and compliance with departmental and company-wide standards.

  • Ability to work collaboratively in teams and build meaningful relationships to achieve common goals.

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase's review of criminal conviction history, including pretrial diversions or program entries

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.

What JPMorgan Chase & Co. employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom