ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in Virginia

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Guidehouse

Databricks Engineer

Arlington, VA

Data Engineering & Architecture Consulting Travel Required: None Clearance Required: Ability to Obtain Public Trust What You Will Do: Guidehouse is seeking a Databricks Engineer to join our AI and ...

Guidehouse

Databricks Engineer

Arlington, VA · On-site

Data Engineering & Architecture Consulting Travel Required: None Clearance Required: Ability to Obtain Public Trust What You Will Do: Guidehouse is seeking a Databricks Engineer to join our AI and ...

Guidehouse

Databricks Engineer

Arlington, VA · On-site

Data Engineering & Architecture Consulting Travel Required: None Clearance Required: Ability to Obtain Public Trust What You Will Do: Guidehouse is seeking a Databricks Engineer to join our AI and ...

Kanak Elite Services Inc

Data Engineer

Mclean, VA · On-site

$115K - $139K/yr

Python Pyspark node.js vue.js AWS EMR/Glue Lambda S3 SNS DynamoDB Databricks Description: Sr. Data Engineer Leads meetings with internal customers to determine data needs Requirements mapping and ...

Acuity INC

Data Engineer - AWS/Databricks

Reston, VA · On-site +1

$119K - $143K/yr

This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise ...

Acuity INC

Data Engineer - AWS/Databricks

Reston, VA · Remote

$119K - $143K/yr

This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise ...

Genworth Financial, Inc.

Senior Data Engineer

Richmond, VA · On-site

$104K - $142K/yr

POSITION TITLE Senior Data Engineer POSITION LOCATION This position is available to remote ... Design, build, and maintain scalable ETL/ELT pipelines using Spark, Python, SQL, and Databricks.

Accord Technologies Inc.

Sr. Data engineer

Reston, VA · On-site

$119K - $143K/yr

Sr. Data engineer Location: Reston, VA Duration: long term Mandatory need: Candidate have to be ex ... Azure Data Engineer (DP-203), Databricks, or AWS. * Experience with real-time data streaming (Kafka ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in Virginia

Senior Databricks Data Engineer information

How does a Senior Databricks Data Engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data Engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

What are Senior Databricks Data Engineers?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.
What are the most commonly searched types of Databricks Data Engineer jobs in Virginia? The most popular types of Databricks Data Engineer jobs in Virginia are:
What are popular job titles related to Senior Databricks Data Engineer jobs in Virginia? For Senior Databricks Data Engineer jobs in Virginia, the most frequently searched job titles are:
What job categories do people searching Senior Databricks Data Engineer jobs in Virginia look for? The top searched job categories for Senior Databricks Data Engineer jobs in Virginia are:
What cities in Virginia are hiring for Senior Databricks Data Engineer jobs? Cities in Virginia with the most Senior Databricks Data Engineer job openings:
Senior Databricks Data Engineer jobs near you
Data Engineer - Databricks

Data Engineer - Databricks

Steampunk

Mclean, VA • On-site

$110K - $160K/yr

Other

Re-posted 16 days ago

Job description

Overview
We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Data Engineer", but a technologist with excellent communication and customer service skills and a passion for data and problem solving.
Contributions
  • Lead and architect data pipelines and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability
  • Assess and understand the ETL jobs, workflows, BI tools, and reports
  • Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products
  • Experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP).
  • Key must have skill sets - Python, SQL, Databricks, AWS Data Services
  • Support an Agile software development lifecycle
  • You will contribute to the growth of our Data Exploitation Practice!

Qualifications
  • Ability to hold a position of public trust with the US government.
  • Bachelor's Degree and 6+ years of total experience or equivalent experience and education.
  • 6+ years direct experience in Data Engineering with experience in tools such as:
    • Big data tools: Hadoop, Spark, Kafka, etc.
    • Relational SQL and NoSQL databases, including Postgres and Cassandra.
    • Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
    • AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena
    • Data Platforms: Databricks, Snowflake
    • Data streaming systems: Kafka, Storm, Spark-Streaming, etc.
    • Languages: Python, R, Scala, Go
  • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks.
  • Advanced working SQL knowledge and experience working with relational databases
  • Advanced working knowledge and of NoSQL databases
  • Experience with message queuing, stream processing, and highly scalable 'big data' data stores.
  • Experience manipulating, processing, and extracting value from large, disconnected datasets.
  • Experience manipulating structured and unstructured data for analysis.
  • Experience with data modeling tools and processes.
  • Experience aggregating and transforming data from multiple datasets to create data products
  • Experience working in an Agile environment

About steampunk
Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $110,000 to $160,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here.
Identity Statement
As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com.
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.

Apply