Job Type
Full-time
Description
We are seeking a Databricks Data Engineer with strong hands-on experience in Python and PySpark to support a fast-paced, high-impact delivery environment. This role requires someone who can quickly step in, take ownership, and deliver scalable data solutions with minimal ramp-up.
Key Responsibilities
โข Design, develop, and optimize data pipelines and ETL workflows using Databricks
โข Build scalable data processing solutions leveraging PySpark and Python
โข Work with large-scale datasets across cloud platforms (AWS and/or Azure)
โข Implement and maintain Medallion Architecture (Bronze, Silver, Gold layers)
โข Ensure data quality, performance optimization, and reliability of data pipelines
โข Collaborate with cross-functional teams to support data-driven initiatives
Required Qualifications
โข 3 to 5 years of experience in Databricks is required.
โข Strong hands-on experience with Databricks, Python, PySpark, and SQL
โข Proven experience building and optimizing ETL pipelines
โข Experience working with large-scale data environments
โข Solid understanding of cloud platforms (AWS and/or Azure)
โข Familiarity with Medallion architecture (Delta Lake)
โข Ability to work independently in fast-paced, deadline-driven environments
What We're Looking For
โข Someone who can hit the ground running with minimal onboarding
โข Strong sense of ownership and accountability
โข Ability to deliver under tight timelines without compromising quality
โข Proactive problem-solver with a delivery-first mindset Nice to Have
โข Experience with Delta Lake
โข Exposure to data governance and data quality frameworks
โข Prior experience in federal or regulated environments
Preferred Additional Qualifications:
โข Experience with Delta Lake
โข Exposure to data governance and data quality frameworks
โข Prior experience in federal or regulated environments
Requirements
Required Qualifications: :
Education:
- Bachelor's degree in information systems, computer science, or other related field. Will accept a suitable combination of education, training, or experience
Clearance: - Clearance: Federal Health Agency within the U.S. Department of Health and Human Services Public Trust clearance
Onsite Requirement: - Location: Hybrid - locals to DMV area
Professional Experience - 3 to 5 years of experience in Databricks is required.
- Strong hands-on experience with Databricks, Python, PySpark, and SQL
- Proven experience building and optimizing ETL pipelines
- Experience working with large-scale data environments
- Solid understanding of cloud platforms (AWS and/or Azure)
- Familiarity with Medallion architecture (Delta Lake)
- Ability to work independently in fast-paced, deadline-driven environments
Salary Description
$130,000 - $140,000