ZipRecruiter

Log In

1

Azure Databricks Jobs in Virginia (NOW HIRING)

Berkley

Databricks Data Engineer

Manassas, VA · On-site

$114K - $137K/yr

As a hands-on Databricks Data Engineer with deep expertise in Azure Databricks and MLOps, this role will have the opportunity to migrate and translate legacy SSIS ETL logic into scalable, cloud ...

Berkley

Databricks Data Engineer

Manassas, VA · On-site

$114K - $137K/yr

As a hands-on Databricks Data Engineer with deep expertise in Azure Databricks and MLOps, this role will have the opportunity to migrate and translate legacy SSIS ETL logic into scalable, cloud ...

Berkley

Databricks Data Engineer

Manassas, VA · On-site

$114K - $137K/yr

As a hands-on Databricks Data Engineer with deep expertise in Azure Databricks and MLOps, this role will have the opportunity to migrate and translate legacy SSIS ETL logic into scalable, cloud ...

Polar IT Services

Azure Databrick Engineer

Richmond, VA · Remote

Databricks Integration Experience -Integrating ETL pipelines into Databricks for transformation/analytics * Databricks notebooks, Spark workloads, or structured pipelines * Azure Databricks strongly ...

Polar IT Services

Azure Databrick Engineer

Richmond, VA · On-site +1

Databricks Integration Experience -Integrating ETL pipelines into Databricks for transformation/analytics * Databricks notebooks, Spark workloads, or structured pipelines * Azure Databricks strongly ...

Polar IT Services

Azure Databrick Engineer

Richmond, VA · Remote

Databricks Integration Experience -Integrating ETL pipelines into Databricks for transformation/analytics * Databricks notebooks, Spark workloads, or structured pipelines * Azure Databricks strongly ...

CyberMedia Technologies

Data Engineer

Mclean, VA · On-site

$115K - $139K/yr

Build, optimize, and maintain data processing solutions using Azure Databricks and lakehouse architectures to support analytical, operational, and reporting use cases. * Data Migration Support:

Genworth

Platform Engineer, Azure / DevOps

Richmond, VA · On-site

$77K - $117K/yr

What you will be doing • Administer and configure Azure Synapse Analytics workspaces, Azure Databricks, Confluent Cloud including data integration and data warehousing components • Developing ...

Beyond SOF

Agentic Engineer.

Richmond, VA · On-site

$106K - $127K/yr

Experience with Azure services including Blob Storage, Data Lakes, Databricks, Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI, Azure Media Services, and Azure AI ...

next page

Showing results 1-20

All JobsAzure Databricks JobsAzure Databricks Jobs in Virginia

Azure Databricks information

See Virginia salary details

$10

$57

$79

How much do azure databricks jobs pay per hour?

As of Jul 9, 2026, the average hourly pay for azure databricks in Virginia is $57.90, according to ZipRecruiter salary data. Most workers in this role earn between $52.45 and $65.05 per hour, depending on experience, location, and employer.

Is Azure Databricks in demand?

Azure Databricks is a popular platform for data engineering, analytics, and machine learning, and professionals with skills in Spark, Python, and cloud environments are increasingly sought after. As organizations adopt cloud-based data solutions, demand for roles involving Azure Databricks continues to grow across industries.

What does a typical day look like for someone working in an Azure Databricks role?

A typical day for an Azure Databricks professional involves designing, developing, and maintaining data pipelines, collaborating with data scientists and business analysts to transform raw data into actionable insights. You may spend time configuring Spark clusters, optimizing query performance, ensuring data security, and troubleshooting data workflow issues. Regular meetings with stakeholders and team members are common to align on project requirements and report progress. This role often offers a mix of independent technical work and team collaboration, making it both dynamic and engaging.

Is Databricks a high paying job?

Azure Databricks professionals, such as data engineers and data scientists, typically earn above-average salaries due to their specialized skills in cloud platforms, big data processing, and machine learning. Compensation varies based on experience, location, and certifications, but these roles are generally well-paid within the tech industry.

What is a job in Azure Databricks?

A job in Azure Databricks refers to an automated task or set of tasks that run on the platform, such as data processing, machine learning model training, or data pipeline execution. These jobs are scheduled and managed through the Azure Databricks workspace, often requiring knowledge of Spark, Python, Scala, or SQL. They enable users to automate workflows and handle large-scale data analytics efficiently.

What is an Azure Databricks job?

An Azure Databricks job is a way to run a notebook, JAR, Python script, or other workload in an automated or scheduled manner on an Azure Databricks cluster. Jobs allow users to orchestrate data processing, machine learning tasks, or ETL workflows efficiently. They can be triggered manually, on a schedule, or in response to events, enabling streamlined data pipeline management. Jobs also support multi-task workflows, allowing dependencies between different tasks.

What is the salary of Azure Databricks developer?

The salary of an Azure Databricks developer typically ranges from $80,000 to $150,000 annually, depending on experience, location, and certifications. Skilled professionals with expertise in Spark, Python, and cloud environments tend to earn higher salaries.

What are the key skills and qualifications needed to thrive in the Azure Databricks position, and why are they important?

To thrive as an Azure Databricks professional, you need expertise in big data analytics, data engineering, and proficiency with SQL, Python, and Apache Spark, typically supported by a degree in computer science or a related field. Familiarity with the Azure cloud ecosystem, Databricks platform tools, and advantageous certifications like Azure Data Engineer Associate are highly valuable. Strong problem-solving skills, collaboration, and the ability to communicate technical concepts clearly help set you apart in this role. These abilities are crucial for designing and optimizing scalable data solutions and effectively working within cross-functional data teams.

What are the most commonly searched types of Azure Databricks jobs in Virginia? The most popular types of Azure Databricks jobs in Virginia are:
What are popular job titles related to Azure Databricks jobs in Virginia? For Azure Databricks jobs in Virginia, the most frequently searched job titles are:
What job categories do people searching Azure Databricks jobs in Virginia look for? The top searched job categories for Azure Databricks jobs in Virginia are:
Azure Databricks jobs near you
Databricks Data Engineer

Databricks Data Engineer

Berkley

Manassas, VA • On-site

$114K - $137K/yr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 15 days ago

Job description

Company Details
We started in early 2019 as a small group of technologists with a passion for making insurance better. Today we are working with a team of industry experts who run five different insurance brands and collectively control $1 billion in annual premiums.
We believe in an idea and execution meritocracy. In other words, a place where the best ideas win and the people who deliver the most value get the most opportunities.
As we grow our team, we are looking for inquisitive, entrepreneurial people who are excited to reimagine the insurance industry.
Insurance is too complex. Help us make it better.
Responsibilities
This position requires on-site work Monday-Thursday at either our Manassas, VA or Chesterfield, MO location.
The Databricks Data Engineer will help design, build, deploy, and maintain scalable and production grade data pipelines in modern cloud environments, enabling analytics, AI, ML, and decision advantage at scale. This role will work with cutting-edge tools like Databricks, Delta Lake, PySpark, and AI/BI genie to transform raw data into actionable insights. As a hands-on Databricks Data Engineer with deep expertise in Azure Databricks and MLOps, this role will have the opportunity to migrate and translate legacy SSIS ETL logic into scalable, cloud-native data pipelines in Databricks. This role will partner with data engineers, data scientists, and product manager to design features, train/evaluate models, and deploy them to production using MLflow, Databricks and Workflows-with rigorous observability, governance (Unity Catalog), and CI/CD automation.
Data Pipeline Engineering
  • Design, build, and maintain high-performance, scalable ETL/ELT pipelines using Azure Databricks, Delta Lake, and PySpark.
  • Convert and modernize existing SSIS package logic into cloud-native Databricks pipelines using PySpark notebooks, Delta Live Tables (DLT), and Databricks Workflows.
  • Implement reliable batch and streaming pipelines with robust data quality and validation frameworks.
  • Optimize pipeline performance using Photon, efficient file formats, partitioning, Z-ordering, and caching strategies.

Lakehouse Platform Development
  • Develop and manage datasets within Delta Lake, ensuring ACID reliability, schema evolution, versioning, and time travel.
  • Architect feature-rich data layers including:
    • Bronze (raw ingestion)
    • Silver (validated, conformed)
    • Gold (analytics-ready and ML-ready)
  • Implement data governance using Unity Catalog for fine-grained access control, lineage, auditability, and metadata management.

MLOps & ML-Enabled Data Pipelines
  • Partner with data scientists and data engineers to create feature pipelines, model training pipelines, and production scoring pipelines.
  • Deploy and operationalize models using MLflow, Databricks Model Registry, and Databricks Workflows.
  • Use Databricks built-in AI SQL functions such as ai_query, ai_forecast, ai_analyze_sentiment to generate actionable insight from large amount of unstructured or structured raw data
  • Implement monitoring for:
    • Pipeline failures
    • Data/feature drift
    • Model performance degradation
    • Operational SLAs/SLIs/SLOs
  • Build automated CI/CD workflows using GitHub Actions or Azure DevOps for notebook deployment, pipeline testing, and environment promotion.

Data Platform, Data Security & Data Governance
  • Collaborate with data engineers to design reliable data products on Delta Lake; leverage Delta Live Tables (DLT) for declarative pipelines when applicable.
  • Enforce Unity Catalog for lineage, permissions, and audit; manage secrets, tokens, and keys securely (e.g., Databricks secrets, Key Vault/Secrets Manager).

Collaboration & Leadership
  • Work closely with cross-functional teams: data engineering, data scientist, product manager, and business stakeholders.
  • Serve as a Databricks SME-championing best practices, code standards, governance, and reusable frameworks.
  • Document architecture, workflows, data models, runbooks, and operational procedures.

Qualifications
  • Minimum of 3 years of experience in Databricks, PySpark notebooks, Python, DevOps, software development, and data engineering.
  • Certified Databricks Data Engineer Associate or Professional is a plus.

Skills & Competencies
  • Proficient in designing, building, deploying, and maintaining high-performance, scalable ETL/ELT pipelines using Azure Databricks, Delta Lake, and PySpark Notebook.
  • Proficient in building, deploying, and operating production ML models such as supervised, unsupervised, and anomaly detection, including techniques for imbalanced datasets
  • Proficient with ML engineering and MLOps, including model versioning, CI/CD for ML, monitoring, drift detection, and automated retraining
  • Proficiency in Python including Pandas and PySpark Dataframes
  • Expert level of SQL skills including Stored Procedure, experience with SSIS, SSRS, Power BI is a plus.
  • Proficient with cloud data engineering platforms, such as Azure, Databricks, Spark, or SQL, and batch and streaming pipelines
  • Familiar with Databricks AI Built-In Functions such as AI_Query, AI_Gen, AI_Classify, AI_Forecast, AI_Analyze_Sentiment, able to use them to extract actionable insights from large amount of unstructured or structured raw data
  • Experience with Python and ML frameworks, such as PyTorch or TensorFlow
  • Experience improving data quality, lineage, and observability in enterprise data environments and operationalizing rules and model-driven scoring for prioritization, routing, or case selection
  • Experience with predictive analytics, machine learning and artificial intelligence desired.

Education
  • A Bachelor's degree in Computer Science, Management Information Systems, Engineering, Math, Physics, or a related quantitative field is required (4-year degree). Master's degree preferred
  • Experience in the commercial insurance industry is a plus.

Additional Company Details
The Company is an equal employment opportunity employer.
We do not accept any unsolicited resumes from external recruiting firms.
The company offers a competitive compensation plan and robust benefits package for full time regular employees.
Base salary & Benefits include Health, dental, vision, life, disability, wellness, paid time off, 401(k) and profit-sharing plans.
-Salary Range: $110k- $140k
The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment.
Additional Requirements
• Ability to travel locally and nationally up to 5% of the time
Sponsorship Details
Sponsorship not Offered for this Role

Apply