ZipRecruiter

Log In

1

Azure Big Data Engineer Jobs in Virginia (NOW HIRING)

Digitive LLC

Big Data Engineer

Richmond, VA · On-site

$55.25 - $73/hr

Big Data Engineer - Azure / Databricks / OT Data Location: Primarily Remote - candidate must be based on the east coast and willing to travel periodically to Parsippany, NJ and/or Richmond, VA Travel:

New

advansix

Big Data Engineer

Hopewell, VA

$104K - $156K/yr

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. · Strong ...

advansix

Big Data Engineer

Hopewell, VA

$104K - $156K/yr

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. · Strong ...

AdvanSix

Big Data Engineer

Chester, VA · On-site

$51.25 - $68/hr

They are seeking a Big Data Engineer to build and operate their enterprise Unified Data Layer ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. • Strong ...

Cymertek

Big Data Engineer

Chantilly, VA · On-site

$57.50 - $76.25/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Big Data Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

Cymertek

Big Data Engineer

Tysons, VA · On-site

$56 - $74/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

Cymertek

Big Data Engineer

Reston, VA · On-site

$58 - $76.75/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Big Data Engineer LOCATION Reston, VA 20190 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

AdvanSix

Big Data Engineer

Chester, VA · On-site

$104K - $156K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. • Strong ...

ByteCubed

Big Data Engineer

Arlington, VA · On-site

$64.25 - $84.75/hr

Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and Improvements, and Software Engineering.

Cymertek

Cloud Big Data Software Engineer

Chantilly, VA · On-site

$57.50 - $76.25/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Cloud Big Data Software Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

Cymertek

Cloud Big Data Software Engineer

Reston, VA · On-site

$58 - $76.75/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Cloud Big Data Software Engineer LOCATION Reston, VA 20190 CLEARANCE TS/SCI Full Poly (Please note ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

Cymertek

Cloud Big Data Software Engineer

Tysons, VA · On-site

$56 - $74/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Cloud Big Data Software Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

Jobsbridge

Big Data Engineer

Lorton, VA · On-site

$56.25 - $74.50/hr

Experience working on a big data platform Demonstrated deep proficiency with Big Data processing ... NET, Java EE, Ruby or other object oriented programming language Familiarity with map data ...

Apton inc

Big Data Engineer/Cloud Data Engineer

Richmond, VA · On-site

$55.25 - $73/hr

Big Data Engineer/Cloud Data Engineer in Richmond, VA Qualifications * 9+ years of experience in software development including design, coding and testing * Must have hands on experience with Java ...

Horizontal Talent

Data Engineer

Arlington, VA · On-site +1

$131K - $158K/yr

This role offers the opportunity to work with modern big data tools, collaborate on impactful ... Azure SQL DW, or BigQuery * Working knowledge of AWS data platform services * Ability to design and ...

New

VTG

Data Engineer

Herndon, VA · On-site

$117K - $141K/yr

Experience with big data processing frameworks (e.g., Spark, Hadoop) * Hands-on experience building ... Experience with cloud data platforms (AWS, Azure, or GCP) * Proficiency in programming languages ...

next page

Showing results 1-20

All JobsAzure Big Data Engineer JobsAzure Big Data Engineer Jobs in Virginia

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.

What are popular job titles related to Azure Big Data Engineer jobs in Virginia?

For Azure Big Data Engineer jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Azure Big Data Engineer jobs in Virginia look for?

The top searched job categories for Azure Big Data Engineer jobs in Virginia are:

What cities in Virginia are hiring for Azure Big Data Engineer jobs?

Cities in Virginia with the most Azure Big Data Engineer job openings:

Azure Big Data Engineer jobs near you

Big Data Engineer

Digitive LLC

Richmond, VA • On-site

$55.25 - $73/hr

Other

This job post has expired today. Applications are no longer accepted.

Job description

 
Position :      Big Data Engineer – Azure / Databricks / OT Data
Location:     Primarily Remote – candidate must be based on the east coast and willing to travel periodically to Parsippany, NJ and/or Richmond, VA
Travel:           Approximately once per month initially; expected to decrease as the individual ramps up. Travel expenses covered.
Duration:      6-Month Contract-to-Hire
Interview Process: 2 video
Permanent Candidates: Candidates interested only in direct-hire opportunities may also be considered
 
Project Overview
Client is building out a Digital Transformation and Data Engineering team focused on creating an enterprise Unified Data Platform / Unified Data Layer (UDL).
Today, critical business and operational data resides across numerous systems, including SAP/ERP, CRM, SaaS applications, cloud platforms, plant Operational Technology (OT), Historian systems, and other manufacturing platforms. Operational reporting is similarly fragmented across these environments.
The goal is to bring this data together into a trusted, governed, scalable Azure data platform that can serve as a unified source for enterprise reporting, Power BI, analytics, AI/ML, automation, finance, supply chain, logistics, HSE, commercial operations, and plant operations.
The organization is a Microsoft/Azure shop and is currently implementing Azure Databricks, with Azure Data Factory serving as a core integration/orchestration platform. Snowflake may potentially be introduced in the future.
 
What They're Looking For
Client is seeking a hands-on Big Data Engineer who can build production-grade pipelines connecting traditional enterprise applications with manufacturing and OT environments.
This person must be technically strong but also self-sufficient and highly communicative. The engineer will work directly with data teams, IT, plant/controls teams, business stakeholders, and other departments to understand source systems and bring their data into the unified platform.
The ideal candidate has worked in continuous or batch manufacturing or an adjacent industrial environment such as chemicals, pharmaceuticals, CPG, oil & gas, energy, or utilities.
 
Key Responsibilities
  • Design and build scalable batch, CDC, near-real-time, and streaming data pipelines.
  • Build pipelines using Azure Databricks, Azure Data Factory, PySpark/Spark, SQL, ADLS/OneLake, and related Azure services.
  • Integrate data from ERP, CRM, SaaS, SAP S/4HANA/DataSphere, APIs, manufacturing applications, and OT systems.
  • Ingest and contextualize plant/industrial data from Historian, SCADA, PLC, IoT/IIoT, telemetry, and time-series environments.
  • Work with industrial connectivity/protocol concepts such as OPC UA and MQTT, along with secure OT-to-IT integration patterns.
  • Develop landing → curated → semantic/consumption layers within the Unified Data Platform.
  • Implement data contracts, schema/versioning, SCD handling, partitioning, caching, clustering, and performance optimization.
  • Build dimensional and semantic models supporting Power BI datasets, APIs, analytics, AI/ML applications, and agents.
  • Partner with plant controls/OT teams around signal quality, security, change control, network boundaries, and downtime windows.
  • Implement data-quality checks for freshness, completeness, schema changes, drift, and validation.
  • Establish monitoring, lineage, alerting, troubleshooting procedures, and production runbooks.
  • Implement RBAC, Key Vault/secrets management, data classifications, retention, governance, and MDM standards.
  • Automate testing and deployment through Git-based CI/CD and structured dev/test/prod environments.
  • Monitor and optimize Databricks/Azure performance and cloud costs.
  • Create documentation, data dictionaries, technical specifications, runbooks, and knowledge-transfer materials.
 
Required Qualifications
  • 5+ years of production data engineering experience building enterprise-scale data pipelines.
  • Strong hands-on experience with Azure Databricks.
  • Strong hands-on experience with Azure Data Factory (ADF).
  • Advanced PySpark/Spark, Python, and SQL skills.
  • Experience with Delta Lake/Lakehouse or similar modern data architectures.
  • Experience developing batch, CDC, and/or streaming pipelines.
  • Strong understanding of Spark Structured Streaming and data-processing performance optimization.
  • Experience integrating multiple enterprise source systems through APIs, databases, files, events, and streaming technologies.
  • Experience with Azure technologies such as ADLS, Synapse/Fabric, Azure SQL, Event Hubs, Key Vault, Azure DevOps, or equivalent services.
  • Experience implementing data quality, testing, monitoring, observability, governance, and CI/CD.
  • Strong communication skills with the ability to independently work with technical and nontechnical stakeholders.
 
Critical OT / Manufacturing Requirement
Candidates need meaningful experience with OT, IoT, industrial streaming, or time-series data. 
 
 

Apply