ZipRecruiter

Log In

1

Azure Big Data Engineer Jobs in Virginia (NOW HIRING)

advansix

Big Data Engineer

Chester, VA · On-site

$104K - $156K/yr

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. · Strong ...

advansix

Big Data Engineer

Hopewell, VA · On-site

$104K - $156K/yr

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. · Strong ...

AdvanSix

Big Data Engineer

Chester, VA · On-site

$51.25 - $68/hr

They are seeking a Big Data Engineer to build and operate their enterprise Unified Data Layer ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. • Strong ...

Cymertek

Big Data Engineer

Chantilly, VA · On-site

$57.50 - $76.25/hr

Big Data Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

Cymertek

Big Data Engineer

Tysons, VA · On-site

$56 - $74/hr

Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

Cymertek

Big Data Engineer

Reston, VA · On-site

$58 - $76.75/hr

Big Data Engineer LOCATION Reston, VA 20190 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data ...

AdvanSix

Big Data Engineer

Chester, VA · On-site

$104K - $156K/yr

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL ... Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. • Strong ...

ByteCubed

Big Data Engineer

Arlington, VA · On-site

$64.25 - $84.75/hr

Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and Improvements, and Software Engineering.

ByteCubed

Big Data Engineer

Arlington, VA · On-site

$64.25 - $84.75/hr

Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and Improvements, and Software Engineering.

Cymertek

Cloud Big Data Software Engineer

Chantilly, VA · On-site

$57.50 - $76.25/hr

Cloud Big Data Software Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

Cymertek

Cloud Big Data Software Engineer

Reston, VA · On-site

$58 - $76.75/hr

Cloud Big Data Software Engineer LOCATION Reston, VA 20190 CLEARANCE TS/SCI Full Poly (Please note ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

Cymertek

Cloud Big Data Software Engineer

Tysons, VA · On-site

$56 - $74/hr

Cloud Big Data Software Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note ... Experience with cloud platforms like AWS, Azure, or GCP * Expertise in big data tools such as ...

USM

Big Data Engineer

Reston, VA

$58 - $76.75/hr

Big Data Engineer_49415 Location: Reston, VA Duration: Full Time Description: * 6+ years of hands on experience and strong and deep knowledge of Java application development * Experience processing ...

Jobsbridge

Big Data Engineer

Lorton, VA

$56.25 - $74.50/hr

Experience working on a big data platform Demonstrated deep proficiency with Big Data processing ... NET, Java EE, Ruby or other object oriented programming language Familiarity with map data ...

Apton inc

Big Data Engineer/Cloud Data Engineer

Richmond, VA · On-site

$55.25 - $73/hr

Big Data Engineer/Cloud Data Engineer in Richmond, VA Qualifications * 9+ years of experience in software development including design, coding and testing * Must have hands on experience with Java ...

Apton Inc

Big Data Engineer/Cloud Data Engineer

Richmond, VA · On-site

$55.25 - $73/hr

Big Data Engineer/Cloud Data Engineer in Richmond, VA Qualifications * 9+ years of experience in software development including design, coding and testing * Must have hands on experience with Java ...

USM

Big Data Engineer

Alexandria, VA · On-site

$59.75 - $79/hr

... Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting and IT Infrastructure. Our other offerings include modified solutions and ...

next page

Showing results 1-20

All JobsAzure Big Data Engineer JobsAzure Big Data Engineer Jobs in Virginia

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.

What are popular job titles related to Azure Big Data Engineer jobs in Virginia?

For Azure Big Data Engineer jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Azure Big Data Engineer jobs in Virginia look for?

The top searched job categories for Azure Big Data Engineer jobs in Virginia are:

What cities in Virginia are hiring for Azure Big Data Engineer jobs?

Cities in Virginia with the most Azure Big Data Engineer job openings:

Azure Big Data Engineer jobs near you

Big Data Engineer

advansix

Chester, VA • On-site

$104K - $156K/yr

Full-time

Re-posted 10 days ago

AdvanSix rating

7.1

Company rating: 7.1 out of 10

Based on 12 frontline employees who took The Breakroom Quiz

70th of 100 rated chemical manufacturers

Job description

Job Responsibilities:

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. You’ll engineer batch/CDC/streaming pipelines, model curated/semantic layers, and harden run-state with testing, CI/CD, security, and observability. You’ll partner closely with the data team and larger IT organization.

Mission

Design and deliver scalable, secure data pipelines and data models that safely connect operational systems to analytics, ensure trusted and wellgoverned data, and enable repeatable delivery of BI, ML, AI, and automation solutions.

Data Engineering & Modeling

· Build ingestion pipelines (batch, CDC, streaming) from S/4HANA/DataSphere, PHD/historian, LIMS, TMS, HSE, and other sources into landing → curated → semantic layers.

· Implement data contracts, schema/versioning, SCD handling, partitioning, and performance tuning (file formats, clustering, caching).

· Develop dimensional/semantic models that back certified Power BI datasets and APIs for apps/agents.

OT/IT Integration & Safety

· Integrate OT data via OPC UA/MQTT, broker/DMZ patterns, read-only historian feeds, and event/batch frames—no control-net reads.

· Collaborate with plant controls on change control, signal quality, and downtime windows.

Quality, Security & Observability

· Embed data quality rules, unit/integration tests, and validation checks (freshness, completeness, drift/PSI).

· Instrument lineage and end-to-end monitoring; build alerting and on-call runbooks to minimize MTTR.

· Enforce RBAC, secrets management, PII/HSE classifications, and retention aligned to Governance/MDM policies.

CI/CD, Cost & Reliability

· Automate build/test/deploy with Git-based CI/CD (environments, approvals, blue/green).

· Track and optimize cost/performance (cluster sizing, autoscaling, cache strategy); contribute to FinOps reviews.

Collaboration & Documentation

· Partner with Reporting & BI on semantic model contracts, RLS, and performance SLAs; avoid direct system scraping.

· Produce “readme” docs, data dictionaries, runbooks, and post-incident reviews; support knowledge transfer with vendors.

Basic Qualifications:

· Minimum 5 years' in data engineering building production pipelines at scale (batch/CDC/streaming).

· Hands-on with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault.

· Strong SQL and Python/PySpark; comfort with Spark Structured Streaming and performance tuning.

· Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD.

· Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling.

· OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics.

· Understanding of Power BI consumption (semantic models, RLS) and APIs for downstream AI/ML apps/agents.

Preferred Qualifications:

· Time-series/data-quality tooling (e.g., Great Expectations or equivalent patterns), feature/metric stores.

· MDM concepts (keys, survivorship), lineage/catalog tooling.

· TMS/WMS, LIMS, Historian, HSE domain exposure; Lean/Six Sigma mindset; FinOps awareness.

The base salary range for this position is $104,600 to $156,800 annually.

What AdvanSix employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply