1

Big Data Engineer Jobs in Raleigh, NC (NOW HIRING)

Manager, Data Engineer (Remote)

Raleigh, NC · On-site

$100K - $174K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Own end-to-end data engineering delivery across the project lifecycle. * Build strong partnerships across the organization to align priorities and deliver data-related goals. * Design clear ...

Data Engineer - Senior Associate

Raleigh, NC

$77K - $202K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and ...

Data Engineer - Senior Manager

Raleigh, NC

$124K - $280K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and ...

AI ML Data Scientist

Cary, NC · On-site

$100 - $120/hr

SAS, SAS Enterprise Miner, R Programming, * Python, Spark. Statistical & Data Management Packages ... Big Data Technologies * Spark (Pyspark & SparkR),Hadoop,Yarn. * PM Tools * MS Project, MS Visio ...

Consulting Data Engineer

Raleigh, NC · On-site

$104K - $174K/yr

We are seeking a Consulting Data Engineer to join our team in Raleigh, NC . This position provides assistance and input to management, develops and leads large multi-functional development activities ...

Consulting Data Engineer

Raleigh, NC · On-site

$104K - $174K/yr

We are seeking a Consulting Data Engineer to join our team in Raleigh, NC . This position provides assistance and input to management, develops and leads large multi-functional development activities ...

Consulting Data Engineer

Raleigh, NC · On-site

$104K - $174K/yr

We are seeking a Consulting Data Engineer to join our team in Raleigh, NC . This position provides assistance and input to management, develops and leads large multi-functional development activities ...

We are seeking a Consulting Data Engineer to join our team in Raleigh, NC . This position provides assistance and input to management, develops and leads large multi-functional development activities ...

Consulting Data Engineer

Raleigh, NC · On-site

$104K - $174K/yr

We are seeking a Consulting Data Engineer to join our team in Raleigh, NC . This position provides assistance and input to management, develops and leads large multi-functional development activities ...

Manager, Data Engineer (Remote)

Raleigh, NC · Remote

$100K - $174K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Own end-to-end data engineering delivery across the project lifecycle. * Build strong partnerships across the organization to align priorities anddeliverdata-related goals. * Design clear, analytics ...

Manager, Data Engineer (Remote)

Raleigh, NC · Remote

$100K - $174K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Own end-to-end data engineering delivery across the project lifecycle. * Build strong partnerships across the organization to align priorities anddeliverdata-related goals. * Design clear, analytics ...

PCA Data Engineer

Raleigh, NC · On-site

$111K - $133K/yr

We are looking for a talented Data Engineer to join our team and contribute to developing robust data solutions that support our business goals. In this role, you will be aligned with a specific ...

PCA Data Engineer

Raleigh, NC · On-site

$111K - $133K/yr

We are looking for a talented Data Engineer to join our team and contribute to developing robust data solutions that support our business goals. In this role, you will be aligned with a specific ...

Data Engineer //Local to NC

Raleigh, NC · On-site

$111K - $133K/yr

NCDPI - Data Engineer - Senior (806834)Client: State of North Carolina301 N. Wilmington St, Raleigh, NCEither Webcam Interview or In Person***The manager would like the candidate to be onsite ...

Azure Data Engineer 1-20-

Raleigh, NC · Remote

$117K - $140K/yr

Our direct client has an opening for a Azure Data Engineer position # 730992. This position is for 4+ months, with option of extension, and will be worked 100% on-site in Raleigh, NC. If you are ...

Power BI and Data Engineer (Hybrid)

Raleigh, NC · On-site

$111K - $133K/yr

Power BI and Data Engineer (Hybrid) Location: Raleigh, NC Duration: 12+ Months with possible extension The client is seeking a Data Engineer for design, development, and optimization of a cloud-based ...

Our large client is looking for multiple consultants to join a growing Big Data project. Experience ... Engineer, Network Visualization Engineer and Ingestion Engineers. All roles will be remote and can ...

Showing results 41-60

Big Data Engineer information

See Raleigh, NC salary details

$15

$61

$85

How much do big data engineer jobs pay per hour?

As of Aug 13, 2026, the average hourly pay for big data engineer in Raleigh, NC is $61.22, according to ZipRecruiter salary data. Most workers in this role earn between $52.12 and $68.94 per hour, depending on experience, location, and employer.

What does a Big Data Engineer do?

A Big Data Engineer designs, builds, and manages systems that process and store large volumes of data. They develop data pipelines, integrate data from various sources, and ensure that the infrastructure is scalable, reliable, and efficient. Their work enables organizations to analyze and derive insights from massive datasets, supporting decision-making and business intelligence. Big Data Engineers often work with technologies like Hadoop, Spark, and cloud platforms.

What are the key skills and qualifications needed to thrive as a Big Data Engineer?

To thrive as a Big Data Engineer, you need strong programming skills (often in Python, Java, or Scala), experience with data modeling, and a solid understanding of distributed computing and database systems, typically supported by a degree in computer science or a related field. Familiarity with big data tools and platforms like Hadoop, Spark, Kafka, and relevant cloud services, as well as certifications such as Cloudera or AWS Big Data, is also important. Analytical thinking, problem-solving ability, and effective communication are key soft skills that help bridge technical solutions with business needs. These skills are crucial for designing scalable data pipelines, ensuring efficient data processing, and delivering actionable insights that drive organizational success.

What are some common challenges Big Data Engineers face when working with large-scale data pipelines?

Big Data Engineers often encounter challenges related to optimizing data pipelines for scalability and reliability, especially as data volume and velocity increase. Issues like managing data consistency, handling schema changes, and ensuring low-latency data processing are frequent hurdles. Collaborating closely with data scientists and DevOps teams is crucial, as projects often require integrating diverse data sources and maintaining high data quality standards. Staying up-to-date with evolving big data technologies and best practices is essential to address these ongoing challenges effectively.
More about Big Data Engineer jobs

What job categories do people searching Big Data Engineer jobs in Raleigh, NC look for?

The top searched job categories for Big Data Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Big Data Engineer jobs?

Cities near Raleigh, NC with the most Big Data Engineer job openings:

Infographic showing various Big Data Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 83% Full Time, and 17% Contract. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $127,336 per year, or $61.2 per hour.

Manager, Data Engineer (Remote)

Arch Capital Group

Raleigh, NC • On-site

$100K - $174K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 18 days ago


Job description

With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.
Job Summary
Strategic Analytics at Arch is a growing team at the forefront of the company's AI transformation. We design and deploy agentic AI systems and predictive analytics, supported by AI-ready data assets and AI-assisted development practices. These capabilities are becoming increasingly embedded across the enterprise.
Data is central to our mission. We unify internal and external data on modern cloud platforms-including Snowflake and Databricks within the Azure ecosystem-to produce reliable, analytics-ready data assets that support both traditional analytics and emerging AI use cases.
As Manager of Strategic Analytics Services, supporting the Claims Analytics group, you will lead end-to-end delivery of complex data pipelines that put analytics at the center of business processes. This is a hands-on role that combines execution, technical leadership, and stakeholder partnership, including leading and developing a team of data engineers.
You will work closely with business and technical leaders to align priorities, shape scalable data solutions, and deliver measurable outcomes. You will also guide engineers and reinforce strong delivery practices, while advancing the team's capabilities in modern data engineering, AI-assisted development, and well-governed, reusable data systems.
Responsibilities
  • Lead delivery of high-quality data solutions by partnering with stakeholders and coaching data engineers.

  • Own end-to-end data engineering delivery across the project lifecycle.

  • Build strong partnerships across the organization to align priorities and deliver data-related goals.

  • Design clear, analytics-ready data structures by anticipating downstream analytical needs.

  • Evaluate and adopt new technologies and data sources to improve capability and efficiency.

  • Automate data ingestion and integration to reliably connect internal and external data sources.

  • Document data sources, definitions, and technical solutions to support transparency and reuse.

  • Reinforce strong delivery hygiene (version control, code review, automated testing, CI/CD, and operational readiness/monitoring).

  • Apply agentic, AI-assisted coding practices to accelerate delivery while maintaining appropriate controls.

  • Build agent-ready data assets, including semantic layer components (ontology, taxonomy, domain models) and governed access.

  • Provide retrieval-ready context (RAG pipelines, vector stores, knowledge bases) when needed.

Desired Skills
Data Engineering
  • Strong programming expertise in Python and SQL, including data engineering frameworks, large-scale data manipulation, and governed AI-assisted development practices

  • Apache Spark proficiency (PySpark preferred) and experience with distributed data processing, including building scalable pipelines and optimizing performance for large-scale datasets

  • Cloud data platform proficiency (Snowflake, Databricks, Azure ecosystem fundamentals)

  • Data warehousing and modeling fundamentals (schema design, conformed definitions, performance optimization)

  • Data quality and observability practices (testing, reconciliation, monitoring)

Analytics & AI Readiness
  • Insurance data modeling for analytics and actuarial-ready data structures

  • MLOps familiarity supporting operationalized analytics and models

  • Semantic modeling skills (business definitions, metrics, ontology/taxonomy/domain models)

  • Business definition standardization for reuse across BI and AI use cases

Leadership & Operating Model
  • Self-directed execution and ownership in a distributed environment, combined with strong cross-functional collaboration, stakeholder partnership, and team building

  • Strong problem-solving and critical thinking skills, including the ability to decompose complex challenges

  • Clear communication across technical and business audiences, with the ability to adapt effectively in ambiguous and evolving environments

Required Skills
  • 6+ years' experience of hands-on development in Python and distributed processing environments (e.g., Spark)

  • 2-3+ years of technical leadership or project delivery ownership experience
  • Hands-on Databricks experience highly preferred

Education
  • College degree in Computer Science, Engineering, Statistics, Mathematics, Actuarial Science, Data Analytics, or equivalent.

For individuals assigned or hired to work in the location(s) indicated below, the base salary range is provided. Range is as of the time of posting. Position is incentive eligible.
$100,500 - $174,000/year
  • Total individual compensation (base salary, short & long-term incentives) offered will take into account a number of factors including but not limited to geographic location, scope & responsibilities of the role, qualifications, talent availability & specialization as well as business needs. The above pay range may be modified in the future.
  • Arch is committed to helping employees succeed through our comprehensive benefits package that includes multiple medical plans plus dental, vision and prescription drug coverage; a competitive 401k with generous matching; PTO beginning at 20 days per year; up to 12 paid company holidays per year plus 2 paid days of Volunteer Time Offer; basic Life and AD&D Insurance as well as Short and Long-Term Disability; Paid Parental Leave of up to 10 weeks; Student Loan Assistance and Tuition Reimbursement, Backup Child and Elder Care; and more. Click here to learn more on available benefits.

Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn't the right fit but you're interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch's Talent Acquisition team.
10200 Arch Capital Services LLC