ZipRecruiter

Log In

1

Data Engineer Data Jobs in Delaware (NOW HIRING)

Prophecy Technologies

Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have strong expertise in designing and implementing efficient and scalable data pipelines using Apache Spark ...

Dlapiper

Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into trusted, usable datasets for analytics ...

GLOBAL IT CON LLC

Data Engineer

Wilmington, DE

$111K - $133K/yr

Data Engineer Position Responsibilities Data Engineer Local preferred Wilmington DE W2 Candidates only Must Have skills: Python/Java, PySpark, AWS, Databricks : Must have Pyspark/python/Spark/ETL ...

Judge Group, Inc.

Data Engineer

Wilmington, DE · On-site

$80 - $85/hr

Role: Senior Data Engineer Duration: 6-12+ months RTH Location: Wilmington, Delaware Interview Process: 2 rounds Must Haves: (Java OR Python), Spark, (AWS OR Databricks), Airflow, Relational ...

Sensiple Inc.

Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Data Engineer Location: Wilmington,DE ONSITE Length: Contract W2 * Must have Pyspark/python/Spark/ETL Streaming pipelines * Must be good with AWS Services (S3/Lambdas/RD/EMR) * Must have good ...

Judge Group, Inc.

Data Engineer Junior

Wilmington, DE

$50 - $60/hr

Junior Data Engineer Location: Wilmington, DE (Hybrid - 3 days onsite) Duration: 6+ month contract (with potential extension) Interview Process Round 1: Virtual interview (Zoom) Round 2: In-person ...

Capital One

Lead Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery ...

Capital One

Lead Data Engineer

Wilmington, DE

$111K - $133K/yr

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery ...

Bridgeforce

Data Engineer

Wilmington, DE

Position Overview The Bridgeforce Data Solutions team seeks an entrepreneurial mindset for a unique and exciting opportunity to be part of the team executing upon the design and creation of ...

Capital One

Lead Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Lead Data Engineer The Bank Tech Data, Decisioning, & Market Services Domain serves as the analytical engine of the bank, building the infrastructure that turns data into smart, fast decisions. We ...

Capital One

Lead Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Lead Data Engineer The Bank Tech Data, Decisioning, & Market Services Domain serves as the analytical engine of the bank, building the infrastructure that turns data into smart, fast decisions. We ...

Bridgeforce

Data Engineer

Wilmington, DE

$78K - $117K/yr

Position Overview The Bridgeforce Data Solutions team seeks an entrepreneurial mindset for a unique and exciting opportunity to be part of the team executing upon the design and creation of ...

Capital One

Lead Data Engineer

Wilmington, DE · On-site

$111K - $133K/yr

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery ...

M&T Bank

Snowflake Data Engineer

Wilmington, DE · On-site

$106K - $177K/yr

... engineer and apply knowledge of appropriate data structure and algorithms to solve business problems. * Utilize source code management tools to manage and deploy code/ applications and ensure ...

M&T Bank

Snowflake Data Engineer

Wilmington, DE · Hybrid

$106K - $177K/yr

... engineer and apply knowledge of appropriate data structure and algorithms to solve business problems. * Utilize source code management tools to manage and deploy code/ applications and ensure ...

next page

Showing results 1-20

All JobsData Engineer Data JobsData Engineer Data Jobs in Delaware

Data Engineer Data information

What are some common challenges Data Engineers face when integrating data from multiple sources?

Data Engineers often encounter challenges such as inconsistent data formats, varying data quality, and differing update frequencies when integrating data from multiple sources. Ensuring data integrity and designing robust ETL pipelines that can handle these discrepancies is a key part of the role. Collaboration with data analysts, database administrators, and source system owners is crucial to resolve data mapping issues, automate data validation, and maintain reliable data flows within the organization.

What is the difference between Data Engineer Data vs Data Analyst?

AspectData Engineer DataData Analyst
Primary RoleBuilds and maintains data pipelines and infrastructureAnalyzes data to generate insights and reports
Skills & CertificationsSQL, Python, ETL tools, cloud platformsSQL, Excel, data visualization tools
Work EnvironmentData engineering teams, IT departmentsBusiness units, analytics teams
Industry UsageTech, finance, healthcare, any data-driven industryMarketing, finance, operations, business intelligence

While Data Engineer Data focuses on creating and managing data infrastructure, Data Analysts interpret this data to support decision-making. Both roles require strong SQL skills, but Data Engineers typically work more with data pipelines and cloud platforms, whereas Data Analysts focus on data visualization and reporting.

What are the key skills and qualifications needed to thrive as a Data Engineer, and why are they important?

To thrive as a Data Engineer, you need a solid understanding of data modeling, SQL, and programming languages such as Python or Java, often backed by a degree in computer science, engineering, or a related field. Familiarity with data warehousing solutions (like Amazon Redshift or Snowflake), ETL tools, and cloud platforms (such as AWS, Azure, or Google Cloud) is typically required, along with relevant certifications. Strong problem-solving abilities, collaboration, and clear communication are vital soft skills for integrating complex data systems and working with cross-functional teams. These skills ensure that data pipelines are reliable, scalable, and effectively support business intelligence and analytics needs.

What are Data Engineers?

Data Engineers are professionals who design, build, and maintain the systems and infrastructure that allow organizations to collect, store, and analyze large amounts of data. They create data pipelines, ensure data quality, and optimize data flow between systems, making it accessible for data scientists and analysts. Data Engineers often work with technologies like SQL, Python, Hadoop, and cloud platforms, and play a crucial role in supporting data-driven decision-making within organizations.
What are popular job titles related to Data Engineer Data jobs in Delaware? For Data Engineer Data jobs in Delaware, the most frequently searched job titles are:
What job categories do people searching Data Engineer Data jobs in Delaware look for? The top searched job categories for Data Engineer Data jobs in Delaware are:
What cities in Delaware are hiring for Data Engineer Data jobs? Cities in Delaware with the most Data Engineer Data job openings:
Data Engineer Data jobs near you

Data Engineer

Prophecy Technologies

Wilmington, DE • On-site

$111K - $133K/yr

Full-time

Posted 3 days ago

Job description

Job Summary:
We are seeking an experienced Data Engineer to join our team. The ideal candidate will have strong expertise in designing and implementing efficient and scalable data pipelines using Apache Spark with Java, integrating data from diverse sources into data lakes (e.g., S3) and data warehouses (e.g., Redshift). This role offers an exciting opportunity to work on enterprise-level data engineering projects.
Key Responsibilities:
  • Design and develop efficient and scalable data pipelines using Apache Spark with Java, integrating data from diverse sources into data lakes (e.g., S3) and data warehouses (e.g., Redshift).
  • Leverage a range of AWS services for data storage, processing, and analytics, including but not limited to S3, Redshift, Glue, EMR, Lambda, Kinesis, and DynamoDB.
  • Optimize Spark applications and data pipelines for performance, cost-efficiency, and reliability, including tuning Spark configurations and utilizing appropriate AWS resources.
  • Design and implement data models for structured and unstructured data, and contribute to the overall data architecture strategy within an AWS environment.
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Implement monitoring solutions for data pipelines and infrastructure, and troubleshoot issues to ensure data quality and system stability.
  • Implement data security measures and adhere to data governance policies within the AWS ecosystem.
  • Create and maintain comprehensive documentation for data engineering processes, designs, and deployments.

Required Technical Skills:
  • Strong proficiency in Java, with experience in developing Spark applications.
  • In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, DataFrames, and RDDs.
  • Extensive experience with AWS services, particularly those related to data engineering (S3, Redshift, Glue, EMR, Kinesis, Lambda).
  • Experience with data warehousing concepts and technologies (e.g., Redshift, Snowflake), and building data lakes on S3.
  • Proficiency in SQL and experience with both relational and NoSQL databases.
  • Strong understanding and practical experience in designing and implementing ETLELT processes.
  • Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.

Required Qualifications:
  • 8-10 years of experience in data engineering.
  • Relevant certification in data engineering or related field.
  • Bachelor's degree in Computer Science or related field.

Preferred Qualifications:
  • Experience with PySpark.
  • Strong communication and collaboration skills to work effectively within a team and with various stakeholders.

Apply