Data Engineer - IAM
$109K - $132K/yr
Data Engineer - IAM Data Lake (Google Cloud Platform) Location: Irving, TX (Preferred) or Ohio ... This role will focus on building scalable data lake solutions, developing data ingestion pipelines ...
$109K - $132K/yr
Data Engineer - IAM Data Lake (Google Cloud Platform) Location: Irving, TX (Preferred) or Ohio ... This role will focus on building scalable data lake solutions, developing data ingestion pipelines ...
$109K - $132K/yr
Data Engineer - IAM Data Lake (Google Cloud Platform) Location: Irving, TX (Preferred) or Ohio ... This role will focus on building scalable data lake solutions, developing data ingestion pipelines ...
San Diego, CA · On-site
$121K - $146K/yr
They are seeking a Data Ops Engineer to design, build, and maintain real-time data ingestion pipelines, ensuring reliable data flow and quality while collaborating with various engineering teams.
San Diego, CA · On-site
$121K - $146K/yr
They are seeking a Data Ops Engineer to design, build, and maintain real-time data ingestion pipelines, ensuring reliable data flow and quality while collaborating with various engineering teams.
Mclean, VA · Remote
$117K - $141K/yr
Data Engineer - Cyber Risk & Security Data Platforms Location: Remote Terms: Full-time Travel: 0 ... Build and manage REST APIs and data ingestion services across systems * Write production-grade code ...
Mclean, VA · Remote
$117K - $141K/yr
Data Engineer - Cyber Risk & Security Data Platforms Location: Remote Terms: Full-time Travel: 0 ... Build and manage REST APIs and data ingestion services across systems * Write production-grade code ...
$124K - $127K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
$124K - $127K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
Mclean, VA · Remote
$115K - $139K/yr
Data Engineer - Cyber Risk & Security Data Platforms Location: Remote Terms: Full-time Clearance ... REST APIs and data ingestion services * Data validation, monitoring, and alerting tools
Quick apply
Mclean, VA · Remote
$115K - $139K/yr
Data Engineer - Cyber Risk & Security Data Platforms Location: Remote Terms: Full-time Clearance ... REST APIs and data ingestion services * Data validation, monitoring, and alerting tools
Jersey City, NJ · On-site
$119K - $143K/yr
The ideal candidate will have expertise in Google BigQuery, specifically in data ingestion ... Apply DevOps principles for continuous integration and deployment (CI/CD) using GitHub and related ...
Jersey City, NJ · On-site
$119K - $143K/yr
The ideal candidate will have expertise in Google BigQuery, specifically in data ingestion ... Apply DevOps principles for continuous integration and deployment (CI/CD) using GitHub and related ...
San Diego, CA · On-site
$70/hr
Role Summary We are seeking a highly skilled Lead Data Engineer with deep, hands-on experience in building large-scale data ingestion pipelines, real-time streaming solutions, and high-performance ...
San Diego, CA · On-site
$70/hr
Role Summary We are seeking a highly skilled Lead Data Engineer with deep, hands-on experience in building large-scale data ingestion pipelines, real-time streaming solutions, and high-performance ...
Rosemead, CA · On-site
$117K - $140K/yr
Job Summary : eTeam is a company focused on data solutions, and they are seeking a Data Engineer to ... Responsibilities : • Design and maintain data ingestion and processing pipelines • Ensure data ...
Rosemead, CA · On-site
$117K - $140K/yr
Job Summary : eTeam is a company focused on data solutions, and they are seeking a Data Engineer to ... Responsibilities : • Design and maintain data ingestion and processing pipelines • Ensure data ...
$103K - $105K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
$103K - $105K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
Plano, TX · On-site
$110K - $132K/yr
Data Engineer Key Skills: Power BI, Azure Data Bricks, Python Plano, TX- In person only no remote ... Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources ...
Plano, TX · On-site
$110K - $132K/yr
Data Engineer Key Skills: Power BI, Azure Data Bricks, Python Plano, TX- In person only no remote ... Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources ...
Nashville, TN · Remote
$110K - $132K/yr
Benefits: * 401(k) Snowflake Data Engineer (AWS Environment) Only TN residents Nashville, TN ... Strong in data ingestion, transformation, validation Plus: * Healthcare / Public Health data ...
Quick apply
Nashville, TN · Remote
$110K - $132K/yr
Benefits: * 401(k) Snowflake Data Engineer (AWS Environment) Only TN residents Nashville, TN ... Strong in data ingestion, transformation, validation Plus: * Healthcare / Public Health data ...
$119K - $143K/yr
... based data ingestion tools-especially AWS Glue. You will be responsible for maintaining and ... Analysts, Software Engineers, and other stakeholders to ensure data systems meet business ...
$119K - $143K/yr
... based data ingestion tools-especially AWS Glue. You will be responsible for maintaining and ... Analysts, Software Engineers, and other stakeholders to ensure data systems meet business ...
Dallas, TX · On-site
... Data Ingestion Track - Design and Develop Data Ingestion jobs in Azure using Python/java/SQL programming in cloud environment to load the data into Snowflake - Unit Test the Data Ingestions jobs ...
Dallas, TX · On-site
... Data Ingestion Track - Design and Develop Data Ingestion jobs in Azure using Python/java/SQL programming in cloud environment to load the data into Snowflake - Unit Test the Data Ingestions jobs ...
Newark, NJ · On-site
$119K - $143K/yr
Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.) * Ensure the best possible performance and quality of high scale data engineering project * Participate in the ...
Newark, NJ · On-site
$119K - $143K/yr
Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.) * Ensure the best possible performance and quality of high scale data engineering project * Participate in the ...
Wayne, PA · On-site
$103K - $105K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
Wayne, PA · On-site
$103K - $105K/yr
The position serves as both a technical operator and a coordination point between partners, Product, Engineering, and internal Data Management teams. Key Responsibilities 1. Partner Data Ingestion ...
$117K - $140K/yr
They are seeking a Lead Data Engineer to support a large-scale healthcare data platform initiative, modernizing data ingestion, automation, and semantic layer capabilities within Google Cloud ...
$117K - $140K/yr
They are seeking a Lead Data Engineer to support a large-scale healthcare data platform initiative, modernizing data ingestion, automation, and semantic layer capabilities within Google Cloud ...
Charlotte, NC · On-site
$111K - $134K/yr
Develop and manage data ingestion from various sources including message queues, file shares, REST ... Over 9+ years of experience as Data Engineer. * Strong SQL skills (MySQL, HIVE, Impala, SPARK SQL)
Charlotte, NC · On-site
$111K - $134K/yr
Develop and manage data ingestion from various sources including message queues, file shares, REST ... Over 9+ years of experience as Data Engineer. * Strong SQL skills (MySQL, HIVE, Impala, SPARK SQL)
$125K - $150K/yr
Role Summary The Data Engineer will design and implement scalable, distributed data pipelines and ... Data Ingestion & Orchestration Orchestrate data pipelines using Azure Data Factory (ADF) to ...
$125K - $150K/yr
Role Summary The Data Engineer will design and implement scalable, distributed data pipelines and ... Data Ingestion & Orchestration Orchestrate data pipelines using Azure Data Factory (ADF) to ...
As our new Software Engineer IIIyou'll be part of the GDI (Getting Data In) group under NG-SIEM with a focus on data ingestion at petabyte-scale. The group focuses on the data ingestion and ...
As our new Software Engineer IIIyou'll be part of the GDI (Getting Data In) group under NG-SIEM with a focus on data ingestion at petabyte-scale. The group focuses on the data ingestion and ...
$125K - $150K/yr
Role Summary The Data Engineer will design and implement scalable, distributed data pipelines and ... Data Ingestion & Orchestration Orchestrate data pipelines using Azure Data Factory (ADF) to ...
$125K - $150K/yr
Role Summary The Data Engineer will design and implement scalable, distributed data pipelines and ... Data Ingestion & Orchestration Orchestrate data pipelines using Azure Data Factory (ADF) to ...
$44.5K - $56.6K
0% of jobs
$56.6K - $68.7K
1% of jobs
$68.7K - $80.8K
3% of jobs
$80.8K - $92.9K
4% of jobs
$92.9K - $105K
7% of jobs
$115.5K is the 25th percentile. Wages below this are outliers.
$105K - $117K
11% of jobs
$117K - $129.1K
12% of jobs
The median wage is $132.4K / yr.
$129.1K - $141.2K
45% of jobs
$141.2K - $153.3K
8% of jobs
$153.3K - $165.4K
5% of jobs
$165.4K - $177.5K
3% of jobs
$44.5K
$129.7K
$177.5K
A Data Ingestion Engineer is responsible for designing, building, and managing data pipelines that collect, process, and store data from various sources. They ensure efficient data flow into storage systems like data lakes or warehouses while maintaining data integrity and quality. Their role involves working with ETL (Extract, Transform, Load) frameworks, automation tools, and cloud platforms. They collaborate with data analysts, engineers, and scientists to support analytics and business intelligence. Strong skills in programming, databases, and big data technologies are essential for success in this role.
A common challenge for Data Ingestion Engineers is ensuring the reliability and scalability of data pipelines when handling large and diverse datasets from multiple sources. You'll often need to troubleshoot data quality issues, maintain optimal pipeline performance, and address integration hurdles with legacy and modern systems. Regular collaboration with data scientists, analysts, and IT teams is necessary to ensure that data is both timely and usable for downstream applications. Staying updated on new tools and evolving technologies also helps you adapt to changing business needs and data architectures.
To thrive as a Data Ingestion Engineer, you need strong programming skills (such as Python, Java, or Scala), experience with ETL processes, and a solid understanding of data warehousing concepts, often supported by a degree in computer science, engineering, or a related field. Proficiency with data pipeline tools like Apache NiFi, Kafka, or AWS Glue, and certifications in cloud platforms (AWS, Azure, GCP) are highly sought after. Excellent problem-solving abilities, attention to detail, and effective communication skills help you collaborate across multidisciplinary teams. These skills ensure efficient, reliable data flows and support data-driven decision-making within organizations.

Job Description Data Engineer - IAM Data Lake (Google Cloud Platform) Location: Irving, TX (Preferred) or Ohio (Hybrid) Duration: 12 Month Contract W2 ONLY, NO C2C Overview We are seeking a skilled Data Engineer to support the design, development, and enhancement of an enterprise IAM Data Lake platform within Google Cloud Platform (GCP). This role will focus on building scalable data lake solutions, developing data ingestion pipelines, and supporting large-scale data processing initiatives using modern cloud and big data technologies. The ideal candidate will have hands-on experience with Google Cloud Platform, data lake architectures, big data processing frameworks, and Hadoop-based environments.
Experience with Hadoop/HDFS and cloud-native data engineering solutions is highly desirable. Key Responsibilities Design, build, and maintain scalable Data Lake solutions within Google Cloud Platform (GCP). Develop and support batch and streaming data ingestion pipelines using GCP-native services and big data technologies.
Build and optimize data processing workflows to support enterprise-scale analytics and reporting requirements. Design and implement data models, ingestion frameworks, and data transformation processes. Develop and maintain PySpark-based data processing applications.
Utilize Apache Airflow to orchestrate and manage complex data workflows. Implement and maintain CI/CD pipelines to support automated deployment and delivery of data engineering solutions. Design and manage Pub/Sub-based streaming architectures and event-driven data processing workflows.
Support event schema design, schema evolution, and versioning best practices. Implement incremental data ingestion strategies and Change Data Capture (CDC) patterns. Develop APIs and integration solutions to support data consumption and data-sharing requirements.
Create and maintain curated datasets, analytical views, and data exposure layers for downstream consumers. Collaborate with architecture, engineering, security, and business teams to ensure data solutions align with enterprise standards. Required Qualifications 4+ years of experience working with Google Cloud Platform (GCP).
4+ years of experience building and supporting large-scale data processing solutions. 4+ years of experience with PySpark and distributed data processing. 4+ years of experience implementing CI/CD practices and deployment automation.
2+ years of experience building and maintaining data pipelines. 2+ years of experience with Apache Airflow. Experience developing and integrating APIs.
Experience working with data lake architectures and cloud-based storage solutions. Understanding of data modeling concepts and best practices. Strong understanding of data processing frameworks and big data technologies.
Preferred Qualifications Experience with Hadoop Ecosystem technologies and HDFS. Experience designing and implementing streaming architectures using Google Pub/Sub. Familiarity with Change Data Capture (CDC) methodologies and incremental ingestion frameworks.
Experience building enterprise-scale IAM or security-related data platforms. Knowledge of data governance, lifecycle management, and access control best practices within GCP. Experience supporting analytical data platforms and data consumption frameworks.
Technical Skills Cloud & Data Platforms Google Cloud Platform (GCP) Google Cloud Storage (GCS) Pub/Sub Data Lake Architecture Data Engineering & Processing PySpark Apache Airflow Data Pipelines Data Processing Data Modeling Change Data Capture (CDC) Big Data Technologies Hadoop Ecosystem HDFS Data Formats Parquet Avro ORC Development & Automation APIs CI/CD Pipelines Version Control Automation Frameworks
Sourced by ZipRecruiter
201 - 500 Employees
Sparta, NJ, US
2008