Data Processing Jobs in Elgin, IL (NOW HIRING)

Rosemont, IL Duration: 6 months 3+ Experience with developing Batch ETL/ELT processes using SQL Server and SSIS ensuring all related data pipelines meets best-in-class standards offering high ...

Skilled in data processing using Databricks or Jupyter Notebooks. * SQL : Proficient in complex data manipulation and retrieval. * AWS (S3) : Experience consuming and managing data in cloud storage.

Develop and optimize data ingestion, processing, and analytics pipelines for structured and unstructured data. * Collaborate with cross functional teams to translate business and analytical ...

Develop and optimize data ingestion, processing, and analytics pipelines for structured and unstructured data. * Collaborate with cross‑functional teams to translate business and analytical ...

Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink) * Collaborate with development teams on data modeling, data ingestion, and capacity planning * Work with users to ...

... processing. - Implement data quality checks, validation, and monitoring. - Enable machine learning workflows with clean, well-structured datasets. - Support analytics and reporting use cases ...

Evaluate and implement appropriate distributed processing and data movement patterns for varying business requirements. * Develop and optimize enterprise-scale ETL/ELT pipelines. * Collaborate with ...

Design and develop data ingestion processes from multiple sources, including: * Infrastructure monitoring platforms * CMDB and asset management systems * Cloud platforms (Azure, AWS) * Enterprise ...

Key Responsibilities Data Engineering & Pipeline DevelopmentDesign, develop, and maintain end-to-end data pipelines in Databricks using Spark and Delta Lake Build and optimize ELT/ETL processes for ...

Strong analytical skills, with the ability to diagnose complex data processing bottlenecks. Nice-to-Have Skills Data orchestration tools (e.g., Apache Airflow, Azure Data Factory). Data governance ...

Deep knowledge in eDiscovery-focused data processing, structured analytics, and related troubleshooting. • Expert-level proficiency in Microsoft Excel, including VBA development, Power Query ...

Strong analytical skills, with the ability to diagnose complex data processing bottlenecks. Nice-to-Have Skills Data orchestration tools (e.g., Apache Airflow, Azure Data Factory). Data governance ...

... processing. - Implement data quality checks, validation, and monitoring. - Enable machine learning workflows with clean, well-structured datasets. - Support analytics and reporting use cases ...

Expert-level SQL and strong proficiency in Python (Scala or Java a plus) for large-scale data processing and transformation. * Deep experience with cloud data platforms (e.g., Databricks, Snowflake ...

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and ...

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and ...

Develop and optimize large-scale data processing solutions using Scala, Spark, and SQL on modern data platforms. * Build and operate trusted data pipelines across secure cloud environments such as ...

Develop and optimize large-scale data processing solutions using Scala, Spark, and SQL on modern data platforms. * Build and operate trusted data pipelines across secure cloud environments such as ...

Build and manage data processing workloads within modern lakehouse platforms, including Microsoft Fabric / OneLake (preferred). * Ensure data quality, reliability, and consistency by implementing ...

Researches, identifies and implements process improvements that address complex technology gaps ... Strong SQL and data analytical skills; experience building data marts and feature datasets for data ...