Senior Pyspark Developer Jobs in Bridgeview, IL (NOW HIRING)

We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This ...

... engineering and analytics initiatives. This role requires strong technical expertise, hands-on ... Python / PySpark : Skilled in data processing using Databricks or Jupyter Notebooks. * SQL

Design and optimize ETL/ELT pipelines using Databricks, PySpark, Python, SQL, and Delta Lake ... Implement CI/CD using Azure DevOps/GitHub Actions , Git, and Terraform. * Collaborate with ...

... DevOps practices using tools such as Jenkins, GitHub/GitLab, Bitbucket, GoCD, and automated ... Preferred Qualifications • Working knowledge of PySpark with Databricks. • Experience working ...

Write and tune PySpark / Spark SQL notebooks for large-scale data transformation * Architect end-to ... Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta ...

Strong experience with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, SQL, and dbt required. * Experience with Azure DevOps, Git, pull request workflows, CI/CD pipelines, and ...

... PySpark, Microsoft Fabric, or similar cloud data platforms. This individual will help automate ... Experience with Azure cloud services, DevOps practices, version control, or deployment pipelines.

... Expertise in Python, SQL, PySpark, Docker • Experience with streaming and batch data ... DevOps and CI/CD concepts • Excellent communication and teamwork skills • master's degree in ...

Experience with PySpark and Apache Spark for high-performance distributed data processing. * Depth ... Understanding of CI/CD and DevOps using Jenkins, GitHub/GitLab, Bitbucket, GoCD, and automated ...

Spark / PySpark * SQL (advanced) * Delta Lake * Data quality frameworks * Data observability tools * AWS/Azure cloud * Orchestration (Airflow, Control-M) * APIs & integrations * CI/CD, DevOps * Data ...

Implement robust DevOps pipelines for code versioning, testing, deployment and monitoring ... Write modular, testable code inPython or PySpark and manage version control with Git; * Support ...

Senior engineers who join now shape the reference architecture every future engagement inherits ... PySpark and why. * Ability to break down ambiguous business problems into Foundry-solvable ...

Position: Sr. Data Engineer Experience: -8+ Years Location: Chicago, IL(3 days/Week) Responsibilities: - * Perform Develop and manage ETL processes using Python, PySpark, and SQL. * Work with ...

This role will partner closely with hiring managers across Data Engineering, Software Engineering ... AWS (or comparable cloud platforms),Python, SQL, PySpark, Data pipelines, ETL/ELT processes, and ...

... experience (Lead and Senior profiles are welcome) * Strong experience migrating data from ... Hands-on expertise with Python, Spark/PySpark, SQL/PLSQL, Pandas * Experience building ETL/ELT ...

... PySpark (distributed processing, optimization) • Azure Data Factory (pipelines, triggers, monitoring) • Databricks (Delta Lake, workflows, clusters) • Azure (ADLS Gen2, Azure SQL, Resource ...

Git branching, pull requests, CI/CD pipelines in Azure DevOps, automated testing, and environment ... on Spark/PySpark for large-scale transformation * Strong grounding in data warehousing and ...

Git branching, pull requests, CI/CD pipelines in Azure DevOps, automated testing, and environment ... on Spark/PySpark for large-scale transformation * Strong grounding in data warehousing and ...

Git branching, pull requests, CI/CD pipelines in Azure DevOps, automated testing, and environment ... on Spark/PySpark for large-scale transformation * Strong grounding in data warehousing and ...

ABOUT THE ROLE We are looking for a Senior Data Engineer (remote) to own and evolve the backbone of ... Strong programming skills (Python, Pyspark, or similar) with proven experience in building and ...