Data Engineer
Chicago, IL ยท On-site
$118K - $141K/yr
... identity management, and secure data sharing mechanisms Support API-based integrations and ... Unity Catalog) Spark / PySpark SQL (advanced querying and optimization)
Quick apply
Chicago, IL ยท On-site
$118K - $141K/yr
... identity management, and secure data sharing mechanisms Support API-based integrations and ... Unity Catalog) Spark / PySpark SQL (advanced querying and optimization)
Quick apply
Chicago, IL ยท On-site
$118K - $141K/yr
... identity management, and secure data sharing mechanisms Support API-based integrations and ... Unity Catalog) Spark / PySpark SQL (advanced querying and optimization)
Chicago, IL ยท On-site
$10K - $145K/yr
Guided by our CORE values of Collaborative Communication, Overall Unity, Respect and Trust, and ... Provides complete management of project timelines and related design activity communication between ...
Quick apply
Chicago, IL ยท On-site
$10K - $145K/yr
Guided by our CORE values of Collaborative Communication, Overall Unity, Respect and Trust, and ... Provides complete management of project timelines and related design activity communication between ...
Chicago, IL ยท On-site
$56.75 - $70.25/hr
... Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing ...
Quick apply
Chicago, IL ยท On-site
$56.75 - $70.25/hr
... Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing ...
Chicago, IL ยท On-site
... Manager (CUCM), Microsoft Teams, or similar platforms. Experience with WebEx, Calabria call center applications, Cisco Unity voice mail systems, Cisco Emergency Responder (CER) and RedSky for E911 ...
Chicago, IL ยท On-site
... Manager (CUCM), Microsoft Teams, or similar platforms. Experience with WebEx, Calabria call center applications, Cisco Unity voice mail systems, Cisco Emergency Responder (CER) and RedSky for E911 ...
Chicago, IL ยท On-site
... Manager (CUCM), Microsoft Teams, or similar platforms. Experience with WebEx, Calabria call center applications, Cisco Unity voice mail systems, Cisco Emergency Responder (CER) and RedSky for E911 ...
Chicago, IL ยท On-site
... Manager (CUCM), Microsoft Teams, or similar platforms. Experience with WebEx, Calabria call center applications, Cisco Unity voice mail systems, Cisco Emergency Responder (CER) and RedSky for E911 ...
$65 - $85.50/hr
You will report to a Field Engineering Manager within the Manufacturing team at Databricks. The ... Become an expert in, and promote open source projects (Apache Spark, Delta Lake, MLflow, and Unity ...
$65 - $85.50/hr
You will report to a Field Engineering Manager within the Manufacturing team at Databricks. The ... Become an expert in, and promote open source projects (Apache Spark, Delta Lake, MLflow, and Unity ...
Chicago, IL ยท Hybrid
$118K - $141K/yr
Offering services in marketing analytics, packaging, supply chain management and logistics, HAVI ... Unity Catalog (RBAC, permissions, lineage, data masking/row-level access). * Databricks Jobs ...
Chicago, IL ยท Hybrid
$118K - $141K/yr
Offering services in marketing analytics, packaging, supply chain management and logistics, HAVI ... Unity Catalog (RBAC, permissions, lineage, data masking/row-level access). * Databricks Jobs ...
Bolingbrook, IL ยท On-site +1
$85K - $109K/yr
... management works together to deliver integrated, highimpact solutions. Step into Your New Role We ... unity. We are proud to offer the following: Benefits: Kleinfelder, and its' subsidiaries and ...
Bolingbrook, IL ยท On-site +1
$85K - $109K/yr
... management works together to deliver integrated, highimpact solutions. Step into Your New Role We ... unity. We are proud to offer the following: Benefits: Kleinfelder, and its' subsidiaries and ...
Chicago, IL ยท On-site +1
$118K - $141K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Chicago, IL ยท On-site +1
$118K - $141K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Chicago, IL ยท Remote
$117K - $140K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Quick apply
Chicago, IL ยท Remote
$117K - $140K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Chicago, IL ยท Hybrid
$100K - $150K/yr
Familiarity with Delta Lake and Unity Catalog * Experience building reusable AI prompt libraries or ... Experience with test data management and synthetic data generation * Familiarity with ...
Chicago, IL ยท Hybrid
$100K - $150K/yr
Familiarity with Delta Lake and Unity Catalog * Experience building reusable AI prompt libraries or ... Experience with test data management and synthetic data generation * Familiarity with ...
Chicago, IL ยท On-site +1
$118K - $141K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Chicago, IL ยท On-site +1
$118K - $141K/yr
Establish and promote best practices for data governance, lineage tracking, metadata management ... Unity Catalog * Spark-based pipelines * Experience with Spark, Scala, or PySpark. * Familiarity ...
Chicago, IL ยท Hybrid
$100K - $150K/yr
Familiarity with Delta Lake and Unity Catalog * Experience building reusable AI prompt libraries or ... Experience with test data management and synthetic data generation * Familiarity with ...
Chicago, IL ยท Hybrid
$100K - $150K/yr
Familiarity with Delta Lake and Unity Catalog * Experience building reusable AI prompt libraries or ... Experience with test data management and synthetic data generation * Familiarity with ...
$118K - $141K/yr
Initiate and manage efforts to improve data quality, operational efficiency, and process ... Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD ...
$118K - $141K/yr
Initiate and manage efforts to improve data quality, operational efficiency, and process ... Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD ...
Chicago, IL ยท On-site
Manager For The Data & Ai Team Valorem Reply is an award-winning digital transformation firm ... and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
Chicago, IL ยท On-site
Manager For The Data & Ai Team Valorem Reply is an award-winning digital transformation firm ... and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
$118K - $141K/yr
Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment * Strong ... Experience with Delta Lake, Databricks Workflows, and Unity Catalog * Experience using Git-based ...
$118K - $141K/yr
Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment * Strong ... Experience with Delta Lake, Databricks Workflows, and Unity Catalog * Experience using Git-based ...
Chicago, IL ยท On-site
... management, and auditing as required Ideally, you will also have: - CommVault Certified Engineer - Working knowledge of SAN and Cloud storage systems - EMC Unity and PURE Storage. - Federal Agency ...
Quick apply
Chicago, IL ยท On-site
... management, and auditing as required Ideally, you will also have: - CommVault Certified Engineer - Working knowledge of SAN and Cloud storage systems - EMC Unity and PURE Storage. - Federal Agency ...
Chicago, IL ยท On-site
$123K - $167K/yr
... management, and auditing as required Ideally, you will also have: - CommVault Certified Engineer - Working knowledge of SAN and Cloud storage systems - EMC Unity and PURE Storage. - Federal Agency ...
Chicago, IL ยท On-site
$123K - $167K/yr
... management, and auditing as required Ideally, you will also have: - CommVault Certified Engineer - Working knowledge of SAN and Cloud storage systems - EMC Unity and PURE Storage. - Federal Agency ...
$126K - $166K/yr
Extensive experience with Terraform and the Databricks Terraform Provider to manage workspace ... Practical Experience Implementing automation and administering the Unity Catalog supporting ...
$126K - $166K/yr
Extensive experience with Terraform and the Databricks Terraform Provider to manage workspace ... Practical Experience Implementing automation and administering the Unity Catalog supporting ...
You speak fluently about the Data Intelligence Platform, Unity Catalog, Delta Lake, Mosaic AI ... You bring named-account relationships with commercial CDOs, CTOs, VPs of Data Engineering, and ...
Quick apply
You speak fluently about the Data Intelligence Platform, Unity Catalog, Delta Lake, Mosaic AI ... You bring named-account relationships with commercial CDOs, CTOs, VPs of Data Engineering, and ...
| Aspect | Unity Engineer Manager | Unity Developer |
|---|---|---|
| Primary Role | Oversees Unity development teams, manages projects, and sets technical direction | Develops and implements Unity-based applications or games |
| Required Skills | Leadership, project management, Unity expertise, coding skills | Strong Unity and C# programming, creative design skills |
| Work Environment | Team management, collaboration with designers and artists | Hands-on coding, design, and development tasks |
| Common Usage | Used in larger teams and companies with multiple projects | Used by individual developers or small teams |
The main difference is that a Unity Engineer Manager leads and manages Unity development teams, focusing on project oversight and team coordination, while a Unity Developer primarily focuses on coding and creating Unity applications or games. Both roles require strong Unity skills, but the manager also needs leadership and project management experience.
$118K - $141K/yr
Contractor
Posted 26 days ago
Job Description:
Key Responsibilities
Data Engineering & Pipeline DevelopmentDesign, develop, and maintain end-to-end data pipelines in Databricks using Spark and Delta Lake
Build and optimize ELT/ETL processes for structured and unstructured data ingestion into the Data Lakehouse
Implement scalable ingestion patterns (batch and event-driven) from internal systems, third-party APIs, and cloud sources
Develop data models (bronze, silver, gold layers) to support enterprise reporting, analytics, and downstream consumption
Data Platform & IntegrationIntegrate the Data Lakehouse with enterprise tools such as Tableau, Alteryx, and machine learning platforms
Design and implement data access controls, identity management, and secure data sharing mechanisms
Support API-based integrations and downstream data consumption patterns
Data Quality, Governance & ControlsImplement data quality checks, reconciliation processes, and monitoring within Databricks pipelines
Ensure adherence to enterprise data governance standards, including lineage, metadata, and audit requirements
Support regulatory and compliance requirements (e.g., data integrity, privacy, and security controls)
Cloud & AutomationDevelop and manage workflows using orchestration tools (e.g., Airflow, Control-M)
Automate data pipelines, deployments, and operational processes through CI/CD pipelines
Leverage cloud-native services (AWS/Azure) for data processing, storage, and event-driven architectures
Operations & SupportMonitor, troubleshoot, and optimize data pipelines and Spark workloads for performance and reliability
Support production data platforms, including incident resolution and root cause analysis
Ensure high availability, data integrity, and SLA adherence across enterprise data systems
CollaborationPartner with data architects, data scientists, BI teams, and business stakeholders to deliver data solutions
Participate in Agile ceremonies and contribute to iterative delivery of data products
Translate business requirements into scalable technical data solutions
Required Qualifications
8+ years of experience in data engineering, data platforms, or related roles
Hands-on experience with Databricks, Apache Spark (PySpark), and Delta Lake
Strong SQL and data modeling skills (relational and dimensional)
Experience building and supporting data pipelines in a cloud environment (AWS or Azure)
Experience with ELT/ETL tools (e.g., Fivetran, custom ingestion frameworks)
Familiarity with data orchestration tools (Airflow, Control-M)
Experience working in Agile development environments
Preferred QualificationsExperience in financial services or regulated environments (e.g., banking, risk, regulatory reporting)
Knowledge of data governance frameworks and tools (e.g., Collibra)
Experience with real-time or streaming data pipelines
Exposure to machine learning pipelines and feature engineering in Databricks
Cloud certifications (AWS, Azure, or Databricks)
Technical SkillsDatabricks (Lakehouse architecture, notebooks, jobs, Unity Catalog)
Spark / PySpark
SQL (advanced querying and optimization)
Sourced by ZipRecruiter
51 - 200 Employees
Fort Mill, SC, US
2015