Immediate W2 contract position available in Atlanta, GA (Hybrid).
- The position is listed as hybrid because team members come into the office as needed for meetings with business partners. Currently, we do not have sufficient office space for all workers to be onsite Monday through Thursday from 8:00 AM to 5:00 PM.
Estimated Duration: 3 years
Job Summary:
The Data Engineer is responsible for designing, building, and supporting scalable data platforms, data products, application integrations, and analytics solutions that enable business decision-making across Power Delivery. This role develops and maintains enterprise data pipelines, integrates operational systems with cloud-based lakehouse platforms, and supports both low-code and pro-code application development using Microsoft Power Platform, OutSystems, and Databricks.
The successful candidate partners with business stakeholders, data analysts, application developers, and technology teams to deliver trusted, governed, and reusable data assets.
Key Responsibilities:
- Data Engineering & Integration
- Design, build, and support enterprise data pipelines using ETL and ELT methodologies.
- Develop scalable ingestion frameworks for structured, semi-structured, and streaming data.
- Build and maintain Databricks notebooks, workflows, and data pipelines.
- Ingest data from source systems using:
- Azure Data Factory
- Kafka
- CDC technologies
- APIs
- Files and database sources
- Implement data quality checks, monitoring, and exception handling.
- Support Bronze, Silver, and Gold (Medallion) data architectures within the Databricks Lakehouse.
- Databricks Development
- Design and maintain Delta Lake tables and data products.
- Develop solutions using:
- Databricks
- PySpark
- Spark SQL
- Python
- SQL
- Optimize lakehouse performance, scalability, and cost management.
- Support data sharing, governance, and catalog management using Unity Catalog.
- Application Development
- Build and enhance business applications using:
- Microsoft Power Apps
- Power Automate
- Microsoft Power Platform
- OutSystems
- Develop integrations between Databricks and business applications.
- Partner with users to automate workflows and operational processes.
- Data Governance & DevOps
- Follow Company governance and security standards.
- Implement CI/CD practices using GitHub and Azure DevOps.
- Maintain documentation, data lineage, and metadata for enterprise data assets.
- Participate in architecture reviews and solution design activities.
Required Qualifications
Education
- Bachelor's degree in one of the following:
- Computer Science
- Information Systems
- Data Analytics
- Engineering
- Related technical discipline
Experience
- 3–7 years of experience in data engineering, analytics engineering, or software development.
- Experience building enterprise data pipelines and integrations.
- Experience working with cloud-based data platforms.
Required Technical Skills
- Data Engineering
- ETL / ELT design and development
- Data ingestion frameworks
- Data pipeline orchestration
- Data warehousing concepts
- Data Lake and Lakehouse architectures
- Medallion architecture
- Databricks
- Databricks
- Databricks Workflows
- PySpark
- Spark SQL
- Delta Lake
- Unity Catalog
- Data Products
- Cloud & Integration
- Azure Data Factory
- APIs
- Kafka
- CDC technologies
- SQL Server
- Development
- Python
- SQL
- GitHub
- Azure DevOps
- Business Applications
- Microsoft Power Apps
- Power Automate
- Microsoft Power Platform
- OutSystems
Preferred Qualifications
- Utility industry experience
- Power Delivery domain knowledge
- Experience supporting Transmission or Distribution Analytics
- Real-time data streaming experience
- Knowledge of AI/ML enablement on Databricks
- Experience with Power BI integration and DirectQuery architectures
Company Description
We provide supplemental employees to the region's most sought after power projects. We credit our success to the commitment we show to our job applicants. E Group Recruiters are here to make sure your job search experience is the best it can be. Our recruiters are experts in knowing what the client manager is looking for in a resume, what bill rate the market will bear, and how to make your application stand out among the rest. Our personal touch continues even after we've found the perfect job for you. All full-time employees are eligible to pay for full health and retirement benefits including BC/BS health and dental insurance, life and disability insurances, and 401K with an immediately vested match is available. We have a dedicated team to guide you through these benefits.