Databricks Engineer Jobs in Hoover, AL (NOW HIRING)

About Us

Quanta Power Solutions brings together the industry-leading capabilities and resources of Quanta's operating companies to deliver complete EPC solutions. Our integrated approach spans power generation, battery energy storage, renewables, transmission, substation, and underground infrastructure — from concept to commissioning, we execute complex power infrastructure projects with the speed, certainty, and operational excellence our customers depend on.

At Quanta Power Solutions, we are driven by a culture of safety, integrity, and disciplined execution — and we're building a team that shares that commitment.

About this Role

Quanta Power Solutions is seeking an experienced Data & Integration Platform Engineer to own, develop, and operate two complementary platforms at the heart of our data ecosystem: Databricks and Boomi. This is a dual-platform ownership role designed for an engineer who understands that great data starts with great integration—and who can govern both ends of that pipeline.

On the Databricks side, you will serve as the technical owner of our enterprise data platform tenant, spanning the Bronze, Silver, and Gold layers of our medallion architecture and delivering curated data assets to BI analysts, AI tools, and business stakeholders across Finance, Operations, Supply Chain, and Project Management. On the Boomi side, you will own the integration platform that connects our enterprise applications—JD Edwards, EcoSys, Salesforce, Dynamics 365, Kronos, and others—and ensures that data flows reliably from source systems into Databricks and between operational platforms.

Both platforms are actively being stood up at Quanta Power Solutions. The successful candidate will take full ownership of each from an early stage, establishing the standards, governance practices, and operating rhythms that will scale with the business. This is a hands-on engineering role with broad platform responsibility—ideal for someone who thrives in a greenfield environment and finds satisfaction in building things right from the start.

What You'll Do

Integration Development (Boomi)

• Design, build, and maintain integration processes in Boomi AtomSphere to connect enterprise systems including JD Edwards, EcoSys, Salesforce, Dynamics 365, Kronos, Autodesk Construction Cloud (ACC/Forma), Bridgit, P6, LevelPath, Origami, and others as the portfolio grows.
• Develop and maintain REST and SOAP API connectors, data transformation maps, cross-reference tables, and reusable process components that form the foundation of QPS’s integration library.
• Build event-driven and near-real-time integrations where business processes require low-latency data availability across systems, and EDI/B2B processes to support supply chain and vendor data exchange.
• Own and administer the Boomi AtomSphere environment, including Atom and Molecule configuration, environment management (Development, Test, Production), deployment pipelines, and release practices.

Data Platform Engineering (Databricks)

• Design and build ETL/ELT workflows using Delta Live Tables, notebooks, and Databricks Jobs to ingest data from Boomi-managed and direct-connect source systems into the Bronze layer, and transform it through Silver into business-ready Gold layer datasets.
• Own and administer Unity Catalog to enforce data governance, access controls, and row/column-level security across all platform layers—taking accountability for the governance framework’s evolution, not just its day-to-day administration.
• Collaborate with BI developers to ensure Gold layer datasets are structured, documented, and optimized for Databricks-native consumption (Genie AI/BI and Databricks Apps). Note: Power BI is an interim tool; the organization’s target state is Databricks-native visualization.
• Support AI and analytics use cases by maintaining clean, well-modeled data assets that power Genie Spaces, Databricks Apps, and internal AI agents.

Platform Operations & Health

• Monitor the health of both platforms—integration processes in Boomi and data pipelines in Databricks—troubleshoot failures proactively, and maintain SLAs for data availability, timeliness, and quality.
• Own data quality monitoring and alerting, including SLA definition (freshness, completeness, accuracy) and escalation processes across both the integration and data platform layers.
• Manage the security model across both platforms: API security policies and credential management in Boomi; row-level security (RLS), column-level security (CLS), and tiered access controls in Databricks Unity Catalog.
• Manage platform licensing, entitlements, and capacity for both Boomi and Databricks in partnership with IT leadership.

Governance, Standards & Documentation

• Establish and enforce development standards across both platforms: naming conventions, error-handling patterns, retry logic, logging, component reuse, and documentation practices that keep the combined platform portfolio maintainable and auditable.
• Own a living catalog of all active integrations and data pipelines—documenting data flows, business owners, SLA commitments, and dependency maps so the full data estate is transparent to IT leadership and business stakeholders.
• Enforce lifecycle governance for integrations and data pipelines: version control, change management, deprecation practices, and decommissioning of legacy point-to-point integrations as the Boomi platform matures.
• Own data governance frameworks in Databricks—Unity Catalog policies, data ownership assignments, quality SLAs, lineage documentation—and evolve them as the platform scales.

Stakeholder Engagement & Leadership Partnership

• Serve as the primary technical point of contact for data and integration needs across Finance, Operations, Supply Chain, and Project Management, translating business requirements into sound platform designs.
• Own the intake and prioritization process for both data requests (Databricks) and integration requests (Boomi), maintaining a transparent, jointly managed backlog aligned to business priorities.
• Partner with Corporate IT to ensure alignment with Quanta enterprise architecture standards, security policies, and shared infrastructure. Note: QPS operates Databricks on AWS within a broader Quanta organization that is Azure-centric; cross-cloud awareness is a practical requirement of this partnership.
• Partner with IT leadership and the Data Analytics team on roadmap planning, capacity needs, and emerging capabilities across both platforms.
• Communicate platform health, roadmap progress, and risks to leadership in clear, business-relevant terms.
• Coordinate with external implementation partners and application vendors during onboarding or transition periods, ensuring clean knowledge transfer and sustainable internal ownership.

What You'll Bring

Education

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.

Experience

• 6–8 years of combined experience in data engineering and/or enterprise application integration, with demonstrated ownership of at least one platform end-to-end (not just a contributor role).
• Hands-on Boomi AtomSphere experience: process design, connector configuration, data mapping, API management, and Atom/Molecule administration.
• Hands-on Databricks experience: Delta Lake, Unity Catalog, Databricks SQL, Delta Live Tables, and pipeline development.
• Strong SQL skills for complex query development, optimization, and debugging.
• Experience with Python or PySpark for data transformation and pipeline development.
• Strong command of integration data formats and protocols: REST, SOAP, JSON, XML, CSV, and EDI.
• Solid understanding of both integration design patterns (request/reply, event-driven, API-first, batch) and data modeling concepts (medallion architecture, star schema, dimensional modeling).
• Familiarity with cloud infrastructure—AWS preferred (S3, IAM, networking fundamentals)—with awareness of Azure as a secondary environment.
• Experience with enterprise source systems such as JD Edwards, EcoSys, Salesforce, Dynamics 365, or similar ERP/CRM platforms.
• Experience owning or significantly evolving platform governance practices: data ownership models, quality standards, access policies, integration standards, and lifecycle management.
• Strong communication skills with the ability to translate technical architecture into business context for non-technical stakeholders.

Nice-to-Have

• Boomi Professional Developer or Boomi Architect certification.
• Databricks Certified Data Engineer certification (Associate or Professional).
• Experience with other iPaaS or integration platforms (MuleSoft, Azure Data Factory, Informatica) as a basis for design judgment.
• Experience with API gateway and developer portal management (publishing, versioning, and securing APIs for internal or external consumers).
• Familiarity with data-as-a-product concepts: data contracts, SLAs, discoverability, and event-driven data sharing.
• Experience in a post-M&A, multi-subsidiary, or greenfield environment where integration and data infrastructure were built from the ground up.
• Familiarity with identity and access management standards relevant to integration and platform security (OAuth 2.0, SAML, mTLS, RLS/CLS).

Travel Requirements

Travel Required

Yes

Percent of Time

Up to 10%

What You'll Get

• Competitive Compensation
• 401(k) Retirement Plan
• Holiday Pay
• Paid Time Off (PTO)
• Comprehensive Health Coverage
• Pet Insurance
• Employee Assistance Program (EAP)
• Professional Development
• Tuition Assistance
• Employee Discount Program