Trainee Databricks Data Engineer Jobs in Sarasota, FL

Location: Sarasota, FL, hybrid, 3 days onsite

We are seeking a Senior Data Architect to provide an independent third‑party perspective on an ongoing enterprise Data Modernization program. The role focuses on architecture assurance, risk mitigation, and acceleration of platform adoption ensuring alignment with enterprise‑scale best practices and long‑term strategic goals.

The architect will work independently with client stakeholders and multiple vendor teams, validating decisions, challenging assumptions, and guiding the program toward a scalable, secure, and future‑ready lakehouse architecture on Databricks.

1. Architecture Advisory Independent Review

   Provide objective third‑party evaluation of the current data platform architecture design choices and implementation approach.

   Review and validate lakehouse architecture including ingestion, transformation, storage, and consumption layers.

   Identify gaps, design risks, and antipatterns across the platform.

   Recommend alternative approaches and trade‑offs aligned to enterprise standards.

2. Data Modernization Strategy Alignment

   Assess alignment to modern data platform paradigms: Lakehouse, ELT, Medallion architecture.

   Validate architectural decisions around:

   • Data ingestion patterns: batch, streaming, unstructured data integration
   • Data modeling and transformation strategies
   • Analytics and AI/ML readiness of the platform

   Ensure consistency with enterprise‑scale governance, security, and performance requirements.

3. Risk Identification & Derisking

   Proactively identify technical architectural and operational risks impacting delivery timelines and scalability.

   Conduct design reviews and provide mitigation strategies and decision frameworks.

   Flag dependencies, constraints, and potential long‑term impacts of current design choices.

   Support leadership with architecture risk summaries and decision recommendations.

4. Multi‑Vendor Stakeholder Engagement

   Work independently with:

   • Customer architects and SMEs
   • Internal delivery teams
   • Third‑party vendors

   Facilitate architecture discussions, workshops, and governance reviews.

   Act as a neutral technical authority to resolve architectural conflicts and drive consensus.

5. Best Practices Governance

   Define and enforce architecture standards, design patterns, and guardrails.

   Ensure adoption of:

   • Databricks and Spark best practices
   • Data governance frameworks including cataloging, access control, and auditing
   • Performance, cost optimization, and scalability standards

   Provide guidance on DataOps, DevOps practices, and observability frameworks.

6. Acceleration Program Support

   Identify opportunities to accelerate delivery and remove bottlenecks.

   Guide teams in prioritizing architectural decisions that unlock progress.

   Support roadmap refinement for phased platform evolution.

14 years in data engineering, data architecture, or analytics platform engineering.

Proven experience in enterprise data modernization or cloud migration programs.

Strong background in Databricks‑based lakehouse implementations at scale.

• Databricks platform architecture
• AWS cloud
• Apache Spark, PySpark, SQL
• Delta Lake and lakehouse design patterns

• Data ingestion and ELT frameworks
• Data governance and cataloging approaches
• Performance optimization and distributed systems

Ability to operate independently as a trusted advisor in a complex multivendor environment.

Strong stakeholder management and executive communication skills.

Proven capability to challenge existing designs constructively and drive consensus.

Strong analytical and problem‑solving mindset.

Focus on independent assurance rather than delivery ownership.

Requires a consultative mindset combined with deep architectural expertise.

Strong emphasis on:

• Risk mitigation
• Decision validation
• Cross‑team alignment

Ability to influence outcomes without direct team ownership.

Experience in insurance or regulated industries.

Exposure to BI/analytics transformation tools.

Prior experience in architecture governance boards or external advisory roles.