Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Senior Databricks Platform Administrator
Boston, MA · On-site
$93K - $126K/yr
Deep understanding of Databricks Lakehouse architecture, Delta Lake, Spark, and large-scale data processing. Experience with cloud platforms such as AWS, Azure, or GCP. Familiarity with AI/ML data ...
Quick apply
Senior Databricks Platform Administrator
Boston, MA · On-site
$93K - $126K/yr
Deep understanding of Databricks Lakehouse architecture, Delta Lake, Spark, and large-scale data processing. Experience with cloud platforms such as AWS, Azure, or GCP. Familiarity with AI/ML data ...
Databricks Architect (Lakehouse platforms)
Minneapolis, MN · On-site +1
$67.50 - $88.75/hr
Databricks Architect Lakehouse platforms Who we are: - At CitiusTech , we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 ...
Databricks Architect (Lakehouse platforms)
Minneapolis, MN · On-site +1
$67.50 - $88.75/hr
Databricks Architect Lakehouse platforms Who we are: - At CitiusTech , we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 ...
Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Quick apply
Databricks & Lakehouse Architecture * Architect enterprise observability data lake solutions using: * Databricks Lakehouse * Delta Lake * Unity Catalog * Delta Live Tables * Structured Streaming
Databricks Practice Lead
Indianapolis, IN · On-site
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Databricks Practice Lead
Indianapolis, IN · On-site
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Databricks Architect
Los Angeles, CA · On-site
$69.75 - $91.50/hr
Design end-to-end Databricks Lakehouse architectures for data ingestion, processing, storage, and consumption. * Define and implement Delta Lake patterns, including medallion architecture (Bronze ...
Quick apply
Databricks Architect
Los Angeles, CA · On-site
$69.75 - $91.50/hr
Design end-to-end Databricks Lakehouse architectures for data ingestion, processing, storage, and consumption. * Define and implement Delta Lake patterns, including medallion architecture (Bronze ...
Databricks SME
Dallas, TX · Hybrid
Lead end-to-end design of Databricks Lakehouse architectures, including Delta Lake , Unity Catalog , and medallion (bronze/silver/gold) data models * Define reference architectures, best practices ...
Quick apply
Databricks SME
Dallas, TX · Hybrid
Lead end-to-end design of Databricks Lakehouse architectures, including Delta Lake , Unity Catalog , and medallion (bronze/silver/gold) data models * Define reference architectures, best practices ...
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Quick apply
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Databricks Practice Lead
Indianapolis, IN · On-site +1
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Databricks Practice Lead
Indianapolis, IN · On-site +1
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
You bring deep expertise in the Databricks Lakehouse Platform and its evolving ecosystem, offering clarity to complex challenges including migrations, governance, and AI enablement. You combine ...
Databricks Architect
Troy, MI · Remote
$66.25 - $87/hr
Role Overview We are looking for a Databricks Architect to design and lead modern Lakehouse data platforms using Databricks. The role focuses on building scalable, high-performance data pipelines and ...
Quick apply
Databricks Architect
Troy, MI · Remote
$66.25 - $87/hr
Role Overview We are looking for a Databricks Architect to design and lead modern Lakehouse data platforms using Databricks. The role focuses on building scalable, high-performance data pipelines and ...
Azure Databricks Architect
Jersey City, NJ · On-site
$66.25 - $86.25/hr
Design end-to-end Databricks Lakehouse architectures for data ingestion, processing, storage, and consumption. * Define and implement Delta Lake patterns, including medallion architecture (Bronze ...
Quick apply
Azure Databricks Architect
Jersey City, NJ · On-site
$66.25 - $86.25/hr
Design end-to-end Databricks Lakehouse architectures for data ingestion, processing, storage, and consumption. * Define and implement Delta Lake patterns, including medallion architecture (Bronze ...
Senior Data Lakehouse Architect (Databricks), Vice President
Quincy, MA · On-site
$70.75 - $94.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
Senior Data Lakehouse Architect (Databricks), Vice President
Quincy, MA · On-site
$70.75 - $94.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
AWS Databricks Engineer
Wilmington, DE · On-site
... and Databricks Lakehouse. • Hands-on experience building enterprise-grade data platforms and multi-zone Lakehouse architectures. Deep knowledge of: o Spark optimization o Delta Lake internals o ...
AWS Databricks Engineer
Wilmington, DE · On-site
... and Databricks Lakehouse. • Hands-on experience building enterprise-grade data platforms and multi-zone Lakehouse architectures. Deep knowledge of: o Spark optimization o Delta Lake internals o ...
AWS Databricks Engineer
Columbus, OH · On-site
Chicago, IL • 12+ years of overall experience in data engineering, cloud architecture, or analytics platforms. • Strong expertise in AWS big-data stack and Databricks Lakehouse. • Hands-on ...
AWS Databricks Engineer
Columbus, OH · On-site
Chicago, IL • 12+ years of overall experience in data engineering, cloud architecture, or analytics platforms. • Strong expertise in AWS big-data stack and Databricks Lakehouse. • Hands-on ...
Sr Databricks Engineer
$110K - $152K/yr
The ideal candidate will have strong expertise in the Databricks Lakehouse platform, building and managing scalable data pipelines, working with notebooks, and implementing robust data monitoring ...
Sr Databricks Engineer
$110K - $152K/yr
The ideal candidate will have strong expertise in the Databricks Lakehouse platform, building and managing scalable data pipelines, working with notebooks, and implementing robust data monitoring ...
Databricks Subject Matter Expert
Atlanta, GA · On-site
$170/hr
In this role, you will serve as the firm's foremost technical authority on the Databricks Lakehouse Platform, guiding clients through complex data transformation initiatives-from strategic ...
Databricks Subject Matter Expert
Atlanta, GA · On-site
$170/hr
In this role, you will serve as the firm's foremost technical authority on the Databricks Lakehouse Platform, guiding clients through complex data transformation initiatives-from strategic ...
Senior Data Lakehouse Architect (Databricks), Vice President
Quincy, MA · On-site
$70.75 - $94.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
Senior Data Lakehouse Architect (Databricks), Vice President
Quincy, MA · On-site
$70.75 - $94.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
Senior Data Lakehouse Architect (Databricks), Vice President
Boston, MA · On-site
$73 - $97.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
Senior Data Lakehouse Architect (Databricks), Vice President
Boston, MA · On-site
$73 - $97.75/hr
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of ...
Databricks Lakehouse information
See salary details
$10.82 - $21.26
24% of jobs
$22.57 is the 25th percentile. Wages below this are outliers.
$21.26 - $31.71
6% of jobs
$31.71 - $42.15
7% of jobs
$42.15 - $52.60
2% of jobs
$52.60 - $63.05
3% of jobs
$63.05 - $73.49
1% of jobs
The median wage is $76.68 / hr.
$73.49 - $83.94
19% of jobs
$90.47 is the 75th percentile. Wages above this are outliers.
$83.94 - $94.38
19% of jobs
$94.38 - $104.83
9% of jobs
$104.83 - $115.28
4% of jobs
$115.28 - $125.72
4% of jobs
$10
$67
$125
How much do databricks lakehouse jobs pay per hour?
Does Databricks have unlimited PTO?
What are some common challenges Databricks Lakehouse professionals face when integrating data from multiple sources, and how can they be addressed?
What are the key skills and qualifications needed to thrive as a Databricks Lakehouse Engineer, and why are they important?
What are lakeflow jobs in Databricks?
Is Databricks a lakehouse or warehouse?
Are Databricks high in demand?
What is a Databricks Lakehouse?

Principal Observability Architect (Splunk & Databricks)
Scicom Infrastructure Services, Inc.Atlanta, GA
Other
Posted 8 days ago
Job description
Position Summary
We are seeking a highly experienced Principal Observability Architect to lead the design, implementation, modernization, and optimization of enterprise-scale observability and analytics platforms. This role will serve as the technical authority for log management, observability engineering, telemetry pipelines, AIOps, security analytics, and data lakehouse architectures leveraging Splunk, Databricks, Cribl, OpenTelemetry, and cloud-native technologies.
The ideal candidate possesses deep expertise in traditional observability platforms (Splunk, Dynatrace, AppDynamics, ServiceNow ITOM) and modern data lakehouse architectures utilizing Databricks, Delta Lake, Unity Catalog, and AI/ML-driven analytics. This individual will drive the strategic transformation from legacy SIEM and observability platforms toward scalable, cloud-native observability data lakes.
Key Responsibilities
Enterprise Architecture & Strategy
- Define enterprise observability architecture standards, patterns, and roadmaps.
- Lead observability transformation initiatives involving Splunk modernization and Databricks adoption.
- Develop reference architectures for telemetry ingestion, storage, analytics, security, and AI-driven operations.
- Align observability strategies with business, security, compliance, and operational objectives.
- Create executive-level architecture presentations, business cases, and technology roadmaps.
Splunk Platform Leadership
- Architect large-scale Splunk Enterprise and Splunk Cloud environments.
- Design and optimize:
- Indexer clusters
- Search head clusters
- Forwarder architectures
- Deployment servers
- Data models
- ITSI implementations
- Define ingestion, retention, indexing, and data lifecycle strategies.
- Lead migration initiatives involving:
- Splunk to Databricks
- Heavy Forwarders to Cribl
- SIEM modernization programs
- Optimize SPL searches, data models, summary indexing, and dashboard performance.
Databricks & Lakehouse Architecture
- Architect enterprise observability data lake solutions using:
- Databricks Lakehouse
- Delta Lake
- Unity Catalog
- Delta Live Tables
- Structured Streaming
- Mosaic AI
- Genie
- Design Medallion Architectures:
- Bronze
- Silver
- Gold
- Develop governance strategies including:
- RBAC
- Data masking
- Data lineage
- Audit controls
- Create high-performance log analytics solutions capable of supporting petabyte-scale telemetry environments.
- Enable self-service analytics and AI-powered observability use cases.
Telemetry & Data Engineering
- Design ingestion architectures supporting:
- OpenTelemetry
- OCSF
- Syslog
- Kafka
- Azure Event Hubs
- AWS Kinesis
- GCP Pub/Sub
- Cribl
- Define normalization and enrichment frameworks.
- Establish data quality and schema management processes.
- Design real-time and batch processing pipelines.
AIOps & Advanced Analytics
- Lead implementation of:
- AIOps
- Predictive analytics
- Root cause analysis
- Anomaly detection
- Event correlation
- Integrate observability datasets with AI/ML platforms.
- Develop observability use cases leveraging:
- Mosaic AI
- Agentic AI
- LLMs
- Generative AI
- Build operational intelligence and executive KPI dashboards.
Security & Compliance
- Architect observability solutions supporting:
- SOC operations
- Threat hunting
- Security analytics
- Compliance reporting
- Design frameworks aligned with:
- HIPAA
- PCI-DSS
- SOX
- NIST
- ISO 27001
- Implement data governance and security controls across observability platforms.
Leadership & Governance
- Provide technical leadership to engineering teams.
- Mentor architects, engineers, and developers.
- Conduct architecture reviews and design governance.
- Define platform standards, best practices, and operational procedures.
- Engage directly with executive stakeholders and business leaders.
Required Qualifications
Experience
- 10+ years of experience in Enterprise Observability, Monitoring, or Security Analytics.
- 5+ years architecting large-scale Splunk environments.
- 3+ years designing Databricks Lakehouse architectures.
- Experience managing environments exceeding:
- 50 TB/day preferred
- 100+ TB/day strongly preferred
- Experience leading enterprise transformation programs.
Splunk Expertise
Deep expertise in:
- Splunk Enterprise
- Splunk Cloud
- Splunk ITSI
- Enterprise Security
- SPL Development
- Data Models
- Indexer Clustering
- Search Head Clustering
- SmartStore
- Heavy Forwarders
- Universal Forwarders
Databricks Expertise
Strong experience with:
- Databricks Lakehouse
- Delta Lake
- Unity Catalog
- Delta Live Tables
- Structured Streaming
- Databricks SQL
- Genie
- Mosaic AI
- Lakehouse Federation
Cloud Platforms
Experience with one or more:
- Microsoft Azure
- Amazon Web Services
- Google Cloud
Data Technologies
Strong knowledge of:
- Kafka
- OpenTelemetry
- OCSF
- Iceberg
- Spark
- SQL
- Python
- REST APIs
- Event Streaming Architectures
Preferred Qualifications
- Experience with Cribl Stream and Cribl Edge
- Experience with Dynatrace, AppDynamics, Datadog, or New Relic
- Experience with ServiceNow ITOM/Event Management
- Experience designing AI/ML operational analytics solutions
- Experience with Security Data Lakes and SIEM modernization initiatives
- Experience with FinOps and cloud cost optimization
- Experience building observability platforms for healthcare, financial services, retail, or large enterprise organizations
Certifications (Preferred)
Splunk
- Splunk Enterprise Certified Architect
- Splunk Core Certified Consultant
Databricks
- Databricks Certified Data Engineer Professional
- Databricks Certified Solutions Architect
Cloud
- Azure Solutions Architect Expert
- AWS Solutions Architect Professional
- Google Professional Cloud Architect
Success Metrics
Within the first 12 months, the architect will:
- Deliver enterprise observability architecture roadmap.
- Reduce observability platform costs through modernization initiatives.
- Design and implement a scalable observability data lake architecture.
- Improve telemetry ingestion performance and reliability.
- Enable AI-powered analytics and operational intelligence capabilities.
- Establish enterprise governance standards for observability and security telemetry.
- Support petabyte-scale observability and security analytics workloads.
Ideal Background
Candidates from organizations utilizing large-scale observability environments such as healthcare, banking, retail, telecommunications, logistics, cloud providers, or managed services organizations are highly desirable. Experience supporting environments generating 100TB+ of telemetry per day and integrating Splunk, Databricks, Cribl, OpenTelemetry, and cloud-native data platforms is strongly preferred.
About Scicom Infrastructure Services
Sourced by ZipRecruiter
Industry
It services
Company size
11 - 50 Employees
Headquarters location
Atlanta, GA, US
Year founded
1999