Data Engineer
Orlando, FL · On-site
$106K - $128K/yr
... DataOps best practices including testing strategies, performance tuning, and data platform ... toward senior-level engineering • Open to feedback and committed to continuous improvement ...
Data Engineer
Orlando, FL · On-site
$106K - $128K/yr
... DataOps best practices including testing strategies, performance tuning, and data platform ... toward senior-level engineering • Open to feedback and committed to continuous improvement ...
The Sr Manager of Data Engineering leads the delivery and operational excellence of enterprise data ... DataOps approaches. Experience partnering with analytics, governance, security, and business ...
The Sr Manager of Data Engineering leads the delivery and operational excellence of enterprise data ... DataOps approaches. Experience partnering with analytics, governance, security, and business ...
Data Quality Engineer
Jacksonville, FL · Remote
$106K - $127K/yr
As a senior member of the data engineering team, you will be responsible for developing scalable ... Familiarity with DevOps and DataOps practices for enterprise data platforms. * Experience ...
Data Quality Engineer
Jacksonville, FL · Remote
$106K - $127K/yr
As a senior member of the data engineering team, you will be responsible for developing scalable ... Familiarity with DevOps and DataOps practices for enterprise data platforms. * Experience ...
Senior Manager, Data Engineering
Tallahassee, FL · On-site +1
$140K - $155K/yr
... engineers and BI developers -Establishdelivery standards, performance expectations, and career ... DataOps and platform governance practices to improve reliability, observability, and delivery ...
Senior Manager, Data Engineering
Tallahassee, FL · On-site +1
$140K - $155K/yr
... engineers and BI developers -Establishdelivery standards, performance expectations, and career ... DataOps and platform governance practices to improve reliability, observability, and delivery ...
About Matia Matia (matia.io) is at the forefront of the DataOps revolution , building a unified ... Identify, target, and engage potential customers in the data and engineering space, through cold ...
About Matia Matia (matia.io) is at the forefront of the DataOps revolution , building a unified ... Identify, target, and engage potential customers in the data and engineering space, through cold ...
... senior e/o lead * Esperienza sia nel design che nella delivery di soluzioni realizzative per ... Solida competenza end-to-end su processi DevSecOps, DataOps, MLOps e AIOps per la realizzazione di ...
... senior e/o lead * Esperienza sia nel design che nella delivery di soluzioni realizzative per ... Solida competenza end-to-end su processi DevSecOps, DataOps, MLOps e AIOps per la realizzazione di ...
Senior Dataops Engineer information
What are some common challenges a Senior DataOps Engineer faces when scaling data infrastructure for a growing organization?
A Senior DataOps Engineer often encounters challenges such as ensuring data pipeline reliability during rapid scaling, managing increasing data volume and complexity, and maintaining high data quality across distributed environments. Balancing automation with flexibility, integrating new tools with legacy systems, and coordinating with cross-functional teams (like data scientists and DevOps) are also key hurdles. Success in this role requires proactively identifying bottlenecks, optimizing workflows, and fostering a culture of collaboration to support evolving business needs.
What are the key skills and qualifications needed to thrive as a Senior DataOps Engineer, and why are they important?
To thrive as a Senior DataOps Engineer, you need a solid background in data engineering, automation, CI/CD pipelines, and strong knowledge of data architecture, usually supported by a degree in computer science or a related field. Expertise in tools like Apache Airflow, Kubernetes, Docker, cloud platforms (AWS, Azure, or GCP), and proficiency with scripting languages such as Python or Bash are typically required, along with certifications like AWS Certified Solutions Architect or Google Cloud Data Engineer. Outstanding problem-solving skills, collaboration, and effective communication are essential soft skills for integrating diverse teams and managing complex workflows. These capabilities ensure data reliability, streamlined operations, and scalable solutions in dynamic data-driven environments.
What is the difference between Senior Dataops Engineer vs Data Engineer?
| Aspect | Senior Dataops Engineer | Data Engineer |
|---|---|---|
| Credentials | Typically requires experience with cloud platforms, scripting, and data pipeline tools | Requires knowledge of database systems, SQL, and data modeling |
| Work Environment | Focuses on deployment, automation, and maintaining data infrastructure | Designs and builds data pipelines and storage solutions |
| Industry Usage | Common in organizations emphasizing data operations and automation | Widespread across industries for data storage and processing |
The main difference is that Senior Dataops Engineers focus on managing and automating data workflows and infrastructure, while Data Engineers primarily design and build data pipelines and storage systems. Both roles require strong technical skills, but their focus areas differ within the data ecosystem.
What are Senior DataOps Engineers?
Senior DataOps Engineers are experienced professionals who design, implement, and manage data pipelines and workflows to ensure reliable, efficient, and scalable data operations within an organization. They bridge the gap between data engineering, DevOps, and analytics by automating data integration, deployment, and monitoring processes. Their role often includes optimizing data infrastructure, ensuring data quality, and enabling data teams to quickly deliver insights. Senior DataOps Engineers also mentor junior team members and help define best practices for data operations.
What are the most commonly searched types of Dataops Engineer jobs in Florida? The most popular types of Dataops Engineer jobs in Florida are:
What are popular job titles related to Senior Dataops Engineer jobs in Florida? For Senior Dataops Engineer jobs in Florida, the most frequently searched job titles are:
What job categories do people searching Senior Dataops Engineer jobs in Florida look for? The top searched job categories for Senior Dataops Engineer jobs in Florida are:
What cities in Florida are hiring for Senior Dataops Engineer jobs? Cities in Florida with the most Senior Dataops Engineer job openings:
Job description
Job Summary:
VaxCare is a vaccine dispensing platform that leverages proprietary technology to improve immunization rates. The Data Engineer will contribute to the design, development, and management of data processing and analytics infrastructure, ensuring efficient data pipelines and collaboration with data scientists and engineers.
Responsibilities:
• Develop and maintain Delta Lake-based data pipelines using Databricks Workflows, Delta Live Tables (DLT), and Unity Catalog for enterprise data governance
• Build ELT/ETL pipelines using medallion architecture (bronze/silver/gold layers) supporting both batch and streaming workloads with Auto Loader and Structured Streaming
• Implement lakehouse solutions leveraging Delta Lake ACID transactions, Z-ordering, liquid clustering, and partitioning strategies
• Support CI/CD pipelines for data workflows using Git integration and Databricks Asset Bundles
• Contribute to data quality frameworks using Delta Live Tables expectations and custom PySpark validation with automated alerting and SLA monitoring
• Create materialized views and incremental refresh strategies for optimized query performance
• Collaborate with data scientists, ML engineers and analysts to support feature engineering pipelines and MLOps workflows
• Participate in code reviews and contribute to technical design discussions
• Implement data observability, monitoring using Databricks SQL, Lakeview dashboards, and alerting frameworks
• Support cost optimization efforts leveraging Photon engine, serverless compute, and platform best practices
• Troubleshoot and resolve issues related to distributed computing, data skew, and performance bottlenecks
• Contribute to technical documentation including data contracts, runbooks, and data catalog metadata in Unity Catalog
• Follow DataOps best practices including testing strategies, performance tuning, and data platform engineering principles
• Stay current with lakehouse architecture trends and emerging technologies to continuously improve our data infrastructure
Qualifications:
Required:
• Bachelor's degree in Computer Science, Data Engineering, Engineering, or related technical field OR equivalent practical experience
• 3-5 years of data engineering experience with 1+ years hands-on production experience building data pipelines on Databricks and Apache Spark
• Strong proficiency in Python (PySpark, pandas) and SQL (complex queries, window functions, CTEs, query optimization)
• Experience with Spark SQL, Delta Lake SQL, and Databricks SQL
• Working knowledge of Apache Spark including performance fundamentals (partitioning, broadcast joins, data skew handling, caching strategies)
• Delta Lake features (ACID transactions, time travel, MERGE operations, CDC, liquid clustering)
• Hands-on experience with Databricks including Delta Live Tables (DLT) for declarative pipeline development
• Unity Catalog for data governance, access control, and lineage tracking
• Databricks Workflows and orchestration
• Basic understanding of cluster configuration and cost-aware compute selection
• Solid understanding of data modeling techniques including dimensional modeling (star schema, fact/dimension tables)
• Medallion architecture (bronze/silver/gold layers)
• Slowly Changing Dimensions (SCD) implementations
• Strong SQL skills including query optimization and performance tuning
• Familiarity with modern lakehouse patterns and understanding of lakehouse vs. traditional data warehouse trade-offs
• Familiarity with DevOps/DataOps practices including Git workflows (branching strategies, pull requests, code reviews)
• CI/CD pipelines for data workflows (GitHub Actions, Azure DevOps, Jenkins)
• Testing strategies (unit tests, integration tests, data quality tests)
• Basic monitoring and observability (logging, alerting)
• Works independently to deliver high-quality, well-tested solutions with meaningful impact on the team's data infrastructure
• Takes ownership of assigned projects and drives them to completion with minimal oversight
• Strong communication and collaboration skills in cross-functional team environments
• Proactive in identifying problems and proposing solutions, even outside immediate area of responsibility
• Demonstrates initiative in expanding technical depth and breadth, with a trajectory toward senior-level engineering
• Open to feedback and committed to continuous improvement
Preferred:
• Master's degree or relevant industry certifications (Databricks Certified Data Engineer Associate, Azure Data certifications) are a plus
• Experience contributing to lakehouse architecture implementations
Company:
VaxCare provides a care delivery platform that manages vaccine and contraceptive workflows for medical practices. Founded in 2006, the company is headquartered in Orlando, USA, with a team of 201-500 employees. The company is currently Growth Stage.
VaxCare is a vaccine dispensing platform that leverages proprietary technology to improve immunization rates. The Data Engineer will contribute to the design, development, and management of data processing and analytics infrastructure, ensuring efficient data pipelines and collaboration with data scientists and engineers.
Responsibilities:
• Develop and maintain Delta Lake-based data pipelines using Databricks Workflows, Delta Live Tables (DLT), and Unity Catalog for enterprise data governance
• Build ELT/ETL pipelines using medallion architecture (bronze/silver/gold layers) supporting both batch and streaming workloads with Auto Loader and Structured Streaming
• Implement lakehouse solutions leveraging Delta Lake ACID transactions, Z-ordering, liquid clustering, and partitioning strategies
• Support CI/CD pipelines for data workflows using Git integration and Databricks Asset Bundles
• Contribute to data quality frameworks using Delta Live Tables expectations and custom PySpark validation with automated alerting and SLA monitoring
• Create materialized views and incremental refresh strategies for optimized query performance
• Collaborate with data scientists, ML engineers and analysts to support feature engineering pipelines and MLOps workflows
• Participate in code reviews and contribute to technical design discussions
• Implement data observability, monitoring using Databricks SQL, Lakeview dashboards, and alerting frameworks
• Support cost optimization efforts leveraging Photon engine, serverless compute, and platform best practices
• Troubleshoot and resolve issues related to distributed computing, data skew, and performance bottlenecks
• Contribute to technical documentation including data contracts, runbooks, and data catalog metadata in Unity Catalog
• Follow DataOps best practices including testing strategies, performance tuning, and data platform engineering principles
• Stay current with lakehouse architecture trends and emerging technologies to continuously improve our data infrastructure
Qualifications:
Required:
• Bachelor's degree in Computer Science, Data Engineering, Engineering, or related technical field OR equivalent practical experience
• 3-5 years of data engineering experience with 1+ years hands-on production experience building data pipelines on Databricks and Apache Spark
• Strong proficiency in Python (PySpark, pandas) and SQL (complex queries, window functions, CTEs, query optimization)
• Experience with Spark SQL, Delta Lake SQL, and Databricks SQL
• Working knowledge of Apache Spark including performance fundamentals (partitioning, broadcast joins, data skew handling, caching strategies)
• Delta Lake features (ACID transactions, time travel, MERGE operations, CDC, liquid clustering)
• Hands-on experience with Databricks including Delta Live Tables (DLT) for declarative pipeline development
• Unity Catalog for data governance, access control, and lineage tracking
• Databricks Workflows and orchestration
• Basic understanding of cluster configuration and cost-aware compute selection
• Solid understanding of data modeling techniques including dimensional modeling (star schema, fact/dimension tables)
• Medallion architecture (bronze/silver/gold layers)
• Slowly Changing Dimensions (SCD) implementations
• Strong SQL skills including query optimization and performance tuning
• Familiarity with modern lakehouse patterns and understanding of lakehouse vs. traditional data warehouse trade-offs
• Familiarity with DevOps/DataOps practices including Git workflows (branching strategies, pull requests, code reviews)
• CI/CD pipelines for data workflows (GitHub Actions, Azure DevOps, Jenkins)
• Testing strategies (unit tests, integration tests, data quality tests)
• Basic monitoring and observability (logging, alerting)
• Works independently to deliver high-quality, well-tested solutions with meaningful impact on the team's data infrastructure
• Takes ownership of assigned projects and drives them to completion with minimal oversight
• Strong communication and collaboration skills in cross-functional team environments
• Proactive in identifying problems and proposing solutions, even outside immediate area of responsibility
• Demonstrates initiative in expanding technical depth and breadth, with a trajectory toward senior-level engineering
• Open to feedback and committed to continuous improvement
Preferred:
• Master's degree or relevant industry certifications (Databricks Certified Data Engineer Associate, Azure Data certifications) are a plus
• Experience contributing to lakehouse architecture implementations
Company:
VaxCare provides a care delivery platform that manages vaccine and contraceptive workflows for medical practices. Founded in 2006, the company is headquartered in Orlando, USA, with a team of 201-500 employees. The company is currently Growth Stage.
About VaxCare
Sourced by ZipRecruiter