$125K - $130K/yr
Work directly with our customers' data engineers, system admins, DevOps teams, and management ... Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools The ...
$125K - $130K/yr
Work directly with our customers' data engineers, system admins, DevOps teams, and management ... Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools The ...
Kinaxis Specialist Master
Atlanta, GA · On-site
... 1, Administrator Level 1, and Integration Level 1 * Experience with Talend or other extract, transform, load (ETL) tools, including Google Cloud Dataflow, Azure Data Factory, or Databricks
Kinaxis Specialist Master
Atlanta, GA · On-site
... 1, Administrator Level 1, and Integration Level 1 * Experience with Talend or other extract, transform, load (ETL) tools, including Google Cloud Dataflow, Azure Data Factory, or Databricks
Data Engineer III - OIT
Atlanta, GA · Hybrid
... Administrators to deliver quality applications and components within scope, on time, and within ... Databricks * Working knowledge of design for interoperability and standards for healthcare ...
Data Engineer III - OIT
Atlanta, GA · Hybrid
... Administrators to deliver quality applications and components within scope, on time, and within ... Databricks * Working knowledge of design for interoperability and standards for healthcare ...
Databricks Admin information
What are Databricks Admins?
Databricks Admins are IT professionals responsible for managing and configuring the Databricks platform within an organization. They handle user access, workspace setup, cluster management, security policies, and integration with cloud services. Their role is crucial in ensuring that the Databricks environment runs smoothly, securely, and efficiently for data teams. Admins also monitor resource usage, troubleshoot issues, and implement best practices for data processing and analytics workflows.
What are some common challenges a Databricks Admin faces when managing large-scale data pipelines?
As a Databricks Admin, one of the primary challenges is ensuring optimal cluster performance and resource utilization, especially when handling large and complex data pipelines. Admins must monitor job execution, manage user access, and troubleshoot issues related to data connectivity, cluster failures, or slow-running jobs. Additionally, maintaining data security and compliance across collaborative teams can be demanding, as it requires fine-tuning permissions and enforcing organizational policies. Strong communication with data engineers and analysts is essential to proactively address problems and optimize workflows.
What are the key skills and qualifications needed to thrive as a Databricks Admin, and why are they important?
To thrive as a Databricks Admin, you need a solid background in data engineering, cloud computing, and distributed systems, often supported by a degree in computer science or related field. Proficiency in Databricks platform management, Spark, Azure or AWS services, and relevant certifications like Databricks Certified Associate Developer are typically required. Strong problem-solving, communication, and collaboration skills help in effectively managing resources and supporting data teams. These skills ensure optimal platform performance, secure data workflows, and support for analytics initiatives across the organization.
What is the difference between Databricks Admin vs Data Engineer?
| Aspect | Databricks Admin | Data Engineer |
|---|---|---|
| Credentials | Databricks certifications, cloud platform knowledge | Programming skills, cloud certifications, data modeling |
| Work Environment | Cloud-based Databricks platform, administrative tasks | Data pipelines, ETL processes, coding environments |
| Employer & Industry | Tech companies, data-driven organizations using Databricks | Organizations building data infrastructure, analytics teams |
| Search & Comparison Intent | Understanding administrative roles in Databricks | Data pipeline development and data architecture |
While both roles work within data platforms, a Databricks Admin primarily manages and maintains the Databricks environment, focusing on platform configuration and user access. In contrast, a Data Engineer builds and maintains data pipelines, often utilizing Databricks for data processing. Both roles require cloud platform knowledge, but their core responsibilities differ significantly.
What are popular job titles related to Databricks Admin jobs in Georgia? For Databricks Admin jobs in Georgia, the most frequently searched job titles are:
What job categories do people searching Databricks Admin jobs in Georgia look for? The top searched job categories for Databricks Admin jobs in Georgia are:
What cities in Georgia are hiring for Databricks Admin jobs? Cities in Georgia with the most Databricks Admin job openings:
$125K - $130K/yr
Full-time
Posted 20 days ago
Job description
Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io.
About this role:
As an Airflow Reliability Engineer on the Customer Reliability Engineering (CRE) team at Astronomer, you will have the opportunity to become an Apache Airflow expert, learning directly from leaders of the Airflow project. You'll provide Apache Airflow expertise directly to customers to help them make the best possible use of our managed Airflow service.
CRE is Astronomer's support team. Because our customers are sophisticated organizations who need and expect high levels of expertise to help them keep mission critical uses of Apache Airflow working consistently, we look a little different from most support teams. Nearly every ticket you will work requires an intersection of strong technical knowledge and customer empathy to understand what the customer needs and how to get them there. Every day is a new challenge and a new thing to learn.
When you learn a new piece of technology, are you aiming not just to get started but to become the expert? Do you listen to the plumber when they tell you what is wrong with the pipes? Are you the kind of person who takes an MIT OpenCourseWare course and actually finishes it? Then this role could be for you.
What you get to do:
What you bring to the role:
Bonus points if you have:
The estimated total compensation for this role ranges from $125,000 - $130,000 based on leveling and geography, along with an equity component and a comprehensive benefits package. This range is merely an estimate; actual compensation may deviate from this range based on skills, experience, and qualifications.
#LI-Fulltime
#LI-Remote
At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
About this role:
As an Airflow Reliability Engineer on the Customer Reliability Engineering (CRE) team at Astronomer, you will have the opportunity to become an Apache Airflow expert, learning directly from leaders of the Airflow project. You'll provide Apache Airflow expertise directly to customers to help them make the best possible use of our managed Airflow service.
CRE is Astronomer's support team. Because our customers are sophisticated organizations who need and expect high levels of expertise to help them keep mission critical uses of Apache Airflow working consistently, we look a little different from most support teams. Nearly every ticket you will work requires an intersection of strong technical knowledge and customer empathy to understand what the customer needs and how to get them there. Every day is a new challenge and a new thing to learn.
When you learn a new piece of technology, are you aiming not just to get started but to become the expert? Do you listen to the plumber when they tell you what is wrong with the pipes? Are you the kind of person who takes an MIT OpenCourseWare course and actually finishes it? Then this role could be for you.
What you get to do:
- Learn and build expertise across several software engineering disciplines, including:
- Airflow and data engineering
- Kubernetes
- Cloud Engineering
- Gain exposure to the big picture; learn about product, engineering, customer relationship management, and more.
- Solve challenging Airflow problems for our customers. From optimizing configuration to identifying world-first Airflow bugs, you'll see it all here.
- Spend up to 20% of your time on side projects that contribute to Astronomer's overall success, such as contributing to the open-source Airflow repository or developing Astronomer's internal monitoring and alerting systems built on Airflow.
- Work on a modern, sophisticated, cloud-native product that customers use to connect to dozens of other systems. Gain depth and breadth of learning!
- Work directly with our customers' data engineers, system admins, DevOps teams, and management.
- Provide feedback from your experience that can shape the direction of the Airflow project.
- Own the customer experience, working directly with customers to prioritize and solve issues, meet SLAs, and provide "white glove" guidance on the path to production.
- Participate remotely within a fully distributed team.
- Help maintain 24x7 coverage through a specified 6-hour pager period during your work day.
- Participate in paid on-call rotation for weekend coverage.
What you bring to the role:
- Data Engineering background
- 4 years of experience with Python
- 1 year of experience in Airflow administration and DAG creation
- Experience with Kubernetes/Docker/Containers
- Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)
- Problem-solving and troubleshooting abilities
- Ability to work well with autonomy and independence
- Strong written and verbal communication for connecting with our customers over our ticketing system and through Zoom
- Experience mentoring junior team members
Bonus points if you have:
- Contributions to open-source projects
- Customer Support experience
- Familiarity with SQL and PostgreSQL
- Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools
The estimated total compensation for this role ranges from $125,000 - $130,000 based on leveling and geography, along with an equity component and a comprehensive benefits package. This range is merely an estimate; actual compensation may deviate from this range based on skills, experience, and qualifications.
#LI-Fulltime
#LI-Remote
At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
About Astronomer
Sourced by ZipRecruiter
Industry
Software development
Company size
201 - 500 Employees
Headquarters location
Cincinnati, OH, US
Year founded
2015