42 Purple Drive Jobs Hiring in Costa Mesa, CA

Overview:
Job Title: Data Engineer
Location: Irvine, CA
Job Type: Full-Time Opportunity
Job Summary
We are seeking a highly skilled Data Engineer with strong platform engineering and data pipeline expertise to support enterprise-scale delivery initiatives. The ideal candidate should have deep hands-on experience with Databricks, Airflow/Astronomer, DevOps automation, and scalable data engineering solutions.
This role requires senior-level engineers capable of owning technical delivery, driving platform reliability, and collaborating with highly technical engineering teams.
Required Skills

• Strong hands-on expertise in:
  • Databricks
  • Apache Spark
  • Airflow / Astronomer
  • Data Engineering and pipeline orchestration
• Experience with:
  • Spark performance tuning
  • Databricks platform administration
  • DAG design and enterprise orchestration
  • Data quality and scalable pipeline architecture
• Strong DevOps knowledge including:
  • CI/CD pipelines
  • Infrastructure as Code (IaC)
  • Automation frameworks
• Experience managing:
  • Platform stability
  • Monitoring and observability
  • Operational readiness and support

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and workflows
• Build and maintain enterprise orchestration solutions using Airflow/Astronomer
• Perform Spark optimization and Databricks platform tuning
• Support platform engineering initiatives focused on scalability, reliability, and automation
• Implement CI/CD and infrastructure automation for data platforms
• Monitor platform health and ensure operational stability
• Collaborate with cross-functional engineering teams to deliver technical solutions
• Own technical delivery for assigned scope, timelines, and outcomes

Preferred Qualifications

• Experience in cloud-based data engineering environments
• Strong troubleshooting and performance optimization skills
• Experience working in highly technical Agile engineering teams