Databricks Engineer Jobs in Arizona (NOW HIRING)

Are you looking for a unique opportunity to be a part of something great? Want to join a 17,000-member team that works on the technology that powers the world around us? Looking for an atmosphere of trust, empowerment, respect, diversity, and communication? How about an opportunity to own a piece of a multi-billion dollar (with a B!) global organization? We offer all that and more at Microchip Technology Inc.

People come to work at Microchip because we help design the technology that runs the world. They stay because our culture supports their growth and stability. They are challenged and driven by an incredible array of products and solutions with unlimited career potential. Microchip’s nationally-recognized Leadership Passage Programs support career growth where we proudly enroll over a thousand people annually. We take pride in our commitment to employee development, values-based decision making, and strong sense of community, driven by our Vision, Mission, and 11 Guiding Values; we affectionately refer to it as the Aggregate System and it’s won us countless awards for diversity and workplace excellence.

Our company is built by dedicated team players who love to challenge the status quo; we did not achieve record revenue and over 30 years of quarterly profitability without a great team dedicated to empowering innovation. People like you.

Visit our careers page to see what exciting opportunities and company perks await!

We are seeking a Software Engineer with hands-on experience building and operating AI and data pipelines in a modern lakehouse environment. This role combines applied machine learning, data engineering, and analytics engineering, with strong emphasis on dbt Core, SQL, Databricks, and AWS.

You will own AI workflows end-to-end — from governed feature modeling through training, deployment, monitoring, and performance optimization — in a production environment.

This is a delivery-oriented role. You are expected to design solutions, write production-quality code, and improve platform reliability.

• Design and implement machine learning training and batch inference pipelines on Databricks using Spark and MLflow.
• Develop and deploy ML models (classification, regression, forecasting, or NLP-based workloads).
• Implement LLM-enabled solutions, including embedding pipelines, semantic search systems, and retrieval-augmented generation (RAG) workflows.
• Proven experience designing feature engineering pipelines that ensure consistency between offline training datasets and production inference workflows.
• Manage model lifecycle, including versioning, experiment tracking, evaluation, and deployment.
• Implement monitoring for model drift, data drift, and prediction stability.
• Diagnose and resolve production failures across training and inference pipelines.

• Architect and maintain dbt Core projects that serve as the transformation and contract layer for AI workloads.
• Design incremental models, snapshots, and historical datasets to support reproducible training.
• Enforce data contracts and schema stability for downstream ML pipelines.
• Implement automated testing, freshness validation, and CI pipelines for dbt projects.
• Collaborate with data engineers to ensure AI systems consume governed, high-quality datasets.

• Design and optimize bronze, silver, and gold pipelines using Delta Lake.
• Develop scalable Spark workloads for large datasets.
• Manage governance, access control, and lineage using Unity Catalog.
• Optimize compute performance and cost efficiency for AI workloads.
• Contribute to architectural decisions across data and AI infrastructure.

• Build and operate AI workflows in an AWS-based lakehouse environment.
• Work with Amazon S3, IAM roles and policies, and related AWS services supporting data pipelines.
• Design secure and scalable data access patterns across environments.
• Support deployment of models using containerized or managed services when required.
• Monitor and optimize cloud resource utilization.

• Implement CI/CD pipelines for dbt projects, ML code, and infrastructure.
• Write maintainable Python and SQL with appropriate documentation and testing.
• Conduct code reviews and provide guidance to junior engineers.
• Ensure production systems meet reliability, auditability, and governance standards.
• Partner with analytics and business stakeholders to translate requirements into scalable AI solutions.

• 0-3 years of total professional experience.
• Professional experience in AI, ML, data engineering, or analytics engineering roles.
• Strong hands-on experience with dbt Core in production environments.
• Advanced SQL skills with performance tuning experience.
• Proven experience with Databricks (Spark, Delta Lake, MLflow).
• Experience building AI/ML pipelines on AWS.
• Proficiency in Python for ML and data processing workflows.
• Experience managing AI workloads end-to-end, including deployment and monitoring.

• Experience working with centralized, versioned feature datasets.
• Exposure to vector databases or LLM-based systems.
• Experience implementing model monitoring and drift detection frameworks.
• Experience supporting near-real-time AI systems.

0% - 25%

Hearing, Seeing, Talking, Works Alone, Works Around Others

80% sitting, 10% standing, 10% walking, 100% inside.

Microchip Technology Inc is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

For more information on applicable equal employment regulations, please refer to the Know Your Rights: Workplace Discrimination is Illegal Poster.

To all recruitment agencies: Microchip Technology Inc. does not accept unsolicited agency resumes. Please do not forward resumes to our recruiting team or other Microchip employees. Microchip is not responsible for any fees related to unsolicited resumes.