Databricks Software Jobs in Arizona (NOW HIRING)

About this role:

Wells Fargo is seeking a Lead Software Engineer to drive innovation and technical excellence within the CTR space.This role will lead the design and optimization of scalable data platforms using technologies such as Apache Spark. The engineer will ensure robust observability and performance monitoring. They will also oversee workflow orchestration and DevOps practices, enabling efficient collaboration and delivery across teams. Strong partnership with business stakeholders is essential to deliver timely, impactful solutions to complex operational challenges.

In this role, you will:

• Lead complex technology initiatives including those that are companywide with broad impact
• Act as a key participant in developing standards and companywide best practices for engineering complex and large-scale technology solutions for technology engineering disciplines
• Design, develop, and maintain ETL/ELT pipelines. Automate workflows for ingestion, transformation, and loading of data
• Integrate data from multiple sources into data lakes or warehouses. Ensure optimal storage strategies balancing cost and performance
• Cleanse, normalize, and enrich raw data for analytics. Implement robust data quality checks and governance frameworks
• Monitor and optimize data workflows for scalability and efficiency
• Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
• Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
• Lead projects, teams, or serve as a peer mentor

Required Qualifications:

• 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 5+ years of experience building data pipelines on Google Cloud Platform (GCP) using Cloud Dataflow, Cloud Dataproc, Cloud Composer, BigQuery, Cloud Storage (GCS), Pub/Sub, or similar GCP-native frameworks
• 5+ years of experience with workflow orchestration using Cloud Composer
• 5+ years of strong development proficiency in SQL and Python for data engineering tasks
• 2+ years of experience with monitoring and observability using Cloud Monitoring, Grafana, or equivalent tools
• Solid understanding of data modeling, ETL/ELT processes, and data governance best practices
• Experience with Data Fusion, Dataplex and Dataprep would be a plus

Desired Qualifications:

• Extensive hands-on experience with BigQuery, Cloud Storage, Cloud SQL, Cloud Dataflow and Cloud Composer.
• Experience with performance monitoring and pipeline observability using GCP-native tools or third-party solutions
• Proficiency with GCP resource management and workload optimization and cost control strategies
• Familiarity with BigQuery for large-scale analytics and schema evolution
• Knowledge of data lakehouse patterns using Apache Iceberg or similar technologies
• Well-versed in PySpark, Pandas, and Polars for data processing
• Experience using Jira and Confluence for agile workflows
• Experience with interactive notebook environments (Jupyter, Zepplin, databricks or similar) for data engineering development

Posting End Date:

*Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visitDisability Inclusion at Wells Fargo.

Drug and Alcohol Policy

Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.