Python Kubernetes Software Engineer Data Jobs in Meridian, ID

This role applies intermediate to advanced data engineering principles, theories, and concepts to solve a range of data and platform challenges of varying complexity. The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and professional knowledge acquired through specialized training, education, and experience. The role exercises professional judgment—from limited to independent decision-making—within defined standards and practices to determine and execute appropriate technical actions.

The position develops practical expertise across data engineering domains including SQL-based transformation and modeling, cloud-native data platforms, and large-scale data processing using PySpark. The engineer acts as a collaborative and informed team member by providing technical analysis and recommendations in support of team and business outcomes, evaluating data engineering challenges and contributing to solution development through well-reasoned technical guidance.

Why This Role is Exciting
 

• Work with Leading Tools: Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based services.

• Expand Your Expertise: Grow skills in distributed data processing, data modeling, automation, and CI/CD within a modern lakehouse architecture.

• Join an Innovative Team: Be part of a data engineering team with a strong history of delivering robust, reliable, and scalable data solutions that support enterprise analytics and decision-making.

• Participates as a member of a data engineering team responsible for cloud data platforms and pipelines
• Mentors and guides other engineers
• Conducts thorough analysis of technical and data requirements ranging from moderate to advanced complexity to support solution design and implementation
• Designs, builds, and maintains data pipelines and transformations using SQL, Python, and PySpark
• Designs, prepares and executes manual and/or automated test plans and scripts
• Leverages advanced data engineering expertise to perform routine and complex maintenance, optimization, and production support, ensuring reliability, scalability, and performance
• Collaborates effectively with business, analytics, and technical teams, leveraging strong interpersonal skills to drive alignment and trust in data solutions
• Demonstrates technical leadership and exerts influence beyond immediate team
• Design, implement, and manage CI/CD pipelines for automated software delivery
• Build and maintain infrastructure as code (IaC) solutions using tools like Terraform
• Support the release process by working closely with engineering teams to improve deployment speed and reliability
• Maintain documentation on new and existing implementations and practices
• Present and train the data engineering organization on innovations, best practices, and implementations

Bachelor’s degree (B.A. or B.S.) from 4 year college or university in Computer Science, Information Technology, Engineering, or related field.

• 5+ years data engineering experience and/or training
• Advanced understanding of data engineering concepts with the ability to address complex data and platform challenges
• Strong proficiency in SQL for data transformation, optimization, and modeling
• Proficient in one or more programming languages such as Python or .NET
• Proficient in data application development using frameworks like Shiny, Streamlit, Gradle, and FastAPI
• Experience with Azure DevOps, Databricks, SQL, and Data Modeling
• Experience with infrastructure as code (IaC) tools (Terraform, Ansible, CloudFormation)
• Advanced understanding of version control systems (Git, SVN)
• Strong verbal and written communication skills, contributing to team design activities and documentation
• Can apply critical thinking skills to solving problems and a strong technical aptitude
• Experience delivering data solutions through agile software development methodologies

• Hands-on experience with PySpark and Databricks for building and operating scalable data solutions
• Proficiency in Python for data engineering workflows and automation
• Experience working in Azure-based data platforms such as Databricks, Azure Data Lake, and Azure DevOps
• Experience delivering data solutions using Agile software development methodologies
• Experience supporting or enabling analytics, BI, or data science workloads

This role reports to office at Simplot Headquarters in Boise, ID full-time.