1

Data Engineer Gcp Data Engineer Jobs in Iowa (NOW HIRING)

Data Engineer III

Des Moines, IA · On-site

$111K - $134K/yr

Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team: * Investigates and ...

Data Engineer

Des Moines, IA · Remote

$55 - $75/hr

Description Own API integrations with internal and external investment systems. Will need Python and AWS experience. CDK, API Gateway Skills Aws, Python, Development Top Skills Details Aws,Python ...

Senior Data Engineer

Cedar Rapids, IA · Hybrid

$95K - $115K/yr

Summary The Senior Data Engineer will support creation of the Book of Record by building AWS-based data pipelines, enabling a single source of truth. The role requires strong AWS expertise, Snowflake ...

Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate & Summary The Opportunity As a Data Engineer - Senior Associate, you will focus on designing and ...

Senior Data Engineer

Des Moines, IA · Hybrid

$103K - $140K/yr

Description About the Role The Waldinger Corporation has an opportunity for a qualified Data Engineer in our Corporate office. In this hybrid role, you'll work closely with team members to build and ...

AWS Data Engineer (Financial)

Cedar Rapids, IA · On-site

$112K - $134K/yr

Experience leveraging AI tools and technologies to enhance data engineering or analytics workflows. * Practical knowledge of grounding large language models (LLMs) to structured data stores , such as ...

Data Strategy-Manager

Des Moines, IA · On-site

$99K - $232K/yr

... Data Engineer / Azure Solutions Architect - Google Professional Data Engineer - DAMA CDMP (Certified Data Management Professional) - Informatica Certified Professional - Alation Certified Data ...

Data Governance- Manager

Des Moines, IA · On-site

$99K - $232K/yr

... Data Engineer / Azure Solutions Architect - Google Professional Data Engineer - DAMA CDMP (Certified Data Management Professional) - Informatica Certified Professional - Alation Certified Data ...

Showing results 41-60

Data Engineer Gcp Data Engineer information

What is the difference between Data Engineer Gcp Data Engineer vs Data Engineer?

AspectData Engineer Gcp Data EngineerData Engineer
CertificationsGCP certifications (e.g., Professional Data Engineer)Varies; often includes cloud or database certifications
Work EnvironmentPrimarily cloud-based, focusing on Google Cloud Platform toolsCan be cloud, on-premises, or hybrid environments
Industry UsageCommon in organizations leveraging Google Cloud servicesWidespread across industries using various cloud providers
Skills FocusGCP tools, BigQuery, Dataflow, Pub/SubSQL, ETL, data modeling, general cloud skills

In summary, Data Engineer Gcp Data Engineer specializes in Google Cloud Platform tools and certifications, focusing on cloud-native data solutions. Data Engineer is a broader role that may work across multiple platforms and environments, with a wider range of tools and technologies.

What are some common challenges faced by data engineers working with GCP, and how can they be addressed?

Data Engineers working with Google Cloud Platform (GCP) often encounter challenges such as optimizing data pipeline performance, managing costs, and ensuring data security and compliance. Effective use of GCP's native monitoring and logging tools can help identify bottlenecks in ETL processes, while leveraging features like autoscaling in Dataflow or BigQuery partitioning improves efficiency. Regular collaboration with DevOps and security teams is crucial to maintain robust cloud architecture and compliance with data regulations. Staying updated with GCP releases and best practices will also help proactively address evolving challenges.

What are the key skills and qualifications needed to thrive as a GCP data engineer?

To thrive as a GCP Data Engineer, you need strong expertise in data modeling, ETL processes, and cloud architecture, typically backed by a degree in computer science or related field. Proficiency with Google Cloud Platform services (like BigQuery, Dataflow, and Pub/Sub), SQL, and tools such as Python or Java is essential, and certifications like Google Professional Data Engineer are highly valued. Strong problem-solving, communication, and teamwork skills help you collaborate effectively and translate business needs into technical solutions. These abilities ensure efficient, scalable data pipelines and reliable infrastructure, which are critical for driving data-driven decision-making.

What is a GCP data engineer?

A GCP Data Engineer is a data engineering professional who specializes in designing, building, and managing data processing systems on Google Cloud Platform (GCP). They work with cloud-based tools and services to collect, transform, and analyze large volumes of data, enabling organizations to gain insights and make data-driven decisions. GCP Data Engineers are proficient in technologies such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Their role often involves ensuring data pipelines are reliable, scalable, and secure while optimizing performance and cost.
What are popular job titles related to Data Engineer Gcp Data Engineer jobs in Iowa? For Data Engineer Gcp Data Engineer jobs in Iowa, the most frequently searched job titles are:
What job categories do people searching Data Engineer Gcp Data Engineer jobs in Iowa look for? The top searched job categories for Data Engineer Gcp Data Engineer jobs in Iowa are:
What cities in Iowa are hiring for Data Engineer Gcp Data Engineer jobs? Cities in Iowa with the most Data Engineer Gcp Data Engineer job openings:

$111K - $134K/yr

Full-time

Re-posted 27 days ago


EMC Insurance rating

9.5

Company rating: 9.5 out of 10

Based on 5 frontline employees who took The Breakroom Quiz

7th of 301 rated insurance


Job description

At EMC, we're all about working together to make an impact. As part of our team, you'll have the opportunity to grow, contribute, and gain experience that matters. We strive to be caring leaders, close partners, and responsive experts-always supporting each other to do our best work. Join us, and let's improve lives together.
Essential Functions:
Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team:
  • Investigates and analyzes feasibility of data integration prototypes and program requirements
  • Develops specifications and plans the full range of programming actions to produce data integration components
  • Develops and maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach
  • Develops and maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services
  • Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data
  • Builds complex unit tests to enable test driven development and automation to drive code reliability
  • Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries
  • Maintains data solutions in a divest state to ensure business functionality until replaced with new technology
  • Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements
  • Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems

Data analysis: Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions:
  • Leads moderately complex projects or supports larger initiatives as part of a team
  • Partners with users and stakeholders to understand data needs and business requirements
  • Leads the team on conceptualizing and developing new data solutions to meet the business data needs and requirements
  • Researches, performs analysis, and proposes effective solutions related to system developments and enhancements through collaboration with Data Architecture
  • Analyzes and reviews potential adjustments or modifications for impacts on other programs
  • Leverages data governance, data security, and privacy principles to support data lineage and reference data needs
  • Collaborates with cross-functional teams to understand business and downstream application (BI reporting, Data Science, Data Governance, other System integrations) and consumer requirements to deliver data-driven solutions that implement best practices for data management, security, and governance

Data modeling:
  • Develops complex data objects for business analytics using data modeling techniques
  • Models front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis
  • Works with stakeholders to understand complex business needs and translates them into a conceptual data model, defining entities, attributes, and relationships
  • Builds complex detailed logical models based on the conceptual model, specifying data types, constraints, and keys to ensure data integrity
  • Implements complex logical models into appropriate database management systems, considering database features, storage optimization, and performance considerations
  • Designs complex data pipelines to extract data from source systems, transform it as needed based on the data model, and load it into the target database

Documentation:
  • Participates in creating and maintaining documentation related to the design of applications and interfaces to enterprise and third-party systems in accordance with departmental and team standards
  • Collaborates with data governance on ensuring what is being produced in data analytics products enables data governance to publish a data asset
  • Collaborates with data governance to develop and maintain data analytic products, artifacts and user documentation for business customers
  • Works with business customers and software development teams to gather and document requirements for data publishing and data consumption via data mesh architecture
  • Maintains systems documentation

Education & Experience:
  • Bachelor's degree, preferably in a computer related field or equivalent relevant experience
  • Five years of data integration development experience, or related experience

Knowledge, Skills & Abilities:
  • Strong SQL knowledge and experience working with relational databases
  • Excellent analytical skills to work with unstructured datasets
  • Excellent knowledge of applicable programming languages, such as Python
  • Strong knowledge of cloud services such as RDS, S3, SNS, CloudWatch and Lambda
  • Strong knowledge of DBT/Informatica or other ETL/ELT tools preferred
  • Strong knowledge of Snowflake
  • Strong knowledge of data modeling
  • Excellent ability to build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Strong ability to manipulate, process and extract value from large, disconnected datasets
  • Strong knowledge of DevOps and/or DataOps practices, CI/CD pipelines, and containerization technologies preferred
  • Excellent knowledge of orchestration or scheduling tools
  • Excellent verbal and written communication skills
  • Strong attention to detail, organizational and multi-tasking skills with the ability to adapt to changing priorities
  • Ability to maintain confidentiality

The hiring salary range for this position will vary based on geographic location, falling within either of the following:
$92,670 - $128,045 or $102,443 - $140,845
A hiring range represents a subset of the full salary range. The actual salary will depend on several factors, including relevant education, skills, and experience of an applicant, geographic location, and business needs.
For information relating to the benefits EMC Team Members receive as part of a comprehensive rewards package, please visit www.emcins.com/careers
Our employment practices are in accordance with the laws that prohibit discrimination due to race, color, creed, sex, sexual orientation, gender identity, genetic information, religion, age, national origin or ancestry, physical or mental disability, medical condition, veteran status, active military status, citizenship status, marital status or any other consideration made unlawful by federal, state, or local laws.
All of our locations are tobacco free including in company vehicles.

What EMC Insurance employees say

Hours and flexibility

Workplace

Get the full story on Breakroom