2

Full Time Azure Data Factory Developer Jobs in Illinois

Azure Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

... Data Factory, Azure Databricks, etc) • Provide code review and facilitate code management for the engineering team to ensure best practices and performance standards • 4 years in SDLC agile and ...

Currently using Microsoft's Azure Data Factory for connecting to network sources as well as ... Partnering with business users, programming, technology teams, data analysts, and project ...

Data Engineer

Chicago, IL · On-site

$46.07 - $68.64/hr

Research Computing Work Type: Full Time (Total FTE between 0. 9 and 1. 0) Remote Shift: Shift 1 ... Azure Data Factory, Apache Kafka and Apache Camel. • Experience designing and implementing ...

Data Engineer

Moline, IL · On-site +1

$88K - $133K/yr

Currently using Microsoft's Azure Data Factory for connecting to network sources as well as ... Partnering with business users, programming, technology teams, data analysts, and project ...

$111K - $121K/yr

... SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, and/or Power BI; * Azure DevOps, GitHub, and CI/CD; * Database storage systems such as cloud, relational ...

Data Engineering & Pipeline Development · Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Foundry, and Microsoft Fabric. · Build and optimize data ...

Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Design and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure ...

next page

Showing results 1-20

Full Time Azure Data Factory Developer information

What does a full time Azure Data Factory developer do?

A Full Time Azure Data Factory Developer is responsible for designing, developing, and maintaining data integration solutions using Microsoft Azure Data Factory. They build and manage data pipelines to extract, transform, and load (ETL) data from various sources into cloud-based data storage or analytics platforms. Their role involves collaborating with data engineers, analysts, and other stakeholders to ensure efficient and reliable data workflows. They also optimize data processes to enhance performance, troubleshoot issues, and ensure security and compliance standards are met.

What are some common challenges full time Azure Data Factory developers face when integrating data from multiple sources?

Full Time Azure Data Factory Developers often encounter challenges such as handling varying data formats, ensuring data consistency, and managing real-time versus batch data loads when integrating information from multiple sources. Additionally, troubleshooting pipeline failures and optimizing data flows for performance can require strong problem-solving skills. Collaboration with data architects, database administrators, and business analysts is crucial to address these challenges and ensure that data integration processes align with organizational goals.

What are the key skills and qualifications needed to thrive as a full time Azure Data Factory developer, and why are they important?

To thrive as a Full Time Azure Data Factory Developer, you need expertise in data integration, ETL processes, SQL, and a strong understanding of Azure cloud services, typically supported by a degree in computer science or a related field. Experience with Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and relevant certifications like Microsoft Certified: Azure Data Engineer Associate are highly valuable. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with stakeholders and troubleshooting complex data workflows. These competencies ensure secure, efficient, and scalable data solutions that drive business intelligence and analytics initiatives.

What is the difference between Full Time Azure Data Factory Developer vs Data Engineer?

AspectFull Time Azure Data Factory DeveloperData Engineer
Primary FocusDesigning, developing, and maintaining data pipelines using Azure Data FactoryBuilding, optimizing, and managing data infrastructure and pipelines across various platforms
Required SkillsAzure Data Factory, SQL, ETL processes, cloud servicesSQL, Python, Spark, cloud platforms, data modeling
CertificationsAzure Data Engineer Associate, Azure certificationsGoogle Cloud, AWS, or Azure certifications, depending on platform
Work EnvironmentCloud-based data projects within organizations using AzureBroader data infrastructure projects across multiple platforms

While both roles involve data pipeline development, the Full Time Azure Data Factory Developer specializes in Azure Data Factory and cloud-based ETL processes, whereas the Data Engineer has a broader scope, working with various tools and platforms to build comprehensive data solutions.

What are the most commonly searched types of Azure Data Factory Developer jobs in Illinois?

The most popular types of Azure Data Factory Developer jobs in Illinois are:

What are popular job titles related to Full Time Azure Data Factory Developer jobs in Illinois?

For Full Time Azure Data Factory Developer jobs in Illinois, the most frequently searched job titles are:

What job categories do people searching Full Time Azure Data Factory Developer jobs in Illinois look for?

The top searched job categories for Full Time Azure Data Factory Developer jobs in Illinois are:

What cities in Illinois are hiring for Full Time Azure Data Factory Developer jobs?

Cities in Illinois with the most Full Time Azure Data Factory Developer job openings:

Azure Data Engineer with Databrick Exp

Syntricate Technologies

Chicago, IL • On-site

$56.75 - $70.25/hr

Full-time

Re-posted 11 days ago


Job description

Job Summary:
Syntricate Technologies is seeking an Azure Data Engineer with expertise in Databricks. The role involves creating Azure Databricks services, managing data storage, and developing data pipelines using Azure Data Factory.
Responsibilities:
• Creating Azure Databricks services
• Reading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services after receiving in different formats (e.g. csv, Parquet, Jason etc.) from Snowflake DWH platform
• Hands-on experience in working with Databricks File system (DBFS)
• Experience in working with RDD, Dataframe, Azure SQL database
• Experience in constructing ingestion, transformation & egree pipelines using Azure Data Factory
• Experience in developing application service using Pyspark & Spark SQL
Qualifications:
Required:
• Very good knowledge in working with Azure Databricks services for data engineer
• Creating Azure Databricks services
• Reading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services after receiving in different formats (e.g. csv, Parquet, Jason etc.) from Snowflake DWH platform
• Hands-on experience in working with Databricks File system (DBFS)
• Experience in working with RDD, Dataframe, Azure SQL database
• Experience in constructing ingestion, transformation & egree pipelines using Azure Data Factory
• Experience in developing application service using Pyspark & Spark SQL
Company:
Syntricate Technologies offers quality assurance, validation, regulatory, business analysis, and project management services. Founded in 2004, the company is headquartered in Boston, USA, with a team of 51-200 employees. The company is currently Growth Stage.