Junior Azure Data Engineer Jobs in Georgia (NOW HIRING)

Job Summary:
InterSources Inc is a Small, Woman, and Minority-Owned Business Enterprise with extensive experience in providing IT Consulting Services. They are seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks, focusing on scalable data architecture and seamless data integration.
Responsibilities:
• Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.
• Design data flows within the Microsoft Fabric environment.
• Implement OneLake storage strategies.
• Configure Synapse Analytics workspaces.
• Establish Power BI integration patterns.
• Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
• Design Delta Lake architecture for IES Gateway data.
• Implement medallion architecture (Bronze/Silver/Gold layers).
• Create real-time data ingestion patterns.
• Establish data quality frameworks.
• Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.
• Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.
• Configure Microsoft Purview policies.
• Establish data masking for sensitive information.
• Design audit logging mechanisms.
• Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.
• Implement performance tuning strategies for large-scale data processing and analytics workloads.
• Optimize Spark configurations.
• Implement partitioning strategies.
• Design caching mechanisms.
• Establish monitoring frameworks.
• Design and implement security patterns aligned with federal and state requirements for sensitive data handling.
Qualifications:
Required:
• Bachelor's degree in computer science or related field.
• 6+ years of experience in data architecture and engineering.
• 2+ years hands-on experience with Azure Databricks and Spark.
• Recent experience with Microsoft Fabric platform.
• Data Integration: Combining and cleansing data from various sources.
• Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
• Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
• Data Visualization Techniques: Representing data graphically in impactful and informative ways.
• Optimization and Security: Optimizing queries, improving performance, and securing data.
• Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
• Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
• Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
• Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
• Configuring and managing Databricks clusters for optimized performance.
• Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
• Developing and deploying machine learning models using Databricks MLflow and other tools.
• Implementing data governance practices using Unity Catalog and Microsoft Purview.
• Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions.
• Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark.
• Dimensional modeling.
• Real-time data modeling patterns.
• Strong analytical and problem-solving abilities.
• Excellent communication skills for technical and non-technical audiences.
• Experience working with government stakeholders.
Preferred:
• Azure DevOps
• Infrastructure as Code (Terraform)
• CI/CD for data pipelines
• Data mesh architecture
• Microsoft Azure Data Engineer Associate
• Databricks Data Engineer Professional
• Microsoft Fabric certifications (as they become available)
• Experience designing data architectures for grant management systems
• Knowledge of federal/state compliance requirements for data handling
• Understanding of financial data processing requirements
• Experience with real-time integration patterns
Company:
InterSources Inc. solves operational problems where protection, performance, compliance, AI, and workforce capability must work together. Founded in 2007, the company is headquartered in Fremont, USA, with a team of 501-1000 employees. The company is currently Late Stage.