Job Summary:
4P Consulting Inc. is seeking a Data Engineer III to design, build, and optimize scalable data pipelines and analytics solutions. The role involves transforming raw data into structured formats that support enterprise analytics and AI/ML initiatives.
Responsibilities:
• Design, develop, test, deploy, and support scalable data pipelines
• Create and maintain Databricks pipelines for multiple data sources
• Develop batch and real-time data processing solutions
• Normalize databases and design schemas aligned with application requirements
• Combine and transform raw data into structured, analytics-ready datasets
• Design and implement data models (star schema, snowflake, relational, NoSQL)
• Implement data access strategies and storage optimization techniques
• Develop functional and technical designs for data engineering solutions
• Support diverse data source integration and enrichment
• Develop solutions using Spark, Hive, Hadoop
• Build and maintain solutions using Azure ecosystem tools: Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse, Azure Key Vault, Power BI
• Work with MSBI tools (SSIS, SSAS), Informatica, Oracle Golden Gate
• Support statistical models and AI/ML solutions using Python and/or R
• Prepare data pipelines to enable machine learning workflows
• Implement CI/CD pipelines for data engineering deployments
• Work within Agile development environments
• Utilize containerization tools (Docker, OpenShift)
• Develop API and web service integrations for data sourcing and delivery
• Implement and maintain data quality frameworks and tools
• Ensure consistency, accuracy, and reliability of data assets
Qualifications:
Required:
• 5–10 years of hands-on data engineering experience
• Advanced SQL expertise
• Strong experience with Spark, Hive, Hadoop
• Hands-on experience with Azure cloud data tools
• Experience building Databricks pipelines
• Experience with MSBI (SSIS/SSAS), Informatica, Oracle, SQL Server
• Experience with batch and real-time data processing frameworks
• Experience with data modeling and schema design
• Experience working with APIs and web services
Preferred:
• Experience supporting AI/ML workflows
• Experience with containerization (Docker, OpenShift)
• Strong background in DevOps and CI/CD practices
• Experience working in enterprise-scale environments
Company:
4P Consulting is a highly specialized Staffing and Recruiting company with significant experience and expertise in the Engineering industry, IT, Admin, Accounting, Advertising . Founded in 2012, the company is headquartered in Kennesaw, Georgia, US, , with a team of 11-50 employees. The company is currently Early Stage.