Freelance Databricks Data Engineer Jobs in Chicopee, MA

Description
POSITION SUMMARY: The Data Engineer IV is responsible for transforming data that can be easily analyzed. The position will be responsible for expanding and optimizing our data and data pipeline for our Association partners. The Data Engineer IV primarily works with project teams on developing new data platforms to support strategic initiatives in alignment with business and/or enterprise strategies.
DUTIES AND RESPONSIBILITIES:
• Lead and architect an enterprise-scale data engineering project team in a matrix organization
• Provide strategic direction for the design, enhancement, and long-term support of data platforms.
• Drive organizational data engineering strategy by influencing process including, : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build and optimize the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Oversee engineering standards through code reviews to ensure quality and best practices are maintained.
• Shape enterprise-wide data governance policies, partnering with senior leadership and stakeholders. This includes data quality, data management, data policies, business process management, and risk management surrounding the handling of organizational data.
• Other related duties as assigned.
SKILLS AND COMPETENCIES:
• Coach and mentor junior engineers
• Effectively Communicate technical direction to senior leadership and cross-functional stakeholders. Foster innovative team culture and process improvement during development phase
• Demonstrate thought leadership in data engineering practices and enterprise data strategy.
Requirements
MINIMUM KNOWLEDGE AND EDUCATION REQUIREMENTS:
• Bachelor's degree in computer science or MIS, and 10+ years' experience in data modeling and cloud technologies. Expert with the Azure technology stack including:
o Databricks
o Data Factory
o SQL
o Python
o Power BI (Business Intelligence)
• 2+ years of leading large, distributed technical teams as well as actively interfacing with senior leadership teams.
• Ability work comfortably in both Agile and Waterfall methodologies
• Strong organization, analytical, and communication skills
• Proficiency in the following technologies: Microsoft Office Suite
• Strong customer service focus (data consumers as customers)
• Familiar with software development best practices
• Knowledge and proficiency in Artificial Intelligence concepts and technologies, including or similar to ChatGPT, Claude, Windsurf, Perplexity AI, Grok, Gemini
ESSENTIAL FUNCTIONS
• Ability to report to work in person and to attend work-related functions/activities.
• Ability to work at a desk and use a computer for extended periods.
• Ability to lift, carry, and move objects up to 10 pounds occasionally.
• Ability to occasionally travel as required.
• Ability to type and utilize various software programs efficiently and operate general office equipment.
• Ability to work in an office setting with moderate noise levels.
• Additional physical demands include, but may not be limited to, frequent talking or hearing, occasional push/pull, stoop/kneel, bend/twist, and reach to retrieve or move items in a typical office environment.
• Must be able to work scheduled hours and overtime as needed.
• This role has been designated as either a hybrid role, which gives employees the opportunity to work from home on Mondays and Fridays and working in the office on Tuesday, Wednesday, and Thursday, or a remote role, which means the employee will work entirely offsite.
o Exceptions to the designated work arrangement may be made based on business needs.
o Please note that the Company retains the right to change a position's designation at any time.
• Ability to concentrate and focus on details when reviewing documents, analyzing data, and performing computer-based tasks.
• Ability to manage multiple tasks and deadlines while maintaining accuracy and efficiency.
• Ability to problem-solve efficiently and make sound decisions.
• Ability to manage job-related stress and interactions with clients, colleagues, or external parties.
• Ability to communicate ideas clearly in both verbal and written form.
• Ability to work with others in a collegial and collaborative manner
This job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.
REASONABLE ACCOMMODATION: Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of their position.