Manager Databricks Data Engineer Jobs in South Carolina

Location
Charleston - 997 Morrison Drive, Suite 402
Business
We know that a "one-size-fits-all" approach doesn't work when it comes to residential living. That's why, at Brookfield Properties, our portfolio features a wide range of options for any stage of life. And though our properties may be diverse, one thing is universal: all offer the unparalleled quality, service, and support our residents deserve.
If you're ready to be a part of our team, we encourage you to apply.
Job Description
Position Summary
The Senior Data Engineer is responsible for designing, building, and optimizing scalable data pipelines and cloud-based data systems that support analytics and data-driven decision-making across the organization. This role requires expertise in data architecture, ETL development, and modern cloud technologies, with a focus on ensuring high-quality, reliable, and efficient data solutions. The ideal candidate will have strong proficiency in Python, SQL, AWS services such as S3 and Redshift. Experience integrating Salesforce data and working with orchestration tools such as Airflow or AWS Glue is also highly valued.
In this role, the Senior Data Engineer will collaborate closely with data analysts, scientists, software engineers, and business stakeholders to improve data accessibility, performance, and scalability. Key responsibilities include developing and maintaining automated ETL frameworks, managing enterprise data products, implementing DevOps and CI/CD practices, and ensuring data quality and governance standards are met. The position also involves researching and adopting emerging technologies to continuously enhance the organization's data infrastructure and operational efficiency.
The ideal candidate will possess strong problem-solving abilities, excellent communication skills, and experience working within agile development environments. Preferred qualifications include certifications in cloud or data engineering platforms, familiarity with non-relational databases and OpenSearch technologies, and exposure to business intelligence tools such as Tableau or Power BI. Success in this role will be measured by pipeline performance, data reliability, cross-functional collaboration, and contributions toward innovation and infrastructure optimization.
1. Pipeline Development & Data Integration (50%)
Design, develop, optimize, and maintain scalable ETL/ELT pipelines and cloud-based data integrations across enterprise systems, APIs, and operational platforms including Yardi and Salesforce. Build reliable, high-performance workflows that support the movement and transformation of data from SQL Server and other source systems into AWS-based analytics platforms including Redshift and S3.
Key Areas:
-ETL/ELT pipeline development and optimization
-SQL Server, API, Yardi, Salesforce, and third-party integrations
-AWS S3 and Redshift data workflows
-Airflow and AWS Glue orchestration
-Pipeline monitoring, reliability, and SLA management
2. Collaboration with Analytics, Data Science, and Stakeholders and Data Enablement 30%
Develop and maintain enterprise datasets, models, and transformation frameworks while partnering with Analytics, Data Science, AI Initiatives, and Business teams to refine requirements, improve data accessibility, and deliver trusted datasets that support reporting, analytics, and operational decision-making.
Key Areas:
* Data modeling and warehousing
* Data quality, governance, and documentation
* Cross-functional collaboration with business, analytics and AI teams
* Dataset refinement and business requirements gathering
* Support for BI, AI/ML, and operational analytics initiatives
3. Architecture, Strategic Initiatives & Operational Excellence (20%)
Contribute to enterprise data platform and strategy through participation in large-scale initiatives, complex integration design, and modernization of data infrastructure. Support scalable and reliable operations through DevOps, automation, CI/CD, and infrastructure management best practices.
Key Areas:
* Enterprise data architecture and integration design
* Strategic technology evaluation and innovation
* Infrastructure automation and CI/CD practices
* Docker, Terraform, and deployment management
* Agile/Scrum participation and operational support
Education
Undergraduate (Bachelor) Degree in MIS, Computer Science, Information Technology required
Work Experience

• 5 - 7 Years of experience developing ETL & System Integration pipelines required
• 5 - 7 Years of experience designing, building, and improving large data models in complex environments required
• 5 - 7 Years experience with Cloud Technologies like Airflow, Glue, or similar ETL Tools
• 5 - 7 Years of experience with SQL, Redshift, Snowflake or similar data warehouse solutions required
• 5 - 7 Years of experience developing complex Python code to support various integration needs

Travel
Travel up to 20% of the time; rarely travel
Great Incentives!
Brookfield Properties cares about the well-being and work-life balance of our valued associates! To show how much we care, we offer awesome incentives that include:

• Full benefits package
• Generous paid time off
• 401(k) with company match
• Growth and advancement opportunities

Equal Opportunity Employer: Minorities/Religion/Sex/Protected Veterans/Disability/Sexual Orientation/Gender Identity/Marital Status/Pregnancy/Age/National Origin/Genetic Information. Drug free workplace
#LI-JR1
We are proud to create a diverse environment and are proud to be an equal opportunity employer. We are grateful for your interest in this position, however, only candidates selected for pre-screening will be contacted.
#BPMF