Sr. Data Engineer (Hybrid)Chicago, IL
The American Medical Association (AMA) is the nation's largest professional Association of physicians and a non-profit organization. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health.
At AMA, our mission to improve the health of the nation starts with our people. We foster an inclusive, people-first culture where every employee is empowered to perform at their best. Together, we advance meaningful change in health care and the communities we serve.
We encourage and support professional development for our employees, and we are dedicated to social responsibility. We invite you to learn more about us and we look forward to getting to know you.
We have an opportunity at our corporate offices in Chicago for a Sr. Data Engineer (Hybrid) on our Information Technology team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office.
As a Sr. Data Engineer, you will play a key role in implementingand maintaining AMA's enterprise data platform to support analytics,interoperability, and responsible AI adoption. This role partners closely withplatform engineering, data governance, data science, IT security, and businessstakeholders to deliver high-quality, reliable, and secure data products. Thisrole contributes to AMA's modern lakehouse architecture, optimizing dataoperations, and embedding governance and quality standards into engineeringworkflows. This role serves as asenior technical contributor within the team-providing mentorship to juniorengineers and implementing engineering best practices within the data platform function,in alignment with architectural direction set by leadership.
RESPONSIBILITIES:
Data Engineering & AI Enablement- Build and maintain scalable data pipelines andETL/ELT workflows supporting analytics, operational reporting, and AI/ML usecases.
- Implement best practice patterns for ingestion,transformation, modeling, and orchestration within a modern lakehouseenvironment (e.g., Databricks, Delta Lake, Azure Data Lake).
- Develop high-performancedata models and curated datasets with strong attention to quality, usability,and interoperability; create reusable engineering components and automation.
- Collaborate with the Architecture Team, the DataPlatform Lead, and federated IT teams to optimize storage, compute, andarchitectural patterns for performance and cost-efficiency.
- Build model-ready data sets and featurepipelines to support AI/ ML use cases; serve as a technical coordination pointsupporting business units' AI-related infrastructure needs.
- Collaborate with data scientists and AI WorkingGroup to operationalize models responsibly and maintain ongoing monitoringsignals.
Governance, Quality & Compliance- Embed data governance, metadata standards,lineage tracking, and quality controls directly into engineering workflows;ensure technical implementation and alignment within engineering workflows.
- Work with the Data Governance Lead and businessstakeholders to operationalize stewardship, classification, validation,retention, and access standards.
- Implement privacy-by-design and security-by-designprinciples, ensuring compliance with internal policies and regulatoryobligations.
- Maintain documentation for pipelines, datasets,and transformations to support transparency and audit requirements.
Platform Reliability, Observability & Optimization- Monitor and troubleshoot pipeline failures,performance bottlenecks, data anomalies, and platform-level issues.
- Implement observability tooling, alerts,logging, and dashboards to ensure end-to-end reliability.
- Support cost governance by optimizing computeresources, refining job schedules, and advising on efficient architecture.
- Collaborate with the Data Platform Lead onscaling, configuration management, CI/CD pipelines, and environment management.
- Collaborate with business units to understanddata needs, translate them into engineering requirements, and deliverfit-for-purpose data solutions; share and apply best practices and emergingtechnologies within assigned initiatives.
- Work with IT Security and Legal/ Compliance toensure platform and datasets meet risk and regulatory standards.
Staff Management- Lead, mentor, and provide management oversightfor staff.
- Responsible for setting objectives, evaluatingemployee performance, and fostering a collaborative team environment.
- Responsible for developing staff knowledge andskills to support career development.
May include other responsibilities as assigned
REQUIREMENTS:
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field preferred or equivalent work experience and HS diploma/equivalent education required.
- 5+ years of experience in data engineering within cloud environments
- Experience in people management preferred.
- Demonstrated hands-on experience with modern data platforms (Databricks preferred).
- Proficiency in Python, SQL, and datatransformation frameworks.
- Experience designing and operationalizingETL/ELT pipelines, orchestration workflows (Airflow, Databricks Workflows), andCI/CD processes.
- Solid understanding of data modeling,structured/unstructured data patterns, and schema design.
- Experience implementing governance and qualitycontrols: metadata, lineage, validation, stewardship workflows.
- Working knowledge of cloud architecture, IAM,networking, and security best practices.
- Demonstrated ability to collaborate acrosstechnical and business teams.
- Exposure to AI/ML engineering concepts, featurestores, model monitoring, or MLOps patterns.
- Experience with infrastructure-as-code(Terraform, CloudFormation) or DevOps tooling.
The American Medical Association is located at 330 N. Wabash Avenue, Chicago, IL 60611 and is convenient to all public transportation in Chicago.
This role is an exempt position, and the salary range for this position is $115,523.42-$150,972.44. This is the lowest to highest salary we believe we would pay for this role at the time of this posting. An employee's pay within the salary range will be determined by a variety of factors including but not limited to business consideration and geographical location, as well as candidate qualifications, such as skills, education, and experience. Employees are also eligible to participate in an incentive plan. To learn more about the American Medical Association's benefits offerings, please click here.
We are an equal opportunity employer, committed to diversity in our workforce. All qualified applicants will receive consideration for employment. As an EOE/AA employer, the American Medical Association will not discriminate in its employment practices due to an applicant's race, color, religion, sex, age, national origin, sexual orientation, gender identity and veteran or disability status.
THE AMA IS COMMITTED TO IMPROVING THE HEALTH OF THE NATION