Job Summary:
Carma is seeking a Data Engineer to join their growing team and contribute to their digital infrastructure platform. The role involves designing, developing, and maintaining data solutions, including ETL pipelines, while collaborating with cross-functional teams to ensure data quality and integrity.
Responsibilities:
• Design and build scalable, efficient ETL/ELT pipelines to extract data from customer source systems, transform it to meet Carma's schema requirements, and load it into our data warehouse
• Write and maintain SQL queries and Python scripts for data extraction, cleansing, transformation, and validation
• Collaborate with teammates to design and implement data flows between data lakes, staging environments, and production warehouses
• Optimize data processing and query performance, and ensure data quality and integrity through rigorous testing and validation
• Implement data governance and security best practices across production environments
• Create and maintain Entity Relationship Diagrams (ERDs) for customer data models
• Build source-to-target mapping documents that clearly define how data moves from origin systems to Carma's platform
• Create reports that customers and engagement managers can use to validate migration accuracy
• Produce project status reports, milestone documentation, and deliverable summaries for engineering managers and clients
• Develop data models and schemas to support business intelligence and reporting
• Take ownership of your project timelines, balancing deadlines across multiple customer engagements
• Partner with engagement managers, business analysts, and customers to gather requirements, understand data needs, and validate results
• Keep the team informed: share blockers, risks, and progress updates so everyone stays aligned
• Inspire others and foster strong relationships within a collaborative team setting
• Innovate and invite a best-practice culture in method, tools, and approach for project work and IP solutions
Qualifications:
Required:
• 5+ years of professional experience in data engineering, data migration, or data warehousing
• Strong proficiency in both SQL and Python — you're comfortable using both daily and writing production-grade code in each
• Proven experience building ETL/ELT pipelines from scratch, not just maintaining existing ones
• Hands-on experience with data lakes and data warehouse architectures (design, load patterns, optimization)
• A track record of creating customer-facing documentation: ERDs, source-to-target maps, data dictionaries
• Superior analytical, quantitative, and conceptual thinking skills to tackle complex data challenges
• Strong communication and interpersonal abilities to ensure successful client projects and team performance
• Comfortable managing project deadlines and delivering documentation to engineering managers and clients
• Deep knowledge of data centers and/or telecom industries. Knowledge of the OSI Model or Power & Cooling are highly beneficial. Understanding current technology used in delivery of services.
• Advanced proficiency with SQL and Spark for large-scale data processing
• Working knowledge of Azure cloud services (Azure Data Factory, Azure SQL, ADLS, or similar)
• Experience with Databricks or similar data platform (Spark based)
• Microsoft BI tools (Power BI or similar) for reporting and data visualization
• Proficiency with the Microsoft Office suite (Word, Excel, PowerPoint, Outlook)
• Proficiency with source control (Git), CI/CD tools, and development environments (VS Code, Azure DevOps)
• Strong understanding of data warehousing and data modeling concepts — star schema, snowflake schema, normalization, denormalization
• Experience with data ingestion tools and technologies (Python, Power BI)
• Knowledge of data quality and validation best practices
• Strong written communications, especially related to articulating expectations and results
Preferred:
• Familiarity with Agile/Scrum delivery methodologies
• Experience with data visualization tools (Power BI or similar)
• Familiarity with Microsoft Flow, Power Automate, and Microsoft Common Data Service configuration migration
• Previous work on building data warehouse’s with teams of five or more people
Company:
Carma is a public agency that specializes in program administration, certificate of coverage, and liability claims oversight services. Founded in 2016, the company is headquartered in Sacramento, USA, with a team of 51-200 employees. The company is currently Growth Stage.
