Astronomy Jobs in Riverside, CA (NOW HIRING)

Job Summary:
Tata Consultancy Services is seeking a Senior Data Platform / Data Product Engineering Lead to drive enterprise-scale data product lifecycle enablement across modern data platforms. This role will lead the design, standardization, and adoption of a paved path for data creators, enabling self-service, governed, and scalable data product development.
Responsibilities:
• Define and implement a self-service data platform strategy to reduce onboarding friction.
• Lead automated provisioning of:
• Databricks workspaces (via DevHub)
• Airflow/Astronomer environments
• Access and entitlements (AccessCentral APIs)
• Establish isolated, stable development environments for federated teams.
• Drive platform observability by integrating metrics into tools like Datadog.
• Architect and implement enterprise-wide data discovery and marketplace enablement.
• Drive adoption of:
• Data contracts
• Metadata standards
• Domain-aligned catalogs (Unity Catalog)
• Enable secure access to curated, masked datasets in dev and production environments.
• Implement tagging, access patterns, and entitlement automation.
• Partner with risk/compliance teams to enforce regulatory and governance controls (BFSI-aligned).
• Lead design of scalable data ingestion, curation, and transformation frameworks.
• Build and standardize modular, reusable frameworks:
• LaunchLake templates
• Airflow DAG libraries
• DBT-based transformation models
• Ensure:
• Data quality and consistency
• Embedded governance and compliance policies
• Enable concurrent development using standardized patterns and environments.
• Define and enforce standard CI/CD pipelines across data products:
• Harness (or equivalent)
• Databricks Asset Bundles (DAB)
• Automate:
• DAG deployments (Airflow/Astronomer)
• DBT pipeline releases
• Reduce manual interventions and ensure consistent, repeatable deployments.
• Improve release reliability with feedback loops, notifications, and monitoring.
• Drive publishing of data products to:
• Unity Catalog
• Enterprise Data Marketplace
• Define and enforce:
• Documentation standards
• Data ownership models
• Versioning and contract management
• Enable cross-domain data sharing with embedded governance and access controls.
• Establish a scalable operating model for data product support.
• Implement:
• Monitoring dashboards (Datadog)
• Data quality frameworks
• Usage and performance metrics tracking
• Improve visibility into:
• Pipeline health
• Data lineage
• Access and consumption patterns
• Lead incident management, root cause analysis, and escalation processes.
• Drive execution of platform priorities such as:
• Data contract activation strategy
• Domain catalog integration
• Data masking in development environments
• Data quality frameworks
• DBT adoption and POCs
• Lead maturity uplift from:
• Manual, fragmented workflows → standardized, automated paved paths
• Champion continuous improvement and innovation in developer experience.
Qualifications:
Required:
• 10+ years of experience in Data Engineering / Data Platform roles
• Strong hands-on expertise in Databricks (Delta Lake, workflows, DAG)
• Strong hands-on expertise in Apache Airflow / Astronomer
• Strong hands-on expertise in Python, SQL, DBT, AWS
• Proven experience implementing CI/CD frameworks (Harness, GitHub Actions, Azure DevOps)
• Deep understanding of data governance (catalogs, lineage, contracts, metadata)
• Deep understanding of data quality and masking techniques
• Deep understanding of enterprise data platforms and marketplace ecosystems
• Experience with API-based integrations (e.g., entitlement systems like AccessCentral)
• Experience with monitoring/observability tools (e.g., Datadog)
Company:
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. Founded in 1968, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.