Senior Observability Engineer Jobs (NOW HIRING)

Job Summary:
Tata Consultancy Services is seeking a Senior Observability Engineer who is an expert in telemetry architecture. The role involves enhancing customer observability maturity across various domains, managing alert optimization, and implementing advanced diagnostics and data strategies.
Responsibilities:
• Personnel will own, design, and optimize the following core domains:
• Operations & Noise Reduction
• Alert-to-Incident Signal Optimization: Analyze and optimize our Alert-to-Incident noise ratio (targeting a baseline better than 10:1). Drive the evolution from chaotic alerting to high-fidelity, actionable incident creation.
• Dynamic Baselining & Anomaly Detection: Shift the paradigm away from rigid static thresholds. Implement dynamic baseline that intelligently accounts for time-of-day, day-of-week, and seasonal traffic patterns.
• Guardrails, Standards, & Observability-as-Code
• Observability-as-Code (OaC): Drive the maturity of our telemetry infrastructure by ensuring all dashboards, alerts, SLOs, and monitor configurations are defined, versioned, and deployed as code.
• CI/CD Instrumentation Gates: Establish and enforce automated instrumentation compliance gates within our deployment pipelines to ensure code is observable before it hits production.
• Fleet Health Management: Centrally manage, version, and monitor the health of our Open Telemetry (OTel) collectors and agent fleets.
• Advanced Diagnostics & Next-Gen Tech
• Automated Root Cause Analysis (RCA): Implement platform capabilities that automatically surface probable root cause the moment an incident fire.
• Change & Deployment Correlation: Ensure all deployments, configuration changes, feature flag toggles, and database migrations are automatically annotated on dashboards and correlated to active incident timelines.
• GenAI/LLM-Assisted Triage: Evaluate and adopt GenAI/LLM capabilities for advanced log pattern explanation and accelerated incident troubleshooting.
• Telemetry Architecture & Data Strategy
• Cloud-Native & Third-Party Monitoring: Ensure deep telemetry integration across cloud-managed services (AWS/Azure/GCP, EKS/AKS, Lambda, RDS) and critical third-party SaaS dependencies (e.g., Guidewire, Salesforce, Earnix, Uniphore, payment gateways).
• Lakehouse & Data Pipeline Integration: Architect pipelines to export raw telemetry data to our data Lakehouse (S3/ADLS) to power advanced ML pipelines and predictive analytics.
• Predictive Capacity Analytics: Leverage the observability platform for capacity forecasting—predicting utilization trends for CPU, memory, queue depth, and storage before saturation occurs.
• Log Standardization: Drive org-wide standards for log structure and serialization to ensure seamless cross-platform parsing and querying.
• Culture, SLOs, & Business Impact
• End-to-End Business Transaction Tracing: Map and trac e complex, multi-service customer journeys (e.g., policy quote  bind  pay) to provide full-context business transaction visibility.
• SLO/SLA Governance: Define, implement, and track Service Level Objectives (SLOs) across all production services.
• Developer Empowerment & Self-Service: Democratize observability by fostering a proactive culture where developers instrument their own services during active development, backed by standardized, self-service health dashboards.
Qualifications:
Required:
• Seasoned Observability expert who actively lives and breathes telemetry architecture
• Experience in operations & noise reduction
• Ability to analyze and optimize Alert-to-Incident noise ratio (targeting a baseline better than 10:1)
• Experience in dynamic baselining & anomaly detection
• Ability to implement dynamic baseline that accounts for time-of-day, day-of-week, and seasonal traffic patterns
• Experience in Observability-as-Code (OaC)
• Ability to ensure all dashboards, alerts, SLOs, and monitor configurations are defined, versioned, and deployed as code
• Experience in establishing and enforcing automated instrumentation compliance gates within deployment pipelines
• Ability to manage, version, and monitor the health of Open Telemetry (OTel) collectors and agent fleets
• Experience in automated root cause analysis (RCA)
• Ability to implement platform capabilities that automatically surface probable root cause during incidents
• Experience in change & deployment correlation
• Ability to ensure deployments, configuration changes, feature flag toggles, and database migrations are annotated on dashboards and correlated to active incident timelines
• Experience in evaluating and adopting GenAI/LLM capabilities for advanced log pattern explanation and incident troubleshooting
• Experience in cloud-native & third-party monitoring
• Ability to ensure deep telemetry integration across cloud-managed services (AWS/Azure/GCP, EKS/AKS, Lambda, RDS) and critical third-party SaaS dependencies
• Experience in architecting pipelines to export raw telemetry data to data Lakehouse (S3/ADLS)
• Ability to leverage the observability platform for capacity forecasting
• Experience in driving org-wide standards for log structure and serialization
• Ability to map and trace complex, multi-service customer journeys for full-context business transaction visibility
• Experience in defining, implementing, and tracking Service Level Objectives (SLOs) across all production services
• Ability to foster a proactive culture where developers instrument their own services during active development
Company:
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. Founded in 1968, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.