Role Overview:
We are seeking an experienced Observability Architect with deep expertise in the ELK Stack (Elasticsearch, Logstash, Kibana) to design, implement, and manage enterprise-wide logging, monitoring, and observability solutions. This role involves collaborating with cross-functional teams to deliver actionable insights and ensure the robust performance and security of the ELK environment.
Key Responsibilities:
- Architect, configure, and manage the ELK Stack to support logging, monitoring, and observability needs across the enterprise.
- Collaborate with cross-functional teams to understand business requirements and design dashboards, alerts, and reports for various stakeholders.
- Optimize and troubleshoot ELK performance, including tuning Elasticsearch for efficient storage and retrieval of large datasets.
- Develop and implement data pipelines with Logstash and other ingestion tools, ensuring reliable data flow from diverse data sources.
- Enable advanced analytics and data visualizations in Kibana to provide actionable insights for IT operations.
- Implement security, access controls, and best practices within the ELK environment.
- Train and mentor team members on ELK best practices and provide technical support as needed.
Required Skills:
- Expert-level proficiency in Elasticsearch.
- Experience with Distributed Architecture Cluster Design.
- Proficiency in Search Index Optimization (Query DSL, Aggregations).
- Expertise in Performance Tuning and Scaling.
- Knowledge of ILM (Index Lifecycle Management), Data Streams, and Sharding Strategy.
- Experience with HADR (High Availability Disaster Recovery) and Multi-region architecture.
- Familiarity with CICD and Infrastructure as Code (Terraform, Ansible).
- Strong understanding of Security (RBAC, TLS, authentication).
- Proficiency in scripting or programming (Python, Java).
Qualifications:
- 10+ years of relevant experience.
Preferred Skills:
- Prior experience in AIOps, ITOM, or other observability solutions.
- Familiarity with scripting and automation (e.g., Python, Bash).
- Knowledge of infrastructure-as-code tools like Terraform or Ansible.