https://www.sre.wang/en/tags/monitoring--alerting/Recent content in Monitoring & Alerting on SRE Engineering PracticeHugo -- gohugo.ioenTue, 04 Feb 2025 00:00:00 +0000https://www.sre.wang/en/posts/blackbox-exporter-uptime/Tue, 04 Feb 2025 00:00:00 +0000https://www.sre.wang/en/posts/blackbox-exporter-uptime/A guide to Blackbox Exporter configuration, HTTP/TCP/ICMP/DNS probing, SSL certificate expiry monitoring, multi-region probing, Prometheus integration, and availability SLO measurementhttps://www.sre.wang/en/posts/opentelemetry-unified-observability/Mon, 11 Nov 2024 00:00:00 +0000https://www.sre.wang/en/posts/opentelemetry-unified-observability/An in-depth guide to OpenTelemetry specifications, the three signals (Metrics/Logs/Traces), Collector architecture, SDK auto-instrumentation, backend integration, and migration strategieshttps://www.sre.wang/en/posts/synthetic-monitoring/Wed, 09 Oct 2024 00:00:00 +0000https://www.sre.wang/en/posts/synthetic-monitoring/A systematic guide to synthetic monitoring principles, its complementary relationship with passive monitoring, critical path simulation, UI automation integration, multi-region probing, fault localization, and tool selectionhttps://www.sre.wang/en/posts/alerting-strategy-design/Mon, 19 Aug 2024 00:00:00 +0000https://www.sre.wang/en/posts/alerting-strategy-design/Starting from alert fatigue, a systematic guide to alert tiering, SLO-based alerting, inhibition and aggregation, MTTR/alert precision metrics, and alert governance for building a high-quality alerting systemhttps://www.sre.wang/en/posts/prometheus-federation-ha/Tue, 23 Jul 2024 00:00:00 +0000https://www.sre.wang/en/posts/prometheus-federation-ha/An in-depth analysis of Prometheus single-point issues, comparing dual-replica, Thanos, Mimir, VictoriaMetrics, and Cortex high-availability and long-term storage solutions, with a selection decision frameworkhttps://www.sre.wang/en/posts/prometheus-service-discovery/Thu, 06 Jun 2024 00:00:00 +0000https://www.sre.wang/en/posts/prometheus-service-discovery/An in-depth guide to Prometheus static configuration and dynamic service discovery, covering file/kubernetes/consul/dns/ec2 SD solutions, relabel_configs label management, and multi-cluster monitoring in practicehttps://www.sre.wang/en/posts/elasticsearch-kibana-log-stack/Thu, 09 May 2024 00:00:00 +0000https://www.sre.wang/en/posts/elasticsearch-kibana-log-stack/From ELK Stack architecture to Elasticsearch index management, Kibana visualization, Filebeat/Logstash collection, log parsing pipelines, and performance optimization — a complete guide to building an ELK log analysis platformhttps://www.sre.wang/en/posts/datadog-vs-selfhosted-monitoring/Wed, 17 Apr 2024 00:00:00 +0000https://www.sre.wang/en/posts/datadog-vs-selfhosted-monitoring/A comprehensive comparison of Datadog commercial monitoring with Prometheus/Grafana open-source self-hosted solutions, covering feature matrix, cost models, TCO analysis, and a selection decision frameworkhttps://www.sre.wang/en/posts/grafana-dashboard-best-practices/Wed, 17 Apr 2024 00:00:00 +0000https://www.sre.wang/en/posts/grafana-dashboard-best-practices/A systematic guide to Grafana dashboard design and operations, covering design principles, variable templates, panel selection, SLO dashboard implementation, and JSON version managementhttps://www.sre.wang/en/posts/prometheus-promql-guide/Thu, 04 Apr 2024 00:00:00 +0000https://www.sre.wang/en/posts/prometheus-promql-guide/A systematic guide to PromQL data models, basic queries, aggregation operations, common functions, practical query examples, and advanced techniques for SRE engineershttps://www.sre.wang/en/posts/alertmanager-routing-silencing/Tue, 27 Feb 2024 00:00:00 +0000https://www.sre.wang/en/posts/alertmanager-routing-silencing/An in-depth guide to Alertmanager architecture, routing tree design, grouping strategies, inhibition rules, silence management, and multi-channel notification configuration, with a complete alertmanager.yml examplehttps://www.sre.wang/en/posts/zabbix-vs-prometheus/Mon, 05 Feb 2024 00:00:00 +0000https://www.sre.wang/en/posts/zabbix-vs-prometheus/A comprehensive comparison of Zabbix and Prometheus across architecture, data models, alerting mechanisms, ecosystems, and use cases, with migration plans and hybrid monitoring practices