ZAWAD / SECURITY / IT INFRASTRUCTURE / SYSTEMS / 6
Systems & Observability

Infrastructure Monitoring with Zabbix

A monitoring case study built around one question: can an operator detect, understand, and verify a fault before users report it? The workflow combines host inventory, reusable templates, service checks, trigger logic, dashboards, and recovery testing.

ZABBIXSNMPAGENTSALERTING
01

MONITORING ARCHITECTURE

A small lab can use one Zabbix server, a database, the web frontend, and several monitored Linux/network hosts. Host groups provide structure; templates keep item and trigger definitions reusable.

02

AGENT & HOST CONFIGURATION

Linux hosts can expose system metrics through the Zabbix agent while network equipment may use SNMP. The configuration emphasizes stable hostnames, predictable interfaces, and explicit metadata such as environment and role.

03

TRIGGER ENGINEERING

Good triggers describe an operational condition, not just a number. CPU saturation, disk pressure, service failure, and unreachable-host events should have thresholds that reflect a baseline and an action path.

FIELD NOTE — Treat command output as evidence. Replace demo placeholders with captured output only when the environment was actually tested.
terminal / evidence
$ zabbix_agentd -t 'system.cpu.util[,user]' 
system.cpu.util[,user] [t|0.42]
$ systemctl status zabbix-agent --no-pager
Active: active (running)
$ ss -lntp | grep 10050
LISTEN ... :10050 ... zabbix_agentd
LAB HOST • AGENT HEALTH
terminal / evidence
$ sudo systemctl stop demo-web.service
$ systemctl is-active demo-web.service
inactive
# Zabbix UI: trigger changes to PROBLEM
$ sudo systemctl start demo-web.service
active
# Zabbix UI: trigger returns to OK
CONTROLLED FAULT • MOCKED UI RESULT
01baseline
02test cycles
03verification gates
04

CONTROLLED FAILURE TEST

A safe lab test is to stop a non-critical test service, observe the item/trigger transition, confirm the alert, restore the service, and verify recovery. This validates both detection and recovery rather than only dashboard cosmetics.

05

LESSONS LEARNED

Monitoring becomes useful when it reduces uncertainty. The best dashboard answers what is broken, where it is broken, how long it has been broken, and whether the condition is improving.