Skip to content

Add gannet daily health report to Server Status + Gannet Dashboard - #2504

Merged
sr320 merged 1 commit into
masterfrom
gannet-health-dashboard
Sep 27, 2026
Merged

sr320 merged 1 commit into
masterfrom
gannet-health-dashboard

Conversation

@sr320

@sr320 sr320 commented Sep 27, 2026

Copy link
Copy Markdown
Member

Gannet now writes a daily health report to https://gannet.fish.washington.edu/v1_web/owlshell/latest.txt. This PR adds it to the handbook.

Pipeline: scripts/check_servers.py fetches and parses the report (plus the last 30 dated gannet_health_YYYY-MM-DD.txt copies for history) into a top-level gannet_stats field. The existing server-status probers relay it through the server-status branch, so no new workflow is needed. Gannet doesn't send CORS headers, so the page can't read the text file directly.

Computing Hardware → Server Status

  • New Daily health column. Gannet's cell shows its alerts (currently CRITICAL disk: /volume2 at 98%) and links to the dashboard.
  • New Gannet Health section with alerts and the disk table, alongside Raven Disk / CPU.

New page: Computing and Code → Gannet Dashboard

  • Tiles: overall state, per-volume % full, 15-min load vs. cores, memory, RAID arrays healthy, uptime
  • Alerts, storage with inodes, volume-use and load history charts
  • Memory, RAID, services, failed systemd units, kernel errors, SMART, and the full raw report

A report older than 30 hours is flagged stale. I tested it with a local mkdocs build using a real parsed report, plus fake history to check the charts.

🤖 Generated with Claude Code

check_servers.py now parses gannet's daily owlshell/latest.txt report
(plus the last 30 dated copies for history) into a top-level gannet_stats
field, relayed through the server-status branch like raven_stats.

- Server Status table gets a "Daily health" column; gannet's shows its
  alerts and links to the dashboard.
- New "Gannet Health" section on Computing Hardware (alerts + disks).
- New Gannet Dashboard page: KPI tiles, alerts, storage with inodes,
  volume-use and load history charts, memory, RAID, services, failed
  units, kernel errors, and the raw report.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@sr320
sr320 merged commit a943dde into master Sep 27, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant