Pegel

Everything about Pegel: releases, incidents and how two people build and run it.

Post

Release day

A signed tag starts everything else: two builds, the checksum file and the release page. Eight seconds of it, looped.

1 min

PostMembers only

Sixty days of Pegel watching itself

Our site, the status page and the mail relay from 2026-09-14 to 2026-11-12: three red days, uptime between 99.72 % and 99.81 %. The numbers per target are for members.

1 min

Sixty days of uptime bars for pegel.example.org, the status page and the mail relay. Day 12 is red for the first two, day 13 for the status page, day 41 for the mail relay.

Incident

arm64 downloads of v0.9.0 failed their checksum

For 13 hours after the release, pegel upgrade on arm64 stopped with a checksum error. The binary was fine, the checksum file was not. Two community packages still carry the old one.

Monitoring Major

Changelog

v0.9.0: Checks from two places

An alert fires only when two probes agree, which ends the false alarms from a flaky home line. Since this release, interval counts seconds.

The version mark v0.9.0 above the line Checks from two places.

Post

Why an alert needs two probes

From May to October, one probe on a home line sent us 121 false alarms. Two probes that had to agree sent one.

2 min

A diagram: probe home and probe vps each report down to a box labelled agree?, which points to example.org. An alert fires only when both probes see the outage.

TIL

A TOML decoder can list the keys it ignored

toml.DecodeFile from BurntSushi/toml returns a MetaData, and its Undecoded() lists every key in the file that matched no field. Pegel 0.9.0 uses it to refuse a typo such as intervall instead of ignoring it.

md, err := toml.DecodeFile(path, &cfg)
if err != nil {
	return nil, err
}
if keys := md.Undecoded(); len(keys) > 0 {
	return nil, fmt.Errorf("%s: unknown key %q", path, keys[0].String())
}

Before, a misspelt key fell back to its default without a word, and nobody suspects a default.

Incident

Alert mails were held for four hours

On 2026-10-24 our mail relay accepted every mail and delivered none from 09:20 to 13:20 CEST. Webhook alerts reached us the whole time.

Resolved Minor

Buy Logbuch