8–11 Nov 2026
Morris J. Wosk Centre For Dialogue, SFU
America/Vancouver timezone

Benchmarking tools: new features, old bugs

10 Nov 2026, 14:20
10m
Asia Pacific Hall (Morris J. Wosk Centre For Dialogue, SFU)

Asia Pacific Hall

Morris J. Wosk Centre For Dialogue, SFU

580 W Hastings St, Vancouver, BC V6B 5K3, Canada
Lightning Talk Main Session OARC 47 Day 2

Speaker

Petr Špaček (Internet Systems Consortium (ISC))

Description

In recent years, benchmarking tools have been extended to support new transports like DNS-over-TLS, HTTPS, and QUIC. These features are orders of magnitude more complex than the good old UDP and TCP, and this complexity provides fertile ground for bugs.

To make things even worse, "Who tests the testing tools?" Hardly anyone.

We developed a test suite for the testing tools and uncovered bugs which affected measurement results in various niche and not-so-niche corner cases.

In this presentation we summarize our findings and alert the audience to gotchas when benchmarking DNS software.

Talk duration 10 Minutes (+5 for Q&A)

Primary author

Petr Špaček (Internet Systems Consortium (ISC))

Presentation materials

There are no materials yet.