bench: document the real-world tierUnverified
d5ea3aa parent: a4751cd modified
README.md +18 -0 | @@ -197,3 +197,21 @@ probe degrades gracefully). Collect with | ||
| 197 | 197 | | GNU date | python3 millis fallback, then whole-second `.000Z` | |
| 198 | 198 | | dd / stat / df| probe records `null` values, job stays green | |
| 199 | 199 | | python3 | emitter falls back to whole-second timestamps | |
| 200 | + | |
| 201 | +## Real-world tier (added round 12+) | |
| 202 | + | |
| 203 | +Alongside the synthetic micro-workloads, the bench builds four notorious OSS | |
| 204 | +projects at pinned tags, cloned/downloaded inside the timed window: | |
| 205 | + | |
| 206 | +| step | project | pin | toolchain | | |
| 207 | +|---|---|---|---| | |
| 208 | +| `rust-ripgrep` | BurntSushi/ripgrep | 15.2.0 | cargo | | |
| 209 | +| `cpp-sqlite` | SQLite amalgamation | 3.45.1 (sqlite.org 2024 tarball) | gcc/make | | |
| 210 | +| `node-typescript` | microsoft/TypeScript | v5.9.3 (5.x line — 7.x is the Go rewrite) | node/npm | | |
| 211 | +| `java-guava` | google/guava | v33.7.1 | maven | | |
| 212 | + | |
| 213 | +ClickHouse is deliberately absent: a full build needs dozens of cores and | |
| 214 | +~100 GB of disk, which no shared-runner tier (ours or GitHub's) provides — a | |
| 215 | +ClickHouse-scale tier needs a dedicated runner class, not a benchmark step. | |
| 216 | +SQLite's amalgamation is the C/C++ stand-in: a real configure+make of one of | |
| 217 | +the most deployed codebases on earth, reproducible from a pinned tarball. | |
| @@ -197,3 +197,21 @@ probe degrades gracefully). Collect with | |||
| 197 | | GNU date | python3 millis fallback, then whole-second `.000Z` | | 197 | | GNU date | python3 millis fallback, then whole-second `.000Z` | |
| 198 | | dd / stat / df| probe records `null` values, job stays green | | 198 | | dd / stat / df| probe records `null` values, job stays green | |
| 199 | | python3 | emitter falls back to whole-second timestamps | | 199 | | python3 | emitter falls back to whole-second timestamps | |
| 200 | + | ||
| 201 | +## Real-world tier (added round 12+) | ||
| 202 | + | ||
| 203 | +Alongside the synthetic micro-workloads, the bench builds four notorious OSS | ||
| 204 | +projects at pinned tags, cloned/downloaded inside the timed window: | ||
| 205 | + | ||
| 206 | +| step | project | pin | toolchain | | ||
| 207 | +|---|---|---|---| | ||
| 208 | +| `rust-ripgrep` | BurntSushi/ripgrep | 15.2.0 | cargo | | ||
| 209 | +| `cpp-sqlite` | SQLite amalgamation | 3.45.1 (sqlite.org 2024 tarball) | gcc/make | | ||
| 210 | +| `node-typescript` | microsoft/TypeScript | v5.9.3 (5.x line — 7.x is the Go rewrite) | node/npm | | ||
| 211 | +| `java-guava` | google/guava | v33.7.1 | maven | | ||
| 212 | + | ||
| 213 | +ClickHouse is deliberately absent: a full build needs dozens of cores and | ||
| 214 | +~100 GB of disk, which no shared-runner tier (ours or GitHub's) provides — a | ||
| 215 | +ClickHouse-scale tier needs a dedicated runner class, not a benchmark step. | ||
| 216 | +SQLite's amalgamation is the C/C++ stand-in: a real configure+make of one of | ||
| 217 | +the most deployed codebases on earth, reproducible from a pinned tarball. | ||