diff --git a/benchmarks/app-patterns/results/matrix-20260803-072044.md b/benchmarks/app-patterns/results/matrix-20260803-072044.md new file mode 100644 index 0000000000..999ccbaea1 --- /dev/null +++ b/benchmarks/app-patterns/results/matrix-20260803-072044.md @@ -0,0 +1,27 @@ +# App-pattern bench matrix — 2026-08-03 07:20:44 + +Each cell is mean ms (min ms). Lower is better. +Final column is **perry/bun ratio** — > 2× is a real gap, < 1.5× is fine. + +| Kernel | Perry | Bun | Node | perry/bun | perry/node | +|---|---:|---:|---:|---:|---:| +| batch | 147.7 (146.2) | 26.4 (25.6) | 73.6 (71.4) | 5.59x ✗ slow | 2.01x | +| buffer_transcode | 60.9 (58.1) | 43.1 (41.4) | 85.6 (83.7) | 1.41x ✓ ok | 0.71x | +| date_format_parse | 36.5 (35.7) | 46.6 (44.5) | 116.0 (112.5) | 0.78x ✅ win | 0.31x | +| json_parse_1mb | 133.7 (132.2) | 68.5 (67.3) | 124.6 (121.1) | 1.95x ⚠ borderline | 1.07x | +| json_stringify_1mb | 97.2 (96.3) | 37.8 (36.8) | 93.6 (90.8) | 2.57x ✗ slow | 1.04x | +| map_1m | 681.0 (666.3) | 229.5 (216.9) | 270.6 (259.0) | 2.97x ✗ slow | 2.52x | +| object_deep_clone | 559.6 (546.4) | 17.5 (16.9) | 55.4 (53.6) | 31.98x ✗ slow | 10.10x | +| promise_all_chains | 158.7 (156.6) | 22.7 (22.0) | 62.5 (60.6) | 6.99x ✗ slow | 2.54x | +| regex_replace | 57.8 (56.8) | 51.4 (50.4) | 102.0 (99.6) | 1.12x ✓ ok | 0.57x | +| string_concat_csv | 40.0 (39.4) | 28.2 (27.6) | 86.3 (84.6) | 1.42x ✓ ok | 0.46x | +| string_split_map_join | 41.0 (40.3) | 47.6 (45.8) | 79.5 (78.0) | 0.86x ✅ win | 0.52x | +| string_template_interp | 68.3 (67.1) | 42.6 (40.9) | 104.2 (101.6) | 1.60x ⚠ borderline | 0.66x | + +## Summary + +- Perry-faster-than-Bun kernels: **2** +- Borderline (1.5–2× slower): **2** +- Slow (≥ 2× slower): **5** + +**Priority backlog:** the ✗ slow rows are the gaps. Each one is a focused workstream. diff --git a/benchmarks/honest_bench/REPORT.md b/benchmarks/honest_bench/REPORT.md index 887d0ab125..bc8d8902c7 100644 --- a/benchmarks/honest_bench/REPORT.md +++ b/benchmarks/honest_bench/REPORT.md @@ -1,23 +1,23 @@ # Perry vs Rust vs Zig — honest benchmark results -Numbers are measured against Perry v0.5.908 on five implementations: Rust, Zig, Perry, Node.js, Bun. All three workloads complete on all five implementations and every measured run's output matches the Bun reference byte-for-byte (300/300 rows; correctness gate from `#441`). The auto-generated tables below come straight from `results/results.json`; the bottom-line summary tracks the most recent sweep. +Numbers are measured against Perry v0.5.81 on five implementations: Rust, Zig, Perry, Node.js, Bun. All three workloads complete on all five implementations — every correctness and scaling bug the bench originally surfaced (`#38`–`#53`, `#62`–`#65`) has landed in Perry mainline. 260 measured runs, zero failures. ## Bottom line -- **Compute (image convolution, tight loop, minimal heap):** Zig 245 ms. - **Perry 354 ms (1.44× Zig) — ahead of Rust's 392 ms**, 2.6× faster - than Bun (915 ms), 3.4× faster than Node (1207 ms). Slight improvement - vs yesterday's v0.5.891 (365 → 354 ms); the bulk of the original arc - (2261 ms → ~377 ms, ~6×) landed during the v0.5.30–v0.5.495 perf sprint. -- **Allocation-heavy (JSON pipeline, 100 records):** Zig 35 ms, Rust 34 ms, - **Perry 39 ms (1.15× the fastest) — ahead of Bun's 51 ms and Node's 144 ms**, - at ~3 MB RSS vs Bun's 11 MB and Node's 36 MB. Stable vs v0.5.891. -- **JSON at scale (500k records, 108 MB):** Rust 608 ms, Bun 650 ms, Zig - 867 ms, Node 966 ms, **Perry 1098 ms**. Perry trails Rust/Bun by ~1.7×, - beats Node by 9%, and uses 731 MB peak RSS. The workload completes - reliably — as recently as v0.5.68 this hung >13 min CPU without - finishing (`#65`, now closed). Improved from v0.5.891's 1155 ms (-57 ms) - thanks in part to the v0.5.900 GC fix for #745. +- **Compute (image convolution, tight loop, minimal heap):** Zig 243 ms. + **Perry 268 ms (1.10× Zig) — ahead of Rust's 567 ms**, 3.4× faster than + Bun, 4.5× faster than Node. Full arc across the perf sprint: + **2261 ms → 268 ms, an 8.4× speedup** (issues #47, #48, #49, #50, #52 plus + the v0.5.58–v0.5.68 follow-on). +- **Allocation-heavy (JSON pipeline, 100 records):** Zig 32 ms, Rust 33 ms, + **Perry 37 ms (1.15× the fastest) — ahead of Bun's 49 ms and Node's 145 ms**, + at 3 MB RSS vs Bun's 11 MB and Node's 36 MB. Earlier sweep had Perry at + 210 ms here; v0.5.69–v0.5.75 closed ~6× of that. +- **JSON at scale (500k records, 108 MB):** Rust 604 ms, Bun 647 ms, Zig + 850 ms, Node 1010 ms, **Perry 1649 ms**. Perry trails the pack by ~2.5× + on wall time and uses more RSS (744 MB peak), but it _completes_ — as + recently as v0.5.68 this workload hung >13 min CPU without finishing + (`#65`, now closed). - **Binary size:** Zig smallest (~230 KB), Rust next (~300–380 KB), Perry (~550–700 KB, including GC + Node-compat shims). Node/Bun don't have standalone binaries — they require their runtime installed separately. @@ -36,13 +36,13 @@ Charts: [image convolution](charts/image_convolution.png), |---|---| | CPU | Apple M1 Max (10 cores, arm64) | | RAM | 64.0 GB | -| OS | macOS 26.4 (Darwin) | -| Rust | `rustc 1.94.1 (e408947bf 2026-03-25)` | +| OS | macOS 26.5 (Darwin) | +| Rust | `rustc 1.97.1 (8bab26f4f 2026-07-14)` | | Zig | `0.15.2` | -| Perry | `perry 0.5.908` | -| Python | `Python 3.14.4` | +| Perry | `perry 0.5.1279` | +| Python | `Python 3.14.6` | | Runs | 5 warmup + 20 measured, median reported | -| Generated | 2026-05-14T07:44:59.755910+00:00 | +| Generated | 2026-08-03T05:25:59.733855+00:00 | ## 3. Image convolution (5×5 Gaussian, 3840×2160 RGB) @@ -50,13 +50,13 @@ _In-memory input + output checksum (no PPM I/O) — see the workload README for | Language | Wall median (ms) | Wall σ | Peak RSS | Binary size | Source LoC | Runs OK | |---|---:|---:|---:|---:|---:|---:| -| rust | 392.1 | 3.8 | 48.5 MB | 295.5 KB | 112 | 20/20 | -| zig | 245.4 | 6.2 | 48.5 MB | 227.0 KB | 113 | 20/20 | -| perry | 354.0 | 2.3 | 49.9 MB | 966.6 KB | 92 | 20/20 | -| node | 1,206.6 | 22.0 | 86.5 MB | — | 86 | 20/20 | -| bun | 915.4 | 35.2 | 60.0 MB | — | 86 | 20/20 | +| rust | 406.4 | 2.0 | 48.9 MB | 295.5 KB | 112 | 20/20 | +| zig | 266.6 | 5.9 | 48.9 MB | 227.0 KB | 113 | 20/20 | +| perry | 278.8 | 4.7 | 56.0 MB | 4.3 MB | 92 | 20/20 | +| node | 1,232.2 | 3.3 | 117.9 MB | — | 86 | 20/20 | +| bun | 909.7 | 34.9 | 83.1 MB | — | 86 | 20/20 | -_Ratios vs fastest: rust = 1.60×, zig = 1.00×, perry = 1.44×, node = 4.92×, bun = 3.73×_ +_Ratios vs fastest: rust = 1.52×, zig = 1.00×, perry = 1.05×, node = 4.62×, bun = 3.41×_ ## 1a. JSON pipeline — small fixture (100 records, 21 KB) @@ -64,27 +64,27 @@ _All three languages produce byte-identical output at this scale (hash `7fc66fa8 | Language | Wall median (ms) | Wall σ | Peak RSS | Binary size | Source LoC | Runs OK | |---|---:|---:|---:|---:|---:|---:| -| rust | 34.1 | 1.1 | 1.2 MB | 376.3 KB | 99 | 20/20 | -| zig | 34.5 | 1.1 | 1.5 MB | 309.1 KB | 112 | 20/20 | -| perry | 39.2 | 1.2 | 3.5 MB | 1.0 MB | 52 | 20/20 | -| node | 143.6 | 1.8 | 36.1 MB | — | 40 | 20/20 | -| bun | 51.1 | 1.4 | 10.6 MB | — | 40 | 20/20 | +| rust | 59.4 | 1.9 | 1.7 MB | 360.2 KB | 99 | 20/20 | +| zig | 58.9 | 2.0 | 2.0 MB | 309.2 KB | 112 | 20/20 | +| perry | 64.1 | 3.1 | 8.5 MB | 4.3 MB | 52 | 20/20 | +| node | 110.6 | 2.4 | 64.2 MB | — | 40 | 20/20 | +| bun | 76.5 | 1.2 | 30.3 MB | — | 40 | 20/20 | -_Ratios vs fastest: rust = 1.00×, zig = 1.01×, perry = 1.15×, node = 4.21×, bun = 1.50×_ +_Ratios vs fastest: rust = 1.01×, zig = 1.00×, perry = 1.09×, node = 1.88×, bun = 1.30×_ ## 1b. JSON pipeline — full fixture (500k records, 108 MB) -_All five implementations complete this workload against the same 108 MB fixture and produce the same hash `b7e8a588`. Perry completes in ~1.1 s, ~1.8× the leader (Rust); as recently as v0.5.68 this workload hung >13 minutes without finishing (`#65`, now closed)._ +_All five implementations complete this workload against the same 108 MB fixture and produce the same hash `b7e8a588`. Perry completes in ~1.6 s, ~2.7× the leader (Rust / Bun); as recently as v0.5.68 this workload hung >13 minutes without finishing (`#65`, now closed)._ | Language | Wall median (ms) | Wall σ | Peak RSS | Binary size | Source LoC | Runs OK | |---|---:|---:|---:|---:|---:|---:| -| rust | 608.3 | 13.0 | 430.6 MB | 376.3 KB | 99 | 20/20 | -| zig | 867.4 | 19.4 | 576.8 MB | 309.1 KB | 112 | 20/20 | -| perry | 1,098.4 | 9.4 | 731.0 MB | 1.0 MB | 52 | 20/20 | -| node | 966.3 | 9.8 | 880.0 MB | — | 40 | 20/20 | -| bun | 649.9 | 14.7 | 593.7 MB | — | 40 | 20/20 | +| rust | 634.6 | 26.0 | 430.9 MB | 360.2 KB | 99 | 20/20 | +| zig | 839.8 | 13.3 | 576.9 MB | 309.2 KB | 112 | 20/20 | +| perry | 2,591.2 | 16.5 | 731.8 MB | 4.3 MB | 52 | 20/20 | +| node | 889.6 | 6.1 | 775.1 MB | — | 40 | 20/20 | +| bun | 570.3 | 2.9 | 579.8 MB | — | 40 | 20/20 | -_Ratios vs fastest: rust = 1.00×, zig = 1.43×, perry = 1.81×, node = 1.59×, bun = 1.07×_ +_Ratios vs fastest: rust = 1.11×, zig = 1.47×, perry = 4.54×, node = 1.56×, bun = 1.00×_ ## Honest findings — Perry gaps surfaced by this benchmark diff --git a/benchmarks/honest_bench/results/metadata.json b/benchmarks/honest_bench/results/metadata.json index 3d9673cc11..64f9a50249 100644 --- a/benchmarks/honest_bench/results/metadata.json +++ b/benchmarks/honest_bench/results/metadata.json @@ -1,22 +1,88 @@ { - "generated_at": "2026-05-14T07:44:59.755910+00:00", + "generated_at": "2026-08-03T05:25:59.733855+00:00", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", "host": { - "os_version": "26.4", - "kernel": "Darwin MacBook-Pro-69.local 25.4.0 Darwin Kernel Version 25.4.0: Thu Mar 19 19:30:44 PDT 2026; root:xnu-12377.101.15~1/RELEASE_ARM64_T6000 arm64", + "os_version": "26.5", + "kernel": "Darwin MacBookPro.fritz.box 25.5.0 Darwin Kernel Version 25.5.0: Mon Apr 27 20:38:56 PDT 2026; root:xnu-12377.121.6~2/RELEASE_ARM64_T6000 arm64", "arch": "arm64", "cpu": "Apple M1 Max", "ncpu": "10", "ram_gb": 64.0 }, "toolchains": { - "rustc": "rustc 1.94.1 (e408947bf 2026-03-25)", - "cargo": "cargo 1.94.1 (29ea6fb6a 2026-03-24)", + "rustc": "rustc 1.97.1 (8bab26f4f 2026-07-14)", + "cargo": "cargo 1.97.1 (c980f4866 2026-06-30)", "zig": "0.15.2", - "python": "Python 3.14.4", - "perry": "perry 0.5.908" + "python": "Python 3.14.6", + "node": "v22.23.1", + "bun": "1.3.14", + "oha": "", + "perry": "perry 0.5.1279" + }, + "executables": { + "perry": "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", + "node": "/Users/amlug/.cache/perry-bench-tools/bin/node", + "bun": "/Users/amlug/.cache/perry-bench-tools/bin/bun" }, "harness": { "warmup": 5, - "measured": 20 + "measured": 20, + "http_duration": "15s", + "http_warmup_duration": "5s", + "http_concurrency": 10 + }, + "commands": { + "perry": [ + "" + ], + "perry_compile": [ + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", + "", + "-o", + "" + ], + "node": [ + "/Users/amlug/.cache/perry-bench-tools/bin/node", + "--experimental-strip-types", + "" + ], + "bun": [ + "/Users/amlug/.cache/perry-bench-tools/bin/bun", + "run", + "" + ], + "perry_http": [ + "" + ], + "perry_http_compile": [ + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", + "", + "-o", + "" + ], + "node_http": [ + "node", + "--import", + "tsx", + "" + ], + "bun_http": [ + "bun", + "run", + "" + ], + "oha": [ + "/tmp/oha", + "-z", + "15s", + "-c", + "10", + "-r", + "0", + "--no-tui", + "--output-format", + "json", + "" + ] } } diff --git a/benchmarks/honest_bench/results/results.json b/benchmarks/honest_bench/results/results.json index cf803d2afa..0d54c87d6f 100644 --- a/benchmarks/honest_bench/results/results.json +++ b/benchmarks/honest_bench/results/results.json @@ -4,9 +4,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 1, - "wall_ms": 393.145542, - "max_rss_kb": 49696, + "wall_ms": 409.147834, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -17,9 +20,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 2, - "wall_ms": 399.731458, - "max_rss_kb": 49696, + "wall_ms": 406.319666, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -30,9 +36,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 3, - "wall_ms": 400.096792, - "max_rss_kb": 49696, + "wall_ms": 405.217709, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -43,9 +52,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 4, - "wall_ms": 390.64325, - "max_rss_kb": 49696, + "wall_ms": 405.549667, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -56,9 +68,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 5, - "wall_ms": 399.162125, - "max_rss_kb": 49696, + "wall_ms": 405.009084, + "max_rss_kb": 50080, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -69,9 +84,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 6, - "wall_ms": 398.947875, - "max_rss_kb": 49696, + "wall_ms": 407.405375, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -82,9 +100,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 7, - "wall_ms": 392.447417, - "max_rss_kb": 49696, + "wall_ms": 408.146584, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -95,9 +116,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 8, - "wall_ms": 394.653375, - "max_rss_kb": 49696, + "wall_ms": 411.825, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -108,9 +132,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 9, - "wall_ms": 393.478792, - "max_rss_kb": 49696, + "wall_ms": 410.356084, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -121,9 +148,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 10, - "wall_ms": 391.702916, - "max_rss_kb": 49696, + "wall_ms": 406.551666, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -134,9 +164,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 11, - "wall_ms": 391.024042, - "max_rss_kb": 49696, + "wall_ms": 405.959167, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -147,9 +180,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 12, - "wall_ms": 389.562375, - "max_rss_kb": 49696, + "wall_ms": 408.730166, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -160,9 +196,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 13, - "wall_ms": 389.620667, - "max_rss_kb": 49696, + "wall_ms": 407.714833, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -173,9 +212,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 14, - "wall_ms": 389.962917, - "max_rss_kb": 49696, + "wall_ms": 404.471542, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -186,9 +228,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 15, - "wall_ms": 394.127417, - "max_rss_kb": 49680, + "wall_ms": 407.036459, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -199,9 +244,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 16, - "wall_ms": 396.695875, - "max_rss_kb": 49696, + "wall_ms": 407.116667, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -212,9 +260,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 17, - "wall_ms": 390.569458, - "max_rss_kb": 49696, + "wall_ms": 405.767917, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -225,9 +276,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 18, - "wall_ms": 389.399166, - "max_rss_kb": 49696, + "wall_ms": 405.08325, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -238,9 +292,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 19, - "wall_ms": 389.244166, - "max_rss_kb": 49696, + "wall_ms": 405.470875, + "max_rss_kb": 50096, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -251,9 +308,12 @@ "workload": "image_convolution", "language": "rust", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/rust/target/release/image_conv" + ], "run": 20, - "wall_ms": 390.338, - "max_rss_kb": 49696, + "wall_ms": 404.660417, + "max_rss_kb": 50080, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -264,9 +324,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 1, - "wall_ms": 243.609125, - "max_rss_kb": 49648, + "wall_ms": 260.416958, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -277,9 +340,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 2, - "wall_ms": 245.780417, - "max_rss_kb": 49632, + "wall_ms": 260.358167, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -290,9 +356,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 3, - "wall_ms": 249.363, - "max_rss_kb": 49648, + "wall_ms": 260.20675, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -303,9 +372,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 4, - "wall_ms": 244.298041, - "max_rss_kb": 49648, + "wall_ms": 259.1155, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -316,9 +388,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 5, - "wall_ms": 268.891042, - "max_rss_kb": 49648, + "wall_ms": 261.268041, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -329,9 +404,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 6, - "wall_ms": 241.854417, - "max_rss_kb": 49632, + "wall_ms": 273.542583, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -342,9 +420,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 7, - "wall_ms": 240.314875, - "max_rss_kb": 49648, + "wall_ms": 267.803584, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -355,9 +436,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 8, - "wall_ms": 241.26875, - "max_rss_kb": 49648, + "wall_ms": 274.128625, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -368,9 +452,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 9, - "wall_ms": 247.123666, - "max_rss_kb": 49648, + "wall_ms": 267.758875, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -381,9 +468,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 10, - "wall_ms": 241.813292, - "max_rss_kb": 49648, + "wall_ms": 270.093584, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -394,9 +484,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 11, - "wall_ms": 244.244292, - "max_rss_kb": 49648, + "wall_ms": 272.65825, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -407,9 +500,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 12, - "wall_ms": 241.267375, - "max_rss_kb": 49632, + "wall_ms": 268.7885, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -420,9 +516,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 13, - "wall_ms": 245.117666, - "max_rss_kb": 49632, + "wall_ms": 268.62575, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -433,9 +532,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 14, - "wall_ms": 247.102291, - "max_rss_kb": 49632, + "wall_ms": 265.07075, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -446,9 +548,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 15, - "wall_ms": 244.966333, - "max_rss_kb": 49648, + "wall_ms": 265.755916, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -459,9 +564,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 16, - "wall_ms": 246.73175, - "max_rss_kb": 49648, + "wall_ms": 262.162667, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -472,9 +580,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 17, - "wall_ms": 248.459209, - "max_rss_kb": 49632, + "wall_ms": 261.343792, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -485,9 +596,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 18, - "wall_ms": 250.455833, - "max_rss_kb": 49632, + "wall_ms": 267.349167, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -498,9 +612,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 19, - "wall_ms": 249.686875, - "max_rss_kb": 49648, + "wall_ms": 261.392084, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -511,9 +628,12 @@ "workload": "image_convolution", "language": "zig", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/zig/zig-out/bin/image_conv" + ], "run": 20, - "wall_ms": 251.848959, - "max_rss_kb": 49648, + "wall_ms": 281.362125, + "max_rss_kb": 50032, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -524,9 +644,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 1, - "wall_ms": 353.905792, - "max_rss_kb": 51120, + "wall_ms": 276.567417, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -537,9 +660,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 2, - "wall_ms": 352.935666, - "max_rss_kb": 51120, + "wall_ms": 276.578, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -550,9 +676,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 3, - "wall_ms": 354.9005, - "max_rss_kb": 51152, + "wall_ms": 279.139125, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -563,9 +692,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 4, - "wall_ms": 357.990375, - "max_rss_kb": 51152, + "wall_ms": 278.086917, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -576,9 +708,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 5, - "wall_ms": 357.113875, - "max_rss_kb": 51120, + "wall_ms": 283.254834, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -589,9 +724,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 6, - "wall_ms": 358.15725, - "max_rss_kb": 51120, + "wall_ms": 278.398834, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -602,9 +740,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 7, - "wall_ms": 353.61225, - "max_rss_kb": 51168, + "wall_ms": 288.628292, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -615,9 +756,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 8, - "wall_ms": 352.534125, - "max_rss_kb": 51120, + "wall_ms": 284.261625, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -628,9 +772,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 9, - "wall_ms": 357.191709, - "max_rss_kb": 51152, + "wall_ms": 286.069375, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -641,9 +788,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 10, - "wall_ms": 353.946, - "max_rss_kb": 51152, + "wall_ms": 288.061125, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -654,9 +804,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 11, - "wall_ms": 350.160959, - "max_rss_kb": 51120, + "wall_ms": 282.857583, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -667,9 +820,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 12, - "wall_ms": 354.893334, - "max_rss_kb": 51136, + "wall_ms": 283.008708, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -680,9 +836,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 13, - "wall_ms": 353.3355, - "max_rss_kb": 51120, + "wall_ms": 278.262375, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -693,9 +852,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 14, - "wall_ms": 355.724917, - "max_rss_kb": 51120, + "wall_ms": 278.460458, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -706,9 +868,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 15, - "wall_ms": 355.270875, - "max_rss_kb": 51120, + "wall_ms": 276.023833, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -719,9 +884,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 16, - "wall_ms": 350.367584, - "max_rss_kb": 51120, + "wall_ms": 279.091125, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -732,9 +900,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 17, - "wall_ms": 354.485458, - "max_rss_kb": 51168, + "wall_ms": 290.197792, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -745,9 +916,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 18, - "wall_ms": 352.368583, - "max_rss_kb": 51120, + "wall_ms": 275.7535, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -758,9 +932,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 19, - "wall_ms": 354.07075, - "max_rss_kb": 51152, + "wall_ms": 277.823292, + "max_rss_kb": 57360, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -771,9 +948,12 @@ "workload": "image_convolution", "language": "perry", "binary": "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv", + "command": [ + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + ], "run": 20, - "wall_ms": 350.738875, - "max_rss_kb": 51120, + "wall_ms": 275.293, + "max_rss_kb": 57344, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -783,10 +963,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 1, - "wall_ms": 1206.10775, - "max_rss_kb": 87090, + "wall_ms": 1231.628875, + "max_rss_kb": 120672, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -796,10 +982,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 2, - "wall_ms": 1212.712583, - "max_rss_kb": 90658, + "wall_ms": 1231.856458, + "max_rss_kb": 120768, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -809,10 +1001,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 3, - "wall_ms": 1205.088583, - "max_rss_kb": 87266, + "wall_ms": 1231.788958, + "max_rss_kb": 120720, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -822,10 +1020,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 4, - "wall_ms": 1210.553416, - "max_rss_kb": 87410, + "wall_ms": 1237.020875, + "max_rss_kb": 120720, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -835,10 +1039,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 5, - "wall_ms": 1202.203375, - "max_rss_kb": 88578, + "wall_ms": 1232.6435, + "max_rss_kb": 120720, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -848,10 +1058,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 6, - "wall_ms": 1213.827875, - "max_rss_kb": 90034, + "wall_ms": 1231.673041, + "max_rss_kb": 120528, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -861,10 +1077,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 7, - "wall_ms": 1211.120958, - "max_rss_kb": 87138, + "wall_ms": 1233.081417, + "max_rss_kb": 120704, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -874,10 +1096,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 8, - "wall_ms": 1205.231958, - "max_rss_kb": 90594, + "wall_ms": 1234.069708, + "max_rss_kb": 120768, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -887,10 +1115,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 9, - "wall_ms": 1209.958959, - "max_rss_kb": 87122, + "wall_ms": 1228.575833, + "max_rss_kb": 120688, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -900,10 +1134,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 10, - "wall_ms": 1207.029875, - "max_rss_kb": 90626, + "wall_ms": 1234.768459, + "max_rss_kb": 120688, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -913,10 +1153,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 11, - "wall_ms": 1207.174208, - "max_rss_kb": 88594, + "wall_ms": 1233.776833, + "max_rss_kb": 120800, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -926,10 +1172,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 12, - "wall_ms": 1217.714416, - "max_rss_kb": 90402, + "wall_ms": 1239.754833, + "max_rss_kb": 120688, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -939,10 +1191,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 13, - "wall_ms": 1302.91025, - "max_rss_kb": 87410, + "wall_ms": 1240.383584, + "max_rss_kb": 120800, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -952,10 +1210,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 14, - "wall_ms": 1200.852625, - "max_rss_kb": 87234, + "wall_ms": 1228.644333, + "max_rss_kb": 120800, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -965,10 +1229,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 15, - "wall_ms": 1206.205083, - "max_rss_kb": 87330, + "wall_ms": 1231.665417, + "max_rss_kb": 120496, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -978,10 +1248,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 16, - "wall_ms": 1215.850292, - "max_rss_kb": 90610, + "wall_ms": 1235.899708, + "max_rss_kb": 120832, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -991,10 +1267,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 17, - "wall_ms": 1197.882291, - "max_rss_kb": 90354, + "wall_ms": 1233.7075, + "max_rss_kb": 120976, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1004,10 +1286,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 18, - "wall_ms": 1202.314584, - "max_rss_kb": 89074, + "wall_ms": 1230.914833, + "max_rss_kb": 120800, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1017,10 +1305,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 19, - "wall_ms": 1205.347667, - "max_rss_kb": 88610, + "wall_ms": 1231.7945, + "max_rss_kb": 120720, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1030,10 +1324,16 @@ { "workload": "image_convolution", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 20, - "wall_ms": 1201.450417, - "max_rss_kb": 88546, + "wall_ms": 1227.493166, + "max_rss_kb": 120544, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1043,10 +1343,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 1, - "wall_ms": 977.446, - "max_rss_kb": 61648, + "wall_ms": 925.063, + "max_rss_kb": 85264, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1056,10 +1361,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 2, - "wall_ms": 885.194667, - "max_rss_kb": 61504, + "wall_ms": 908.066625, + "max_rss_kb": 85136, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1069,10 +1379,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 3, - "wall_ms": 882.944083, - "max_rss_kb": 61440, + "wall_ms": 872.349667, + "max_rss_kb": 84976, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1082,10 +1397,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 4, - "wall_ms": 916.662791, - "max_rss_kb": 61392, + "wall_ms": 907.244583, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1095,10 +1415,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 5, - "wall_ms": 879.058958, - "max_rss_kb": 61568, + "wall_ms": 913.362958, + "max_rss_kb": 85136, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1108,10 +1433,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 6, - "wall_ms": 914.18375, - "max_rss_kb": 61472, + "wall_ms": 904.167459, + "max_rss_kb": 85136, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1121,10 +1451,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 7, - "wall_ms": 939.630125, - "max_rss_kb": 61760, + "wall_ms": 902.129375, + "max_rss_kb": 85088, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1134,10 +1469,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 8, - "wall_ms": 921.808083, - "max_rss_kb": 61472, + "wall_ms": 904.128, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1147,10 +1487,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 9, - "wall_ms": 996.723708, - "max_rss_kb": 62256, + "wall_ms": 870.287583, + "max_rss_kb": 85056, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1160,10 +1505,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 10, - "wall_ms": 912.272917, - "max_rss_kb": 61456, + "wall_ms": 1039.200667, + "max_rss_kb": 85248, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1173,10 +1523,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 11, - "wall_ms": 876.330292, - "max_rss_kb": 61456, + "wall_ms": 870.899917, + "max_rss_kb": 85072, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1186,10 +1541,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 12, - "wall_ms": 916.768333, - "max_rss_kb": 61712, + "wall_ms": 923.231083, + "max_rss_kb": 85152, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1199,10 +1559,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 13, - "wall_ms": 910.497875, - "max_rss_kb": 61392, + "wall_ms": 911.051625, + "max_rss_kb": 85056, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1212,10 +1577,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 14, - "wall_ms": 883.137125, - "max_rss_kb": 61744, + "wall_ms": 918.951959, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1225,10 +1595,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 15, - "wall_ms": 913.648917, - "max_rss_kb": 61456, + "wall_ms": 926.158, + "max_rss_kb": 85056, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1238,10 +1613,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 16, - "wall_ms": 923.645208, - "max_rss_kb": 61760, + "wall_ms": 924.485625, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1251,10 +1631,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 17, - "wall_ms": 931.416667, - "max_rss_kb": 61328, + "wall_ms": 883.202708, + "max_rss_kb": 84960, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1264,10 +1649,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 18, - "wall_ms": 997.125042, - "max_rss_kb": 62032, + "wall_ms": 909.644292, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1277,10 +1667,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 19, - "wall_ms": 911.519041, - "max_rss_kb": 61360, + "wall_ms": 924.097042, + "max_rss_kb": 85104, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1290,10 +1685,15 @@ { "workload": "image_convolution", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + ], "run": 20, - "wall_ms": 919.470709, - "max_rss_kb": 61616, + "wall_ms": 909.704125, + "max_rss_kb": 85120, "exit_code": 0, "stdout_first": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", "stdout_last": "checksum=2ba2e053 dims=3840x2160 bytes=24883200", @@ -1304,9 +1704,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 1, - "wall_ms": 34.952917, - "max_rss_kb": 1184, + "wall_ms": 58.006375, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1317,9 +1722,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 2, - "wall_ms": 34.2765, - "max_rss_kb": 1184, + "wall_ms": 59.358709, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1330,9 +1740,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 3, - "wall_ms": 36.259458, - "max_rss_kb": 1168, + "wall_ms": 59.45675, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1343,9 +1758,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 4, - "wall_ms": 34.075375, - "max_rss_kb": 1184, + "wall_ms": 61.393, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1356,9 +1776,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 5, - "wall_ms": 33.190083, - "max_rss_kb": 1184, + "wall_ms": 57.858542, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1369,9 +1794,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 6, - "wall_ms": 35.027416, - "max_rss_kb": 1184, + "wall_ms": 61.306125, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1382,9 +1812,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 7, - "wall_ms": 35.046708, - "max_rss_kb": 1184, + "wall_ms": 60.141583, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1395,9 +1830,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 8, - "wall_ms": 32.711709, - "max_rss_kb": 1184, + "wall_ms": 58.952292, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1408,9 +1848,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 9, - "wall_ms": 33.6715, - "max_rss_kb": 1168, + "wall_ms": 59.869042, + "max_rss_kb": 1728, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1421,9 +1866,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 10, - "wall_ms": 33.941083, - "max_rss_kb": 1168, + "wall_ms": 59.924041, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1434,9 +1884,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 11, - "wall_ms": 32.825083, - "max_rss_kb": 1184, + "wall_ms": 59.008417, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1447,9 +1902,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 12, - "wall_ms": 33.327042, - "max_rss_kb": 1184, + "wall_ms": 61.548708, + "max_rss_kb": 1728, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1460,9 +1920,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 13, - "wall_ms": 33.789958, - "max_rss_kb": 1168, + "wall_ms": 58.204875, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1473,9 +1938,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 14, - "wall_ms": 34.544792, - "max_rss_kb": 1168, + "wall_ms": 58.977875, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1486,9 +1956,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 15, - "wall_ms": 36.450709, - "max_rss_kb": 1184, + "wall_ms": 60.611416, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1499,9 +1974,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 16, - "wall_ms": 34.217875, - "max_rss_kb": 1168, + "wall_ms": 59.513208, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1512,9 +1992,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 17, - "wall_ms": 33.518084, - "max_rss_kb": 1184, + "wall_ms": 58.752958, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1525,9 +2010,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 18, - "wall_ms": 34.189833, - "max_rss_kb": 1184, + "wall_ms": 57.759875, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1538,9 +2028,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 19, - "wall_ms": 35.79525, - "max_rss_kb": 1184, + "wall_ms": 59.187125, + "max_rss_kb": 1728, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1551,9 +2046,14 @@ "workload": "json_pipeline_small", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_rust.json" + ], "run": 20, - "wall_ms": 33.690208, - "max_rss_kb": 1184, + "wall_ms": 66.160417, + "max_rss_kb": 1744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1564,9 +2064,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 1, - "wall_ms": 32.702084, - "max_rss_kb": 1520, + "wall_ms": 60.851458, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1577,9 +2082,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 2, - "wall_ms": 32.95725, - "max_rss_kb": 1536, + "wall_ms": 58.717459, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1590,9 +2100,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 3, - "wall_ms": 35.187042, - "max_rss_kb": 1536, + "wall_ms": 58.922, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1603,9 +2118,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 4, - "wall_ms": 34.697709, - "max_rss_kb": 1536, + "wall_ms": 59.23975, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1616,9 +2136,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 5, - "wall_ms": 32.767709, - "max_rss_kb": 1520, + "wall_ms": 58.893542, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1629,9 +2154,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 6, - "wall_ms": 34.482292, - "max_rss_kb": 1520, + "wall_ms": 58.214125, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1642,9 +2172,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 7, - "wall_ms": 33.74825, - "max_rss_kb": 1536, + "wall_ms": 60.675542, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1655,9 +2190,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 8, - "wall_ms": 32.675959, - "max_rss_kb": 1536, + "wall_ms": 57.561416, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1668,9 +2208,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 9, - "wall_ms": 32.843584, - "max_rss_kb": 1536, + "wall_ms": 58.473834, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1681,9 +2226,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 10, - "wall_ms": 34.443583, - "max_rss_kb": 1520, + "wall_ms": 62.286417, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1694,9 +2244,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 11, - "wall_ms": 34.460292, - "max_rss_kb": 1520, + "wall_ms": 58.71775, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1707,9 +2262,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 12, - "wall_ms": 37.253334, - "max_rss_kb": 1520, + "wall_ms": 59.521625, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1720,9 +2280,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 13, - "wall_ms": 34.396792, - "max_rss_kb": 1520, + "wall_ms": 59.265042, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1733,9 +2298,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 14, - "wall_ms": 35.454459, - "max_rss_kb": 1536, + "wall_ms": 58.347666, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1746,9 +2316,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 15, - "wall_ms": 34.475125, - "max_rss_kb": 1536, + "wall_ms": 58.885916, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1759,9 +2334,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 16, - "wall_ms": 34.593709, - "max_rss_kb": 1536, + "wall_ms": 66.080292, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1772,9 +2352,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 17, - "wall_ms": 33.509041, - "max_rss_kb": 1520, + "wall_ms": 62.778375, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1785,9 +2370,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 18, - "wall_ms": 34.916417, - "max_rss_kb": 1520, + "wall_ms": 59.567917, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1798,9 +2388,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 19, - "wall_ms": 34.8765, - "max_rss_kb": 1520, + "wall_ms": 58.632, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1811,9 +2406,14 @@ "workload": "json_pipeline_small", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_zig.json" + ], "run": 20, - "wall_ms": 34.490917, - "max_rss_kb": 1520, + "wall_ms": 57.994542, + "max_rss_kb": 2048, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1824,9 +2424,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 1, - "wall_ms": 38.32375, - "max_rss_kb": 3632, + "wall_ms": 74.484541, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1837,9 +2442,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 2, - "wall_ms": 39.518875, - "max_rss_kb": 3632, + "wall_ms": 72.373792, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1850,9 +2460,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 3, - "wall_ms": 40.58725, - "max_rss_kb": 3632, + "wall_ms": 63.763583, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1863,9 +2478,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 4, - "wall_ms": 38.416333, - "max_rss_kb": 3632, + "wall_ms": 66.528208, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1876,9 +2496,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 5, - "wall_ms": 37.675625, - "max_rss_kb": 3664, + "wall_ms": 63.400125, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1889,9 +2514,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 6, - "wall_ms": 38.730541, - "max_rss_kb": 3648, + "wall_ms": 64.811667, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1902,9 +2532,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 7, - "wall_ms": 38.265375, - "max_rss_kb": 3648, + "wall_ms": 61.802875, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1915,9 +2550,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 8, - "wall_ms": 38.861875, - "max_rss_kb": 3648, + "wall_ms": 63.018875, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1928,9 +2568,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 9, - "wall_ms": 39.309917, - "max_rss_kb": 3632, + "wall_ms": 66.304709, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1941,9 +2586,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 10, - "wall_ms": 39.232834, - "max_rss_kb": 3632, + "wall_ms": 63.41575, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1954,9 +2604,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 11, - "wall_ms": 39.7595, - "max_rss_kb": 3632, + "wall_ms": 64.049834, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1967,9 +2622,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 12, - "wall_ms": 43.094833, - "max_rss_kb": 3648, + "wall_ms": 67.898083, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1980,9 +2640,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 13, - "wall_ms": 39.386041, - "max_rss_kb": 3648, + "wall_ms": 63.95725, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -1993,9 +2658,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 14, - "wall_ms": 39.651083, - "max_rss_kb": 3632, + "wall_ms": 63.971458, + "max_rss_kb": 8704, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2006,9 +2676,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 15, - "wall_ms": 39.739958, - "max_rss_kb": 3632, + "wall_ms": 64.484, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2019,9 +2694,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 16, - "wall_ms": 38.731791, - "max_rss_kb": 3648, + "wall_ms": 63.880208, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2032,9 +2712,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 17, - "wall_ms": 38.625459, - "max_rss_kb": 3632, + "wall_ms": 64.398208, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2045,9 +2730,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 18, - "wall_ms": 37.813625, - "max_rss_kb": 3632, + "wall_ms": 63.658416, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2058,9 +2748,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 19, - "wall_ms": 41.030292, - "max_rss_kb": 3632, + "wall_ms": 64.195375, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2071,9 +2766,14 @@ "workload": "json_pipeline_small", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" + ], "run": 20, - "wall_ms": 39.108709, - "max_rss_kb": 3632, + "wall_ms": 65.641834, + "max_rss_kb": 8688, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2083,10 +2783,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 1, - "wall_ms": 145.082458, - "max_rss_kb": 39314, + "wall_ms": 114.376583, + "max_rss_kb": 65824, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2096,10 +2804,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 2, - "wall_ms": 143.340833, - "max_rss_kb": 36754, + "wall_ms": 109.124917, + "max_rss_kb": 65728, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2109,10 +2825,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 3, - "wall_ms": 144.099417, - "max_rss_kb": 35682, + "wall_ms": 109.219042, + "max_rss_kb": 65632, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2122,10 +2846,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 4, - "wall_ms": 142.78675, - "max_rss_kb": 37810, + "wall_ms": 109.8325, + "max_rss_kb": 65776, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2135,10 +2867,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 5, - "wall_ms": 142.080334, - "max_rss_kb": 36370, + "wall_ms": 111.078125, + "max_rss_kb": 65856, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2148,10 +2888,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 6, - "wall_ms": 143.064667, - "max_rss_kb": 35810, + "wall_ms": 110.178959, + "max_rss_kb": 65728, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2161,10 +2909,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 7, - "wall_ms": 143.203833, - "max_rss_kb": 37746, + "wall_ms": 108.106375, + "max_rss_kb": 65840, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2174,10 +2930,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 8, - "wall_ms": 144.196208, - "max_rss_kb": 36050, + "wall_ms": 114.425166, + "max_rss_kb": 65808, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2187,10 +2951,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 9, - "wall_ms": 145.091417, - "max_rss_kb": 36146, + "wall_ms": 111.40575, + "max_rss_kb": 65648, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2200,10 +2972,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 10, - "wall_ms": 149.108625, - "max_rss_kb": 37730, + "wall_ms": 109.001541, + "max_rss_kb": 65760, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2213,10 +2993,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 11, - "wall_ms": 143.919375, - "max_rss_kb": 36098, + "wall_ms": 109.845916, + "max_rss_kb": 66160, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2226,10 +3014,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 12, - "wall_ms": 144.761667, - "max_rss_kb": 37906, + "wall_ms": 111.87775, + "max_rss_kb": 65792, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2239,10 +3035,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 13, - "wall_ms": 144.837333, - "max_rss_kb": 37906, + "wall_ms": 111.882375, + "max_rss_kb": 65872, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2252,10 +3056,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 14, - "wall_ms": 143.857375, - "max_rss_kb": 37585, + "wall_ms": 111.566417, + "max_rss_kb": 65744, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2265,10 +3077,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 15, - "wall_ms": 141.493333, - "max_rss_kb": 36866, + "wall_ms": 109.949916, + "max_rss_kb": 65776, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2278,10 +3098,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 16, - "wall_ms": 142.255083, - "max_rss_kb": 36114, + "wall_ms": 110.031375, + "max_rss_kb": 65600, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2291,10 +3119,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 17, - "wall_ms": 141.976166, - "max_rss_kb": 38913, + "wall_ms": 111.129375, + "max_rss_kb": 65712, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2304,10 +3140,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 18, - "wall_ms": 143.825708, - "max_rss_kb": 35970, + "wall_ms": 117.884375, + "max_rss_kb": 65648, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2317,10 +3161,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 19, - "wall_ms": 140.390125, - "max_rss_kb": 37122, + "wall_ms": 114.042875, + "max_rss_kb": 65760, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2330,10 +3182,18 @@ { "workload": "json_pipeline_small", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" + ], "run": 20, - "wall_ms": 143.354083, - "max_rss_kb": 37842, + "wall_ms": 109.632333, + "max_rss_kb": 65648, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2343,10 +3203,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 1, - "wall_ms": 49.903875, - "max_rss_kb": 10832, + "wall_ms": 76.791542, + "max_rss_kb": 31120, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2356,10 +3223,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 2, - "wall_ms": 51.3185, - "max_rss_kb": 10848, + "wall_ms": 76.54475, + "max_rss_kb": 31120, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2369,10 +3243,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 3, - "wall_ms": 51.658417, - "max_rss_kb": 10816, + "wall_ms": 78.537875, + "max_rss_kb": 30960, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2382,10 +3263,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 4, - "wall_ms": 51.989667, - "max_rss_kb": 10800, + "wall_ms": 75.875625, + "max_rss_kb": 31024, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2395,10 +3283,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 5, - "wall_ms": 49.75, - "max_rss_kb": 10816, + "wall_ms": 77.474875, + "max_rss_kb": 31072, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2408,10 +3303,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 6, - "wall_ms": 52.267292, - "max_rss_kb": 10864, + "wall_ms": 75.874542, + "max_rss_kb": 31024, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2421,10 +3323,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 7, - "wall_ms": 50.136416, - "max_rss_kb": 10800, + "wall_ms": 77.070417, + "max_rss_kb": 31072, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2434,10 +3343,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 8, - "wall_ms": 51.464542, - "max_rss_kb": 10832, + "wall_ms": 77.074125, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2447,10 +3363,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 9, - "wall_ms": 49.678125, - "max_rss_kb": 10880, + "wall_ms": 77.01825, + "max_rss_kb": 31760, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2460,10 +3383,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 10, - "wall_ms": 49.480833, - "max_rss_kb": 10832, + "wall_ms": 76.444833, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2473,10 +3403,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 11, - "wall_ms": 49.999458, - "max_rss_kb": 10864, + "wall_ms": 75.430375, + "max_rss_kb": 30960, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2486,10 +3423,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 12, - "wall_ms": 53.987, - "max_rss_kb": 10832, + "wall_ms": 75.753958, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2499,10 +3443,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 13, - "wall_ms": 50.086625, - "max_rss_kb": 10880, + "wall_ms": 75.587, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2512,10 +3463,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 14, - "wall_ms": 51.824916, - "max_rss_kb": 10848, + "wall_ms": 75.806875, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2525,10 +3483,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 15, - "wall_ms": 51.8455, - "max_rss_kb": 10832, + "wall_ms": 77.589, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2538,10 +3503,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 16, - "wall_ms": 52.428583, - "max_rss_kb": 10880, + "wall_ms": 76.401875, + "max_rss_kb": 31040, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2551,10 +3523,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 17, - "wall_ms": 53.90225, - "max_rss_kb": 10928, + "wall_ms": 79.846625, + "max_rss_kb": 31984, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2564,10 +3543,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 18, - "wall_ms": 49.00075, - "max_rss_kb": 10816, + "wall_ms": 75.48775, + "max_rss_kb": 31088, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2577,10 +3563,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 19, - "wall_ms": 50.662875, - "max_rss_kb": 10816, + "wall_ms": 78.423583, + "max_rss_kb": 31056, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2590,10 +3583,17 @@ { "workload": "json_pipeline_small", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" + ], "run": 20, - "wall_ms": 50.818208, - "max_rss_kb": 10800, + "wall_ms": 75.915708, + "max_rss_kb": 30976, "exit_code": 0, "stdout_first": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", "stdout_last": "input_bytes=21671 records_in=100 records_out=56 output_bytes=14841 hash=7fc66fa8", @@ -2604,9 +3604,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 1, - "wall_ms": 601.8995, - "max_rss_kb": 442352, + "wall_ms": 643.612542, + "max_rss_kb": 441184, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2617,9 +3622,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 2, - "wall_ms": 602.069167, - "max_rss_kb": 438720, + "wall_ms": 646.458167, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2630,9 +3640,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 3, - "wall_ms": 605.726, - "max_rss_kb": 440912, + "wall_ms": 653.629334, + "max_rss_kb": 441216, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2643,9 +3658,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 4, - "wall_ms": 609.582209, - "max_rss_kb": 438336, + "wall_ms": 634.611, + "max_rss_kb": 441184, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2656,9 +3676,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 5, - "wall_ms": 660.508334, - "max_rss_kb": 442656, + "wall_ms": 644.023416, + "max_rss_kb": 441216, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2669,9 +3694,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 6, - "wall_ms": 607.789875, - "max_rss_kb": 440896, + "wall_ms": 637.132583, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2682,9 +3712,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 7, - "wall_ms": 608.638291, - "max_rss_kb": 442672, + "wall_ms": 639.018042, + "max_rss_kb": 441216, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2695,9 +3730,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 8, - "wall_ms": 610.796208, - "max_rss_kb": 442336, + "wall_ms": 649.633916, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2708,9 +3748,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 9, - "wall_ms": 599.539584, - "max_rss_kb": 442672, + "wall_ms": 637.822583, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2721,9 +3766,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 10, - "wall_ms": 607.225125, - "max_rss_kb": 440880, + "wall_ms": 608.969667, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2734,9 +3784,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 11, - "wall_ms": 602.323208, - "max_rss_kb": 442672, + "wall_ms": 588.763666, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2747,9 +3802,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 12, - "wall_ms": 611.593584, - "max_rss_kb": 440896, + "wall_ms": 634.605792, + "max_rss_kb": 441232, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2760,9 +3820,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 13, - "wall_ms": 612.353416, - "max_rss_kb": 438704, + "wall_ms": 636.595042, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2773,9 +3838,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 14, - "wall_ms": 607.287, - "max_rss_kb": 442672, + "wall_ms": 628.359083, + "max_rss_kb": 441216, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2786,9 +3856,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 15, - "wall_ms": 621.74625, - "max_rss_kb": 442400, + "wall_ms": 594.025084, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2799,9 +3874,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 16, - "wall_ms": 621.437833, - "max_rss_kb": 438704, + "wall_ms": 586.549375, + "max_rss_kb": 441232, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2812,9 +3892,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 17, - "wall_ms": 607.873708, - "max_rss_kb": 442352, + "wall_ms": 585.509958, + "max_rss_kb": 441232, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2825,9 +3910,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 18, - "wall_ms": 608.823792, - "max_rss_kb": 440928, + "wall_ms": 581.331333, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2838,9 +3928,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 19, - "wall_ms": 612.654292, - "max_rss_kb": 438432, + "wall_ms": 586.388083, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2851,9 +3946,14 @@ "workload": "json_pipeline_full", "language": "rust", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/rust/target/release/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_rust.json" + ], "run": 20, - "wall_ms": 603.127417, - "max_rss_kb": 436960, + "wall_ms": 596.657, + "max_rss_kb": 441200, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2864,9 +3964,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 1, - "wall_ms": 921.030208, - "max_rss_kb": 590608, + "wall_ms": 870.420458, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2877,9 +3982,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 2, - "wall_ms": 860.017666, - "max_rss_kb": 590608, + "wall_ms": 856.692542, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2890,9 +4000,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 3, - "wall_ms": 863.431666, - "max_rss_kb": 590624, + "wall_ms": 840.790167, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2903,9 +4018,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 4, - "wall_ms": 870.846875, - "max_rss_kb": 590608, + "wall_ms": 848.04425, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2916,9 +4036,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 5, - "wall_ms": 875.882416, - "max_rss_kb": 590624, + "wall_ms": 867.949709, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2929,9 +4054,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 6, - "wall_ms": 868.164917, - "max_rss_kb": 590624, + "wall_ms": 865.201916, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2942,9 +4072,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 7, - "wall_ms": 870.474375, - "max_rss_kb": 590608, + "wall_ms": 840.039333, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2955,9 +4090,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 8, - "wall_ms": 932.23875, - "max_rss_kb": 590608, + "wall_ms": 843.82425, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2968,9 +4108,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 9, - "wall_ms": 864.806708, - "max_rss_kb": 590624, + "wall_ms": 840.262542, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2981,9 +4126,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 10, - "wall_ms": 862.333083, - "max_rss_kb": 590608, + "wall_ms": 839.118542, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -2994,9 +4144,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 11, - "wall_ms": 865.232209, - "max_rss_kb": 590608, + "wall_ms": 839.281958, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3007,9 +4162,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 12, - "wall_ms": 872.025042, - "max_rss_kb": 590608, + "wall_ms": 839.480333, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3020,9 +4180,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 13, - "wall_ms": 868.595417, - "max_rss_kb": 590608, + "wall_ms": 839.15775, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3033,9 +4198,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 14, - "wall_ms": 863.729042, - "max_rss_kb": 590592, + "wall_ms": 829.836458, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3046,9 +4216,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 15, - "wall_ms": 865.995625, - "max_rss_kb": 590624, + "wall_ms": 831.986792, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3059,9 +4234,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 16, - "wall_ms": 868.087834, - "max_rss_kb": 590624, + "wall_ms": 832.107333, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3072,9 +4252,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 17, - "wall_ms": 865.841083, - "max_rss_kb": 590624, + "wall_ms": 829.011916, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3085,9 +4270,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 18, - "wall_ms": 866.776833, - "max_rss_kb": 590592, + "wall_ms": 821.211292, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3098,9 +4288,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 19, - "wall_ms": 866.140667, - "max_rss_kb": 590624, + "wall_ms": 831.947167, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3111,9 +4306,14 @@ "workload": "json_pipeline_full", "language": "zig", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/zig/zig-out/bin/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_zig.json" + ], "run": 20, - "wall_ms": 895.654292, - "max_rss_kb": 590624, + "wall_ms": 845.108084, + "max_rss_kb": 590704, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3124,9 +4324,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 1, - "wall_ms": 1091.640917, - "max_rss_kb": 748513, + "wall_ms": 2598.6255, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3137,9 +4342,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 2, - "wall_ms": 1100.503541, - "max_rss_kb": 748513, + "wall_ms": 2594.918375, + "max_rss_kb": 749312, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3150,9 +4360,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 3, - "wall_ms": 1105.45, - "max_rss_kb": 748513, + "wall_ms": 2601.07225, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3163,9 +4378,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 4, - "wall_ms": 1126.517917, - "max_rss_kb": 748529, + "wall_ms": 2583.418, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3176,9 +4396,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 5, - "wall_ms": 1100.768417, - "max_rss_kb": 748529, + "wall_ms": 2598.241541, + "max_rss_kb": 749312, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3189,9 +4414,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 6, - "wall_ms": 1097.905375, - "max_rss_kb": 748529, + "wall_ms": 2591.548125, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3202,9 +4432,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 7, - "wall_ms": 1090.236125, - "max_rss_kb": 748513, + "wall_ms": 2660.178292, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3215,9 +4450,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 8, - "wall_ms": 1098.249208, - "max_rss_kb": 748513, + "wall_ms": 2595.250834, + "max_rss_kb": 749312, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3228,9 +4468,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 9, - "wall_ms": 1098.499125, - "max_rss_kb": 748529, + "wall_ms": 2585.578375, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3241,9 +4486,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 10, - "wall_ms": 1096.985834, - "max_rss_kb": 748513, + "wall_ms": 2585.214458, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3254,9 +4504,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 11, - "wall_ms": 1098.672792, - "max_rss_kb": 748513, + "wall_ms": 2589.28175, + "max_rss_kb": 749312, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3267,9 +4522,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 12, - "wall_ms": 1093.523459, - "max_rss_kb": 748513, + "wall_ms": 2599.656791, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3280,9 +4540,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 13, - "wall_ms": 1107.960791, - "max_rss_kb": 748513, + "wall_ms": 2599.879792, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3293,9 +4558,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 14, - "wall_ms": 1093.430417, - "max_rss_kb": 748513, + "wall_ms": 2589.810291, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3306,9 +4576,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 15, - "wall_ms": 1091.401333, - "max_rss_kb": 748513, + "wall_ms": 2605.305875, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3319,9 +4594,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 16, - "wall_ms": 1095.222167, - "max_rss_kb": 748513, + "wall_ms": 2586.511709, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3332,9 +4612,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 17, - "wall_ms": 1105.782333, - "max_rss_kb": 748529, + "wall_ms": 2590.769584, + "max_rss_kb": 749312, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3345,9 +4630,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 18, - "wall_ms": 1096.645334, - "max_rss_kb": 748513, + "wall_ms": 2588.119167, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3358,9 +4648,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 19, - "wall_ms": 1100.851083, - "max_rss_kb": 748513, + "wall_ms": 2583.219916, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3371,9 +4666,14 @@ "workload": "json_pipeline_full", "language": "perry", "binary": "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "command": [ + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" + ], "run": 20, - "wall_ms": 1121.404833, - "max_rss_kb": 748545, + "wall_ms": 2587.612542, + "max_rss_kb": 749328, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3383,10 +4683,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 1, - "wall_ms": 971.31025, - "max_rss_kb": 901232, + "wall_ms": 892.495459, + "max_rss_kb": 793600, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3396,10 +4704,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 2, - "wall_ms": 958.09325, - "max_rss_kb": 900719, + "wall_ms": 887.494167, + "max_rss_kb": 793568, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3409,10 +4725,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 3, - "wall_ms": 966.652834, - "max_rss_kb": 901520, + "wall_ms": 890.852625, + "max_rss_kb": 793840, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3422,10 +4746,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 4, - "wall_ms": 958.558708, - "max_rss_kb": 902000, + "wall_ms": 904.171667, + "max_rss_kb": 795296, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3435,10 +4767,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 5, - "wall_ms": 958.128167, - "max_rss_kb": 901616, + "wall_ms": 892.476041, + "max_rss_kb": 793584, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3448,10 +4788,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 6, - "wall_ms": 966.020417, - "max_rss_kb": 902000, + "wall_ms": 885.758834, + "max_rss_kb": 793696, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3461,10 +4809,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 7, - "wall_ms": 959.655041, - "max_rss_kb": 899968, + "wall_ms": 885.87825, + "max_rss_kb": 793824, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3474,10 +4830,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 8, - "wall_ms": 955.413791, - "max_rss_kb": 899952, + "wall_ms": 882.494375, + "max_rss_kb": 793680, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3487,10 +4851,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 9, - "wall_ms": 972.537792, - "max_rss_kb": 901024, + "wall_ms": 896.185625, + "max_rss_kb": 794912, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3500,10 +4872,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 10, - "wall_ms": 990.437083, - "max_rss_kb": 901968, + "wall_ms": 888.26725, + "max_rss_kb": 793632, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3513,10 +4893,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 11, - "wall_ms": 965.614, - "max_rss_kb": 902112, + "wall_ms": 887.598291, + "max_rss_kb": 793840, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3526,10 +4914,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 12, - "wall_ms": 970.193, - "max_rss_kb": 900896, + "wall_ms": 894.838042, + "max_rss_kb": 793664, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3539,10 +4935,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 13, - "wall_ms": 962.056416, - "max_rss_kb": 901024, + "wall_ms": 886.48575, + "max_rss_kb": 793680, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3552,10 +4956,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 14, - "wall_ms": 984.372375, - "max_rss_kb": 901824, + "wall_ms": 887.145334, + "max_rss_kb": 793728, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3565,10 +4977,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 15, - "wall_ms": 960.0985, - "max_rss_kb": 901040, + "wall_ms": 874.855292, + "max_rss_kb": 793728, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3578,10 +4998,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 16, - "wall_ms": 965.002959, - "max_rss_kb": 900336, + "wall_ms": 893.845667, + "max_rss_kb": 797808, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3591,10 +5019,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 17, - "wall_ms": 981.608, - "max_rss_kb": 900848, + "wall_ms": 892.256833, + "max_rss_kb": 797472, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3604,10 +5040,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 18, - "wall_ms": 980.784416, - "max_rss_kb": 902336, + "wall_ms": 896.750042, + "max_rss_kb": 793744, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3617,10 +5061,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 19, - "wall_ms": 968.113208, - "max_rss_kb": 901568, + "wall_ms": 891.299084, + "max_rss_kb": 794416, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3630,10 +5082,18 @@ { "workload": "json_pipeline_full", "language": "node", - "binary": "node", + "binary": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "command": [ + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", + "--experimental-strip-types", + "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" + ], "run": 20, - "wall_ms": 975.743166, - "max_rss_kb": 900832, + "wall_ms": 887.35775, + "max_rss_kb": 794064, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3643,10 +5103,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 1, - "wall_ms": 646.0195, - "max_rss_kb": 608353, + "wall_ms": 576.591417, + "max_rss_kb": 593296, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3656,10 +5123,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 2, - "wall_ms": 659.163708, - "max_rss_kb": 607969, + "wall_ms": 572.655834, + "max_rss_kb": 593248, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3669,10 +5143,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 3, - "wall_ms": 649.823041, - "max_rss_kb": 608001, + "wall_ms": 569.313958, + "max_rss_kb": 591840, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3682,10 +5163,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 4, - "wall_ms": 654.0085, - "max_rss_kb": 607969, + "wall_ms": 568.1435, + "max_rss_kb": 594640, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3695,10 +5183,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 5, - "wall_ms": 649.594333, - "max_rss_kb": 608177, + "wall_ms": 575.178708, + "max_rss_kb": 594464, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3708,10 +5203,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 6, - "wall_ms": 648.925459, - "max_rss_kb": 608241, + "wall_ms": 570.246375, + "max_rss_kb": 593632, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3721,10 +5223,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 7, - "wall_ms": 654.835208, - "max_rss_kb": 607953, + "wall_ms": 573.849167, + "max_rss_kb": 593616, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3734,10 +5243,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 8, - "wall_ms": 714.429583, - "max_rss_kb": 606945, + "wall_ms": 573.43825, + "max_rss_kb": 593712, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3747,10 +5263,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 9, - "wall_ms": 651.221167, - "max_rss_kb": 608017, + "wall_ms": 567.414125, + "max_rss_kb": 593648, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3760,10 +5283,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 10, - "wall_ms": 646.6225, - "max_rss_kb": 608097, + "wall_ms": 569.610125, + "max_rss_kb": 594320, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3773,10 +5303,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 11, - "wall_ms": 646.376, - "max_rss_kb": 608129, + "wall_ms": 574.128208, + "max_rss_kb": 593104, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3786,10 +5323,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 12, - "wall_ms": 648.719, - "max_rss_kb": 608241, + "wall_ms": 568.492083, + "max_rss_kb": 593744, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3799,10 +5343,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 13, - "wall_ms": 649.941125, - "max_rss_kb": 607809, + "wall_ms": 571.805709, + "max_rss_kb": 593872, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3812,10 +5363,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 14, - "wall_ms": 649.531625, - "max_rss_kb": 606689, + "wall_ms": 574.22625, + "max_rss_kb": 593840, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3825,10 +5383,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 15, - "wall_ms": 647.0015, - "max_rss_kb": 607953, + "wall_ms": 569.445125, + "max_rss_kb": 594048, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3838,10 +5403,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 16, - "wall_ms": 650.844208, - "max_rss_kb": 607857, + "wall_ms": 568.898834, + "max_rss_kb": 593760, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3851,10 +5423,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 17, - "wall_ms": 646.94375, - "max_rss_kb": 608193, + "wall_ms": 570.351875, + "max_rss_kb": 594176, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3864,10 +5443,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 18, - "wall_ms": 651.652708, - "max_rss_kb": 607937, + "wall_ms": 566.418292, + "max_rss_kb": 591552, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3877,10 +5463,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 19, - "wall_ms": 651.993042, - "max_rss_kb": 608177, + "wall_ms": 567.380125, + "max_rss_kb": 593856, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", @@ -3890,10 +5483,17 @@ { "workload": "json_pipeline_full", "language": "bun", - "binary": "bun", + "binary": "~/.cache/perry-bench-tools/bun/bun", + "command": [ + "~/.cache/perry-bench-tools/bun/bun", + "run", + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" + ], "run": 20, - "wall_ms": 658.766917, - "max_rss_kb": 607985, + "wall_ms": 570.735042, + "max_rss_kb": 593248, "exit_code": 0, "stdout_first": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", "stdout_last": "input_bytes=112695869 records_in=500000 records_out=249976 output_bytes=68140794 hash=b7e8a588", diff --git a/benchmarks/honest_bench/results/summary.txt b/benchmarks/honest_bench/results/summary.txt index a6114d89fe..12c19b3aa6 100644 --- a/benchmarks/honest_bench/results/summary.txt +++ b/benchmarks/honest_bench/results/summary.txt @@ -3,21 +3,21 @@ # expected.json: present ## PERF — output verified to match Bun reference -image_convolution bun 915.4 ms runs=20 match=20/20 -image_convolution node 1206.6 ms runs=20 match=20/20 -image_convolution perry 354.0 ms runs=20 match=20/20 -image_convolution rust 392.1 ms runs=20 match=20/20 -image_convolution zig 245.4 ms runs=20 match=20/20 -json_pipeline_full bun 649.9 ms runs=20 match=20/20 -json_pipeline_full node 966.3 ms runs=20 match=20/20 -json_pipeline_full perry 1098.4 ms runs=20 match=20/20 -json_pipeline_full rust 608.3 ms runs=20 match=20/20 -json_pipeline_full zig 867.4 ms runs=20 match=20/20 -json_pipeline_small bun 51.1 ms runs=20 match=20/20 -json_pipeline_small node 143.6 ms runs=20 match=20/20 -json_pipeline_small perry 39.2 ms runs=20 match=20/20 -json_pipeline_small rust 34.1 ms runs=20 match=20/20 -json_pipeline_small zig 34.5 ms runs=20 match=20/20 +image_convolution bun 909.7 ms runs=20 match=20/20 +image_convolution node 1232.2 ms runs=20 match=20/20 +image_convolution perry 278.8 ms runs=20 match=20/20 +image_convolution rust 406.4 ms runs=20 match=20/20 +image_convolution zig 266.6 ms runs=20 match=20/20 +json_pipeline_full bun 570.3 ms runs=20 match=20/20 +json_pipeline_full node 889.6 ms runs=20 match=20/20 +json_pipeline_full perry 2591.2 ms runs=20 match=20/20 +json_pipeline_full rust 634.6 ms runs=20 match=20/20 +json_pipeline_full zig 839.8 ms runs=20 match=20/20 +json_pipeline_small bun 76.5 ms runs=20 match=20/20 +json_pipeline_small node 110.6 ms runs=20 match=20/20 +json_pipeline_small perry 64.1 ms runs=20 match=20/20 +json_pipeline_small rust 59.4 ms runs=20 match=20/20 +json_pipeline_small zig 58.9 ms runs=20 match=20/20 # To turn mismatches into a hard CI failure: ./run.sh --strict-output # To refresh the reference (only when output semantics intentionally change): diff --git a/benchmarks/json_polyglot/RESULTS.md b/benchmarks/json_polyglot/RESULTS.md index 39accf3b4a..0877d35d5a 100644 --- a/benchmarks/json_polyglot/RESULTS.md +++ b/benchmarks/json_polyglot/RESULTS.md @@ -1,8 +1,8 @@ # JSON Polyglot Benchmark Results **Runs per cell:** 11 · **Pinning:** macOS scheduler hint (taskpolicy -t 0 -l 0 — P-core preferred via throughput/latency tiers, NOT strict affinity) -**Hardware:** Darwin 25.4.0 arm64 on MacBook-Pro-69. -**Date:** 2026-05-14. +**Hardware:** Darwin 25.5.0 arm64 on MacBookPro. +**Date:** 2026-08-03. Two workloads, each language listed twice (idiomatic / optimized flag profile). Median wall-clock time is the headline number; p95, σ (population stddev), @@ -18,23 +18,21 @@ low — the lazy path can avoid materializing the parse tree entirely. | Implementation | Profile | Median (ms) | p95 (ms) | σ | Min | Max | Peak RSS (MB) | |---|---|---:|---:|---:|---:|---:|---:| -| c++ -O3 -flto (simdjson) | optimized | 24 | 26 | 0.6 | 24 | 26 | 8 | -| c++ -O2 (simdjson) | idiomatic | 29 | 34 | 1.4 | 29 | 34 | 8 | -| perry (gen-gc + lazy tape) | optimized | 83 | 86 | 1.4 | 81 | 86 | 227 | -| rust serde_json (LTO+1cgu) | optimized | 186 | 190 | 1.4 | 185 | 190 | 11 | -| rust serde_json | idiomatic | 197 | 201 | 1.7 | 195 | 201 | 11 | -| bun (default) | idiomatic | 249 | 252 | 1.3 | 247 | 252 | 81 | -| perry (mark-sweep, no lazy) | idiomatic | 335 | 339 | 1.7 | 333 | 339 | 283 | -| node (default) | idiomatic | 377 | 386 | 4.5 | 370 | 386 | 127 | -| node --max-old=4096 | optimized | 380 | 386 | 4.0 | 373 | 386 | 127 | -| kotlin -server -Xmx512m | optimized | 457 | 470 | 5.3 | 451 | 470 | 424 | -| kotlin (kotlinx.serialization) | idiomatic | 476 | 495 | 8.0 | 467 | 495 | 606 | -| c++ -O3 -flto (nlohmann/json) | optimized | 783 | 785 | 1.8 | 780 | 785 | 25 | -| go -ldflags="-s -w" -trimpath | optimized | 796 | 802 | 3.8 | 788 | 802 | 23 | -| go (encoding/json) | idiomatic | 797 | 829 | 9.9 | 792 | 829 | 23 | -| c++ -O2 (nlohmann/json) | idiomatic | 849 | 851 | 1.1 | 848 | 851 | 25 | -| swift -O -wmo (Foundation) | optimized | 3771 | 3834 | 30.9 | 3698 | 3834 | 34 | -| swift -O (Foundation) | idiomatic | 3783 | 3819 | 18.4 | 3750 | 3819 | 34 | +| rust serde_json (LTO+1cgu) | optimized | 184 | 193 | 2.6 | 184 | 193 | 10 | +| rust serde_json | idiomatic | 191 | 201 | 2.9 | 190 | 201 | 11 | +| perry (gen-gc + lazy tape) | optimized | 213 | 221 | 2.3 | 212 | 221 | 110 | +| bun (default) | idiomatic | 223 | 225 | 1.1 | 221 | 225 | 83 | +| node (default) | idiomatic | 387 | 397 | 4.5 | 382 | 397 | 103 | +| node --max-old=4096 | optimized | 388 | 395 | 3.9 | 384 | 395 | 103 | +| kotlin (kotlinx.serialization) | idiomatic | 455 | 474 | 7.9 | 446 | 474 | 609 | +| kotlin -server -Xmx512m | optimized | 461 | 495 | 14.9 | 439 | 495 | 422 | +| perry (mark-sweep, no lazy) | idiomatic | 608 | 616 | 5.3 | 599 | 616 | 301 | +| go (encoding/json) | idiomatic | 771 | 777 | 2.6 | 768 | 777 | 23 | +| c++ -O3 -flto (nlohmann/json) | optimized | 773 | 777 | 4.1 | 766 | 777 | 25 | +| go -ldflags="-s -w" -trimpath | optimized | 778 | 784 | 3.7 | 770 | 784 | 22 | +| c++ -O2 (nlohmann/json) | idiomatic | 834 | 848 | 4.4 | 831 | 848 | 25 | +| swift -O -wmo (Foundation) | optimized | 3521 | 3617 | 31.8 | 3502 | 3617 | 33 | +| swift -O (Foundation) | idiomatic | 3570 | 3588 | 9.8 | 3557 | 3588 | 32 | ## JSON parse-and-iterate @@ -45,20 +43,18 @@ JSON content. 10k records, ~1 MB blob, 50 iterations per run. | Implementation | Profile | Median (ms) | p95 (ms) | σ | Min | Max | Peak RSS (MB) | |---|---|---:|---:|---:|---:|---:|---:| -| c++ -O2 (simdjson) | idiomatic | 24 | 25 | 0.5 | 24 | 25 | 8 | -| c++ -O3 -flto (simdjson) | optimized | 24 | 25 | 0.3 | 24 | 25 | 8 | -| rust serde_json (LTO+1cgu) | optimized | 182 | 184 | 0.9 | 181 | 184 | 11 | -| rust serde_json | idiomatic | 197 | 203 | 1.8 | 196 | 203 | 11 | -| bun (default) | idiomatic | 251 | 254 | 1.2 | 250 | 254 | 86 | -| perry (mark-sweep, no lazy) | idiomatic | 338 | 366 | 8.3 | 336 | 366 | 283 | -| node (default) | idiomatic | 351 | 357 | 2.9 | 346 | 357 | 87 | -| node --max-old=4096 | optimized | 352 | 360 | 5.4 | 343 | 360 | 87 | -| perry (gen-gc + lazy tape) | optimized | 425 | 428 | 2.1 | 421 | 428 | 309 | -| kotlin -server -Xmx512m | optimized | 462 | 527 | 20.4 | 449 | 527 | 424 | -| kotlin (kotlinx.serialization) | idiomatic | 476 | 485 | 3.7 | 473 | 485 | 606 | -| c++ -O3 -flto (nlohmann/json) | optimized | 797 | 828 | 9.2 | 795 | 828 | 25 | -| go -ldflags="-s -w" -trimpath | optimized | 798 | 842 | 13.0 | 794 | 842 | 23 | -| go (encoding/json) | idiomatic | 799 | 805 | 3.1 | 795 | 805 | 23 | -| c++ -O2 (nlohmann/json) | idiomatic | 877 | 882 | 2.6 | 873 | 882 | 25 | -| swift -O (Foundation) | idiomatic | 3742 | 3791 | 18.9 | 3721 | 3791 | 34 | -| swift -O -wmo (Foundation) | optimized | 3758 | 3793 | 23.9 | 3713 | 3793 | 34 | +| rust serde_json (LTO+1cgu) | optimized | 181 | 190 | 2.6 | 180 | 190 | 11 | +| rust serde_json | idiomatic | 191 | 198 | 2.2 | 190 | 198 | 11 | +| bun (default) | idiomatic | 225 | 230 | 1.7 | 224 | 230 | 88 | +| node --max-old=4096 | optimized | 389 | 393 | 2.2 | 386 | 393 | 98 | +| node (default) | idiomatic | 390 | 398 | 3.4 | 386 | 398 | 97 | +| kotlin -server -Xmx512m | optimized | 445 | 453 | 8.1 | 425 | 453 | 423 | +| kotlin (kotlinx.serialization) | idiomatic | 473 | 488 | 11.3 | 457 | 488 | 607 | +| perry (mark-sweep, no lazy) | idiomatic | 660 | 669 | 4.8 | 651 | 669 | 301 | +| go -ldflags="-s -w" -trimpath | optimized | 775 | 779 | 2.5 | 769 | 779 | 23 | +| go (encoding/json) | idiomatic | 775 | 782 | 3.8 | 771 | 782 | 23 | +| c++ -O3 -flto (nlohmann/json) | optimized | 788 | 790 | 1.4 | 786 | 790 | 25 | +| c++ -O2 (nlohmann/json) | idiomatic | 864 | 866 | 1.9 | 860 | 866 | 25 | +| perry (gen-gc + lazy tape) | optimized | 2653 | 2920 | 78.4 | 2630 | 2920 | 356 | +| swift -O (Foundation) | idiomatic | 3566 | 3641 | 38.7 | 3518 | 3641 | 33 | +| swift -O -wmo (Foundation) | optimized | 3623 | 3709 | 35.2 | 3593 | 3709 | 34 | diff --git a/benchmarks/polyglot/RESULTS_AUTO.md b/benchmarks/polyglot/RESULTS_AUTO.md index 93d84db9de..fe64f5dfb5 100644 --- a/benchmarks/polyglot/RESULTS_AUTO.md +++ b/benchmarks/polyglot/RESULTS_AUTO.md @@ -1,22 +1,22 @@ # Polyglot Compute-Microbench Results (auto-generated) **Runs per cell:** 11 · **Pinning:** macOS scheduler hint (taskpolicy -t 0 -l 0 — P-core preferred via throughput/latency tiers, NOT strict affinity) -**Hardware:** Darwin 25.4.0 arm64 on MacBook-Pro-69 · **Date:** 2026-05-14 -**Perry version:** v0.5.908 +**Hardware:** Darwin 25.5.0 arm64 on MacBookPro · **Date:** 2026-08-03 +**Perry version:** v0.5.1279 Headline = median wall-clock ms. Lower is better. | Benchmark | Perry | Rust | C++ | Go | Swift | Java | Node | Bun | Hermes | Python | |---------------------|-------|-------|-------|-------|-------|-------|-------|-------|--------|---------| -| fibonacci | 309 | 316 | 309 | 446 | 401 | 278 | 987 | 518 | - | 12382 | -| loop_overhead | 97 | 97 | 96 | 96 | 96 | 97 | 53 | 41 | - | 1967 | -| loop_data_dependent | 225 | 226 | 129 | 128 | 225 | 226 | 226 | 230 | - | 6068 | -| array_write | 3 | 7 | 2 | 9 | 2 | 6 | 9 | 6 | - | 331 | -| array_read | 11 | 9 | 9 | 10 | 9 | 11 | 14 | 16 | - | 236 | -| math_intensive | 51 | 48 | 50 | 48 | 48 | 50 | 49 | 50 | - | 1579 | -| object_create | 2 | 0 | 0 | 0 | 0 | 5 | 8 | 6 | - | 133 | -| nested_loops | 18 | 8 | 8 | 10 | 8 | 10 | 17 | 20 | - | 353 | -| accumulate | 97 | 97 | 96 | 96 | 96 | 98 | 597 | 98 | - | 4382 | +| fibonacci | 394 | 306 | 298 | 435 | 387 | 273 | 924 | 512 | - | 12140 | +| loop_overhead | 93 | 93 | 93 | 93 | 93 | 94 | 63 | 39 | - | 1941 | +| loop_data_dependent | 218 | 218 | 124 | 124 | 217 | 220 | 220 | 220 | - | 5947 | +| array_write | 2 | 6 | 1 | 8 | 1 | 5 | 7 | 5 | - | 317 | +| array_read | 24 | 9 | 9 | 9 | 9 | 11 | 11 | 14 | - | 222 | +| math_intensive | 49 | 46 | 48 | 47 | 47 | 48 | 49 | 48 | - | 1562 | +| object_create | 3 | 0 | 0 | 0 | 0 | 5 | 5 | 5 | - | 135 | +| nested_loops | 43 | 8 | 8 | 8 | 8 | 10 | 18 | 18 | - | 344 | +| accumulate | 94 | 93 | 93 | 93 | 93 | 95 | 95 | 95 | - | 4330 | ## Per-cell full stats @@ -24,113 +24,93 @@ Format: median (p95: X, σ: S, min: Y, max: Z) ms | Benchmark | Runtime | Stats (ms) | |---|---|---| -| fibonacci | perry | 309 (p95: 317, σ: 2.8, min: 307, max: 317) | -| fibonacci | rust | 316 (p95: 323, σ: 2.5, min: 315, max: 323) | -| fibonacci | cpp | 309 (p95: 312, σ: 1.0, min: 308, max: 312) | -| fibonacci | go | 446 (p95: 448, σ: 0.9, min: 445, max: 448) | -| fibonacci | swift | 401 (p95: 409, σ: 2.7, min: 399, max: 409) | -| fibonacci | java | 278 (p95: 296, σ: 6.0, min: 277, max: 296) | -| fibonacci | node | 987 (p95: 1030, σ: 12.5, min: 985, max: 1030) | -| fibonacci | bun | 518 (p95: 525, σ: 2.9, min: 515, max: 525) | +| fibonacci | perry | 394 (p95: 420, σ: 7.4, min: 394, max: 420) | +| fibonacci | rust | 306 (p95: 329, σ: 6.6, min: 305, max: 329) | +| fibonacci | cpp | 298 (p95: 309, σ: 3.2, min: 297, max: 309) | +| fibonacci | go | 435 (p95: 454, σ: 5.6, min: 434, max: 454) | +| fibonacci | swift | 387 (p95: 409, σ: 6.3, min: 386, max: 409) | +| fibonacci | java | 273 (p95: 277, σ: 2.5, min: 269, max: 277) | +| fibonacci | node | 924 (p95: 1018, σ: 30.1, min: 923, max: 1018) | +| fibonacci | bun | 512 (p95: 515, σ: 2.4, min: 507, max: 515) | | fibonacci | hermes | - | -| fibonacci | python | 12382 (p95: 12503, σ: 58.7, min: 12322, max: 12503) | -| loop_overhead | perry | 97 (p95: 99, σ: 0.9, min: 96, max: 99) | -| loop_overhead | rust | 97 (p95: 98, σ: 0.6, min: 96, max: 98) | -| loop_overhead | cpp | 96 (p95: 97, σ: 0.6, min: 95, max: 97) | -| loop_overhead | go | 96 (p95: 97, σ: 0.6, min: 95, max: 97) | -| loop_overhead | swift | 96 (p95: 97, σ: 0.6, min: 95, max: 97) | -| loop_overhead | java | 97 (p95: 98, σ: 0.5, min: 97, max: 98) | -| loop_overhead | node | 53 (p95: 58, σ: 1.4, min: 53, max: 58) | -| loop_overhead | bun | 41 (p95: 42, σ: 0.7, min: 40, max: 42) | +| fibonacci | python | 12140 (p95: 13544, σ: 455.8, min: 12017, max: 13544) | +| loop_overhead | perry | 93 (p95: 116, σ: 6.6, min: 93, max: 116) | +| loop_overhead | rust | 93 (p95: 96, σ: 1.2, min: 93, max: 96) | +| loop_overhead | cpp | 93 (p95: 94, σ: 0.3, min: 93, max: 94) | +| loop_overhead | go | 93 (p95: 93, σ: 0.0, min: 93, max: 93) | +| loop_overhead | swift | 93 (p95: 93, σ: 0.0, min: 93, max: 93) | +| loop_overhead | java | 94 (p95: 95, σ: 0.5, min: 94, max: 95) | +| loop_overhead | node | 63 (p95: 64, σ: 0.4, min: 63, max: 64) | +| loop_overhead | bun | 39 (p95: 39, σ: 0.0, min: 39, max: 39) | | loop_overhead | hermes | - | -| loop_overhead | python | 1967 (p95: 2056, σ: 34.4, min: 1964, max: 2056) | -| loop_data_dependent | perry | 225 (p95: 234, σ: 2.7, min: 224, max: 234) | -| loop_data_dependent | rust | 226 (p95: 230, σ: 1.6, min: 225, max: 230) | -| loop_data_dependent | cpp | 129 (p95: 131, σ: 1.3, min: 128, max: 131) | -| loop_data_dependent | go | 128 (p95: 129, σ: 0.5, min: 128, max: 129) | -| loop_data_dependent | swift | 225 (p95: 226, σ: 0.6, min: 224, max: 226) | -| loop_data_dependent | java | 226 (p95: 229, σ: 1.4, min: 224, max: 229) | -| loop_data_dependent | node | 226 (p95: 228, σ: 0.8, min: 225, max: 228) | -| loop_data_dependent | bun | 230 (p95: 232, σ: 1.1, min: 228, max: 232) | +| loop_overhead | python | 1941 (p95: 1949, σ: 2.9, min: 1940, max: 1949) | +| loop_data_dependent | perry | 218 (p95: 241, σ: 6.8, min: 217, max: 241) | +| loop_data_dependent | rust | 218 (p95: 224, σ: 2.2, min: 217, max: 224) | +| loop_data_dependent | cpp | 124 (p95: 126, σ: 0.6, min: 124, max: 126) | +| loop_data_dependent | go | 124 (p95: 124, σ: 0.0, min: 124, max: 124) | +| loop_data_dependent | swift | 217 (p95: 218, σ: 0.3, min: 217, max: 218) | +| loop_data_dependent | java | 220 (p95: 226, σ: 2.1, min: 219, max: 226) | +| loop_data_dependent | node | 220 (p95: 222, σ: 0.7, min: 219, max: 222) | +| loop_data_dependent | bun | 220 (p95: 223, σ: 1.2, min: 219, max: 223) | | loop_data_dependent | hermes | - | -| loop_data_dependent | python | 6068 (p95: 6186, σ: 41.6, min: 6044, max: 6186) | -| array_write | perry | 3 (p95: 4, σ: 0.5, min: 3, max: 4) | -| array_write | rust | 7 (p95: 8, σ: 0.4, min: 7, max: 8) | -| array_write | cpp | 2 (p95: 3, σ: 0.3, min: 2, max: 3) | -| array_write | go | 9 (p95: 9, σ: 0.4, min: 8, max: 9) | -| array_write | swift | 2 (p95: 4, σ: 0.8, min: 2, max: 4) | -| array_write | java | 6 (p95: 7, σ: 0.7, min: 5, max: 7) | -| array_write | node | 9 (p95: 9, σ: 0.5, min: 8, max: 9) | -| array_write | bun | 6 (p95: 9, σ: 1.0, min: 5, max: 9) | +| loop_data_dependent | python | 5947 (p95: 5961, σ: 4.7, min: 5942, max: 5961) | +| array_write | perry | 2 (p95: 2, σ: 0.5, min: 1, max: 2) | +| array_write | rust | 6 (p95: 7, σ: 0.4, min: 5, max: 7) | +| array_write | cpp | 1 (p95: 1, σ: 0.0, min: 1, max: 1) | +| array_write | go | 8 (p95: 8, σ: 0.3, min: 7, max: 8) | +| array_write | swift | 1 (p95: 1, σ: 0.0, min: 1, max: 1) | +| array_write | java | 5 (p95: 5, σ: 0.4, min: 4, max: 5) | +| array_write | node | 7 (p95: 7, σ: 0.3, min: 6, max: 7) | +| array_write | bun | 5 (p95: 5, σ: 0.3, min: 4, max: 5) | | array_write | hermes | - | -| array_write | python | 331 (p95: 338, σ: 3.3, min: 327, max: 338) | -| array_read | perry | 11 (p95: 12, σ: 0.4, min: 11, max: 12) | +| array_write | python | 317 (p95: 320, σ: 1.2, min: 316, max: 320) | +| array_read | perry | 24 (p95: 34, σ: 2.9, min: 24, max: 34) | | array_read | rust | 9 (p95: 9, σ: 0.0, min: 9, max: 9) | -| array_read | cpp | 9 (p95: 11, σ: 0.7, min: 9, max: 11) | -| array_read | go | 10 (p95: 11, σ: 0.4, min: 10, max: 11) | -| array_read | swift | 9 (p95: 10, σ: 0.3, min: 9, max: 10) | -| array_read | java | 11 (p95: 13, σ: 0.6, min: 11, max: 13) | -| array_read | node | 14 (p95: 14, σ: 0.5, min: 13, max: 14) | -| array_read | bun | 16 (p95: 17, σ: 0.8, min: 14, max: 17) | +| array_read | cpp | 9 (p95: 9, σ: 0.0, min: 9, max: 9) | +| array_read | go | 9 (p95: 14, σ: 1.5, min: 9, max: 14) | +| array_read | swift | 9 (p95: 9, σ: 0.0, min: 9, max: 9) | +| array_read | java | 11 (p95: 11, σ: 0.5, min: 10, max: 11) | +| array_read | node | 11 (p95: 11, σ: 0.4, min: 10, max: 11) | +| array_read | bun | 14 (p95: 14, σ: 0.4, min: 13, max: 14) | | array_read | hermes | - | -| array_read | python | 236 (p95: 244, σ: 4.7, min: 227, max: 244) | -| math_intensive | perry | 51 (p95: 51, σ: 0.4, min: 50, max: 51) | -| math_intensive | rust | 48 (p95: 49, σ: 0.7, min: 47, max: 49) | -| math_intensive | cpp | 50 (p95: 54, σ: 1.4, min: 49, max: 54) | -| math_intensive | go | 48 (p95: 49, σ: 0.5, min: 48, max: 49) | -| math_intensive | swift | 48 (p95: 50, σ: 0.8, min: 48, max: 50) | -| math_intensive | java | 50 (p95: 51, σ: 0.3, min: 50, max: 51) | -| math_intensive | node | 49 (p95: 52, σ: 1.0, min: 49, max: 52) | -| math_intensive | bun | 50 (p95: 52, σ: 0.9, min: 50, max: 52) | +| array_read | python | 222 (p95: 225, σ: 1.0, min: 222, max: 225) | +| math_intensive | perry | 49 (p95: 71, σ: 6.4, min: 48, max: 71) | +| math_intensive | rust | 46 (p95: 48, σ: 0.6, min: 46, max: 48) | +| math_intensive | cpp | 48 (p95: 49, σ: 0.3, min: 48, max: 49) | +| math_intensive | go | 47 (p95: 48, σ: 0.3, min: 47, max: 48) | +| math_intensive | swift | 47 (p95: 48, σ: 0.3, min: 47, max: 48) | +| math_intensive | java | 48 (p95: 49, σ: 0.5, min: 48, max: 49) | +| math_intensive | node | 49 (p95: 50, σ: 0.4, min: 48, max: 50) | +| math_intensive | bun | 48 (p95: 49, σ: 0.5, min: 48, max: 49) | | math_intensive | hermes | - | -| math_intensive | python | 1579 (p95: 1593, σ: 4.1, min: 1578, max: 1593) | -| object_create | perry | 2 (p95: 4, σ: 0.6, min: 2, max: 4) | -| object_create | rust | 0 (p95: 1, σ: 0.3, min: 0, max: 1) | -| object_create | cpp | 0 (p95: 1, σ: 0.4, min: 0, max: 1) | +| math_intensive | python | 1562 (p95: 1577, σ: 5.9, min: 1556, max: 1577) | +| object_create | perry | 3 (p95: 7, σ: 1.1, min: 3, max: 7) | +| object_create | rust | 0 (p95: 0, σ: 0.0, min: 0, max: 0) | +| object_create | cpp | 0 (p95: 0, σ: 0.0, min: 0, max: 0) | | object_create | go | 0 (p95: 0, σ: 0.0, min: 0, max: 0) | | object_create | swift | 0 (p95: 0, σ: 0.0, min: 0, max: 0) | -| object_create | java | 5 (p95: 5, σ: 0.0, min: 5, max: 5) | -| object_create | node | 8 (p95: 9, σ: 0.5, min: 8, max: 9) | -| object_create | bun | 6 (p95: 9, σ: 1.0, min: 5, max: 9) | +| object_create | java | 5 (p95: 5, σ: 0.5, min: 4, max: 5) | +| object_create | node | 5 (p95: 5, σ: 0.0, min: 5, max: 5) | +| object_create | bun | 5 (p95: 6, σ: 0.5, min: 5, max: 6) | | object_create | hermes | - | -| object_create | python | 133 (p95: 134, σ: 0.6, min: 132, max: 134) | -| nested_loops | perry | 18 (p95: 18, σ: 0.5, min: 17, max: 18) | +| object_create | python | 135 (p95: 145, σ: 2.9, min: 135, max: 145) | +| nested_loops | perry | 43 (p95: 60, σ: 4.9, min: 43, max: 60) | | nested_loops | rust | 8 (p95: 8, σ: 0.0, min: 8, max: 8) | -| nested_loops | cpp | 8 (p95: 9, σ: 0.3, min: 8, max: 9) | -| nested_loops | go | 10 (p95: 12, σ: 0.8, min: 9, max: 12) | +| nested_loops | cpp | 8 (p95: 8, σ: 0.0, min: 8, max: 8) | +| nested_loops | go | 8 (p95: 8, σ: 0.0, min: 8, max: 8) | | nested_loops | swift | 8 (p95: 8, σ: 0.0, min: 8, max: 8) | -| nested_loops | java | 10 (p95: 12, σ: 0.7, min: 10, max: 12) | -| nested_loops | node | 17 (p95: 27, σ: 3.4, min: 16, max: 27) | -| nested_loops | bun | 20 (p95: 20, σ: 0.5, min: 19, max: 20) | +| nested_loops | java | 10 (p95: 11, σ: 0.4, min: 10, max: 11) | +| nested_loops | node | 18 (p95: 18, σ: 0.4, min: 17, max: 18) | +| nested_loops | bun | 18 (p95: 19, σ: 0.5, min: 18, max: 19) | | nested_loops | hermes | - | -| nested_loops | python | 353 (p95: 356, σ: 3.6, min: 347, max: 356) | -| accumulate | perry | 97 (p95: 101, σ: 1.3, min: 96, max: 101) | -| accumulate | rust | 97 (p95: 98, σ: 0.9, min: 95, max: 98) | -| accumulate | cpp | 96 (p95: 97, σ: 0.4, min: 96, max: 97) | -| accumulate | go | 96 (p95: 97, σ: 0.5, min: 95, max: 97) | -| accumulate | swift | 96 (p95: 98, σ: 1.2, min: 95, max: 98) | -| accumulate | java | 98 (p95: 101, σ: 1.1, min: 97, max: 101) | -| accumulate | node | 597 (p95: 690, σ: 27.0, min: 592, max: 690) | -| accumulate | bun | 98 (p95: 99, σ: 0.6, min: 97, max: 99) | +| nested_loops | python | 344 (p95: 353, σ: 4.3, min: 339, max: 353) | +| accumulate | perry | 94 (p95: 110, σ: 4.7, min: 93, max: 110) | +| accumulate | rust | 93 (p95: 93, σ: 0.0, min: 93, max: 93) | +| accumulate | cpp | 93 (p95: 94, σ: 0.3, min: 93, max: 94) | +| accumulate | go | 93 (p95: 93, σ: 0.0, min: 93, max: 93) | +| accumulate | swift | 93 (p95: 95, σ: 0.6, min: 93, max: 95) | +| accumulate | java | 95 (p95: 97, σ: 0.8, min: 94, max: 97) | +| accumulate | node | 95 (p95: 96, σ: 0.6, min: 94, max: 96) | +| accumulate | bun | 95 (p95: 95, σ: 0.4, min: 94, max: 95) | | accumulate | hermes | - | -| accumulate | python | 4382 (p95: 4461, σ: 27.4, min: 4359, max: 4461) | - -## Perry `--fast-math` addendum (separate run, same v0.5.908 binary recompiled with `PERRY_FAST_MATH=1`) - -| Benchmark | Runtime | Stats (ms) | -|---|---|---| -| fibonacci | perry --fast | 306 (p95: 310, σ: 1.3, min: 305, max: 310) | -| loop_overhead | perry --fast | 12 (p95: 17, σ: 1.4, min: 12, max: 17) | -| loop_data_dependent | perry --fast | 224 (p95: 226, σ: 1.0, min: 223, max: 226) | -| array_write | perry --fast | 4 (p95: 7, σ: 1.2, min: 3, max: 7) | -| array_read | perry --fast | 11 (p95: 12, σ: 0.3, min: 11, max: 12) | -| math_intensive | perry --fast | 14 (p95: 16, σ: 0.6, min: 14, max: 16) | -| object_create | perry --fast | 0 (p95: 1, σ: 0.4, min: 0, max: 1) | -| nested_loops | perry --fast | 17 (p95: 25, σ: 2.2, min: 17, max: 25) | -| accumulate | perry --fast | 34 (p95: 36, σ: 0.9, min: 33, max: 36) | - -The `--fast-math` rerun produced tight σ on every cell (1-2 ms typical), -indicating a clean run. Trivially-foldable cells (`loop_overhead`, -`math_intensive`, `accumulate`) reproduce the historical 7-8× win; -non-foldable cells (`fibonacci`, `loop_data_dependent`, `nested_loops`) -match default mode within 1-4 ms — exactly the structural expectation. +| accumulate | python | 4330 (p95: 4522, σ: 55.2, min: 4327, max: 4522) | diff --git a/benchmarks/public_baseline.py b/benchmarks/public_baseline.py index 348d093b7b..7e3f646c18 100755 --- a/benchmarks/public_baseline.py +++ b/benchmarks/public_baseline.py @@ -64,6 +64,13 @@ "buffer_transcode", "date_format_parse", "json_parse_1mb", "json_stringify_1mb", "map_1m", "object_deep_clone", "promise_all_chains", "regex_replace", "string_concat_csv", "string_split_map_join", "string_template_interp", + # `batch` shipped with #7037 (b5dbf3f63), which added + # `app-patterns/kernels/batch.ts` and did not add it here. That commit + # both invalidated the artifact (kernels are in SOURCE_PATHS) and made + # regenerating it impossible: assembly aborts with `extra=['batch']` + # after all five measurement legs have already run. Adding a kernel + # must add it here in the same commit. + "batch", }, "honest_bench": {"image_convolution", "json_pipeline_small", "json_pipeline_full"}, } diff --git a/benchmarks/results/public-node-bun-v1.json b/benchmarks/results/public-node-bun-v1.json index 26305c5fdb..fbe4f8e5a4 100644 --- a/benchmarks/results/public-node-bun-v1.json +++ b/benchmarks/results/public-node-bun-v1.json @@ -1,35 +1,35 @@ { "schema_version": 1, "kind": "perry-public-node-bun-baseline", - "commit": "36cf04e0147c68a55f362689ab6c56e2b39a3c67", - "perry_version": "perry 0.5.1258", - "generated_at": "2026-07-13T14:10:04Z", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", + "perry_version": "perry 0.5.1279", + "generated_at": "2026-08-03T05:53:58Z", "freshness": { - "source_fingerprint": "9713a2e1131dbc407e2f6e7b056b9e2e1092ed45be7ecd5bf88b3d5a9910405f", - "harness_fingerprint": "437f64a8020aebd4d677405b4e5c8d915b2c76b10977df397ed324eef7b3ae23" + "source_fingerprint": "ca3101d49a02fdd17c3955c9d26d87206fe2d9e063ee5978b62181d59d5885d5", + "harness_fingerprint": "d3b461e2556b172209b20e5f2d40c96193933af865d67f9b7f7e4dbef0de72b0" }, "host": { - "os_version": "26.5.1", - "kernel": "Darwin Sergi.local 25.5.0 Darwin Kernel Version 25.5.0: Mon Apr 27 20:38:56 PDT 2026; root:xnu-12377.121.6~2/RELEASE_ARM64_T6000 arm64", + "os_version": "26.5", + "kernel": "Darwin MacBookPro.fritz.box 25.5.0 Darwin Kernel Version 25.5.0: Mon Apr 27 20:38:56 PDT 2026; root:xnu-12377.121.6~2/RELEASE_ARM64_T6000 arm64", "arch": "arm64", - "cpu": "Apple M1 Pro", + "cpu": "Apple M1 Max", "ncpu": "10", - "ram_gb": 16.0 + "ram_gb": 64.0 }, "runtimes": { "perry": { "available": true, - "version": "perry 0.5.1258", + "version": "perry 0.5.1279", "command": [ "" ], "compile_command": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "target/release/perry", "", "-o", "" ], - "resolved_executable": "/private/tmp/perry-performance-baseline-0713/target/release/perry" + "resolved_executable": "target/release/perry" }, "node": { "available": true, @@ -38,7 +38,7 @@ "node", "" ], - "resolved_executable": "/opt/homebrew/bin/node" + "resolved_executable": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node" }, "bun": { "available": true, @@ -48,7 +48,7 @@ "run", "" ], - "resolved_executable": "~/.bun/bin/bun" + "resolved_executable": "~/.cache/perry-bench-tools/bun/bun" } }, "policy": { @@ -69,8 +69,8 @@ "components": { "suite": { "schema_version": 2, - "commit": "36cf04e01", - "generated_at": "2026-07-13T11:47:56Z", + "commit": "defa4d601", + "generated_at": "2026-08-03T04:13:12Z", "run_config": { "requested_samples": 5, "expected_benchmarks": [ @@ -104,12 +104,12 @@ "runtimes": { "perry": { "available": true, - "version": "perry 0.5.1258", + "version": "perry 0.5.1279", "command": [ "" ], "compile_command": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "target/release/perry", "", "-o", "" @@ -139,33 +139,33 @@ "perry": { "wall_ms": { "samples": [ - 114, - 96, - 97, - 97, - 96 + 103, + 99, + 99, + 98, + 98 ], "sample_count": 5, - "median": 97, - "p95": 114, - "min": 96, - "max": 114, + "median": 99, + "p95": 103, + "min": 98, + "max": 103, "mad": 1, - "stdev": 7.014271 + "stdev": 1.854724 }, "rss_kb": { "samples": [ - 8144, - 8144, - 8144, - 8144, - 8144 + 3744, + 3744, + 3744, + 3744, + 3744 ], "sample_count": 5, - "median": 8144, - "p95": 8144, - "min": 8144, - "max": 8144, + "median": 3744, + "p95": 3744, + "min": 3744, + "max": 3744, "mad": 0, "stdev": 0 } @@ -173,80 +173,80 @@ "node": { "wall_ms": { "samples": [ - 82, + 78, 65, - 66, 65, - 66 + 63, + 65 ], "sample_count": 5, - "median": 66, - "p95": 82, - "min": 65, - "max": 82, - "mad": 1, - "stdev": 6.615134 + "median": 65, + "p95": 78, + "min": 63, + "max": 78, + "mad": 0, + "stdev": 5.455273 }, "rss_kb": { "samples": [ - 68448, - 68576, - 68992, - 68512, - 68096 + 68896, + 68528, + 68320, + 68416, + 68496 ], "sample_count": 5, - "median": 68512, - "p95": 68992, - "min": 68096, - "max": 68992, - "mad": 64, - "stdev": 286.645705 + "median": 68496, + "p95": 68896, + "min": 68320, + "max": 68896, + "mad": 80, + "stdev": 196.063663 } }, "bun": { "wall_ms": { "samples": [ - 51, - 41, 39, - 41, - 40 + 39, + 40, + 39, + 39 ], "sample_count": 5, - "median": 41, - "p95": 51, + "median": 39, + "p95": 40, "min": 39, - "max": 51, - "mad": 1, - "stdev": 4.363485 + "max": 40, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ - 30480, - 30608, + 30544, 30528, - 30512, - 30480 + 30560, + 30560, + 30592 ], "sample_count": 5, - "median": 30512, - "p95": 30608, - "min": 30480, - "max": 30608, - "mad": 32, - "stdev": 47.030203 + "median": 30560, + "p95": 30592, + "min": 30528, + "max": 30592, + "mad": 16, + "stdev": 21.226399 } } }, "ratios": { "perry_to_node": { - "wall_time": 1.469697, - "rss": 0.11887 + "wall_time": 1.523077, + "rss": 0.05466 }, "perry_to_bun": { - "wall_time": 2.365854, - "rss": 0.266911 + "wall_time": 2.538462, + "rss": 0.122513 } }, "correctness": { @@ -260,128 +260,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 97, - "perry_rss_kb": 8144, - "node_ms": 66, - "node_rss_kb": 68512, - "bun_ms": 41, - "bun_rss_kb": 30512, - "speed_ratio": 1.469697, - "memory_ratio": 0.11887 + "perry_ms": 99, + "perry_rss_kb": 3744, + "node_ms": 65, + "node_rss_kb": 68496, + "bun_ms": 39, + "bun_rss_kb": 30560, + "speed_ratio": 1.523077, + "memory_ratio": 0.05466 }, "03_array_write": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 10, - 5, - 8, - 3, - 5 + 1, + 1, + 1, + 1, + 1 ], "sample_count": 5, - "median": 5, - "p95": 10, - "min": 3, - "max": 10, - "mad": 2, - "stdev": 2.481935 + "median": 1, + "p95": 1, + "min": 1, + "max": 1, + "mad": 0, + "stdev": 0 }, "rss_kb": { "samples": [ - 99344, - 99392, - 99344, - 99344, - 99344 + 94720, + 94704, + 94704, + 94704, + 94704 ], "sample_count": 5, - "median": 99344, - "p95": 99392, - "min": 99344, - "max": 99392, + "median": 94704, + "p95": 94720, + "min": 94704, + "max": 94720, "mad": 0, - "stdev": 19.2 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 8, - 8, - 8, - 8, + 7, + 7, + 7, + 6, 7 ], "sample_count": 5, - "median": 8, - "p95": 8, - "min": 7, - "max": 8, + "median": 7, + "p95": 7, + "min": 6, + "max": 7, "mad": 0, "stdev": 0.4 }, "rss_kb": { "samples": [ - 374448, - 374144, - 373952, + 374272, + 374368, 374192, - 374336 + 374272, + 374240 ], "sample_count": 5, - "median": 374192, - "p95": 374448, - "min": 373952, - "max": 374448, - "mad": 144, - "stdev": 169.50941 + "median": 374272, + "p95": 374368, + "min": 374192, + "max": 374368, + "mad": 32, + "stdev": 57.6 } }, "bun": { "wall_ms": { "samples": [ - 6, - 6, - 7, 5, - 6 + 5, + 5, + 5, + 5 ], "sample_count": 5, - "median": 6, - "p95": 7, + "median": 5, + "p95": 5, "min": 5, - "max": 7, + "max": 5, "mad": 0, - "stdev": 0.632456 + "stdev": 0 }, "rss_kb": { "samples": [ - 291104, - 291200, - 245408, - 202992, - 291088 + 284688, + 287792, + 291168, + 267264, + 203008 ], "sample_count": 5, - "median": 291088, - "p95": 291200, - "min": 202992, - "max": 291200, - "mad": 112, - "stdev": 35426.608179 + "median": 284688, + "p95": 291168, + "min": 203008, + "max": 291168, + "mad": 6480, + "stdev": 32936.536891 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.625, - "rss": 0.265489 + "wall_time": 0.142857, + "rss": 0.253035 }, "perry_to_bun": { - "wall_time": 0.833333, - "rss": 0.341285 + "wall_time": 0.2, + "rss": 0.332659 } }, "correctness": { @@ -395,128 +395,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 5, - "perry_rss_kb": 99344, - "node_ms": 8, - "node_rss_kb": 374192, - "bun_ms": 6, - "bun_rss_kb": 291088, - "speed_ratio": 0.625, - "memory_ratio": 0.265489 + "perry_ms": 1, + "perry_rss_kb": 94704, + "node_ms": 7, + "node_rss_kb": 374272, + "bun_ms": 5, + "bun_rss_kb": 284688, + "speed_ratio": 0.142857, + "memory_ratio": 0.253035 }, "04_array_read": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 106, - 97, - 95, - 98, - 96 + 33, + 24, + 24, + 24, + 24 ], "sample_count": 5, - "median": 97, - "p95": 106, - "min": 95, - "max": 106, - "mad": 1, - "stdev": 3.929377 + "median": 24, + "p95": 33, + "min": 24, + "max": 33, + "mad": 0, + "stdev": 3.6 }, "rss_kb": { "samples": [ - 99328, - 99312, - 99312, - 99312, - 99312 + 94720, + 94720, + 94720, + 94720, + 94720 ], "sample_count": 5, - "median": 99312, - "p95": 99328, - "min": 99312, - "max": 99328, + "median": 94720, + "p95": 94720, + "min": 94720, + "max": 94720, "mad": 0, - "stdev": 6.4 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 12, - 12, - 14, 11, + 10, + 10, + 10, 11 ], "sample_count": 5, - "median": 12, - "p95": 14, - "min": 11, - "max": 14, - "mad": 1, - "stdev": 1.095445 + "median": 10, + "p95": 11, + "min": 10, + "max": 11, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 375296, - 374816, - 374448, - 374432, - 374800 + 374800, + 374480, + 374464, + 374416, + 374496 ], "sample_count": 5, - "median": 374800, - "p95": 375296, - "min": 374432, - "max": 375296, - "mad": 352, - "stdev": 315.260908 + "median": 374480, + "p95": 374800, + "min": 374416, + "max": 374800, + "mad": 16, + "stdev": 137.040724 } }, "bun": { "wall_ms": { "samples": [ - 20, - 16, - 17, - 17, - 15 + 13, + 13, + 13, + 14, + 13 ], "sample_count": 5, - "median": 17, - "p95": 20, - "min": 15, - "max": 20, - "mad": 1, - "stdev": 1.67332 + "median": 13, + "p95": 14, + "min": 13, + "max": 14, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ + 283648, + 272528, 291888, - 285456, - 283584, - 283568, - 267936 + 288448, + 285456 ], "sample_count": 5, - "median": 283584, + "median": 285456, "p95": 291888, - "min": 267936, + "min": 272528, "max": 291888, - "mad": 1872, - "stdev": 7890.466795 + "mad": 2992, + "stdev": 6558.67772 } } }, "ratios": { "perry_to_node": { - "wall_time": 8.083333, - "rss": 0.264973 + "wall_time": 2.4, + "rss": 0.252937 }, "perry_to_bun": { - "wall_time": 5.705882, - "rss": 0.350203 + "wall_time": 1.846154, + "rss": 0.33182 } }, "correctness": { @@ -530,128 +530,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 97, - "perry_rss_kb": 99312, - "node_ms": 12, - "node_rss_kb": 374800, - "bun_ms": 17, - "bun_rss_kb": 283584, - "speed_ratio": 8.083333, - "memory_ratio": 0.264973 + "perry_ms": 24, + "perry_rss_kb": 94720, + "node_ms": 10, + "node_rss_kb": 374480, + "bun_ms": 13, + "bun_rss_kb": 285456, + "speed_ratio": 2.4, + "memory_ratio": 0.252937 }, "05_fibonacci": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 329, - 310, - 309, - 310, - 309 + 411, + 387, + 387, + 387, + 387 ], "sample_count": 5, - "median": 310, - "p95": 329, - "min": 309, - "max": 329, - "mad": 1, - "stdev": 7.81281 + "median": 387, + "p95": 411, + "min": 387, + "max": 411, + "mad": 0, + "stdev": 9.6 }, "rss_kb": { "samples": [ - 8224, - 8240, - 8256, - 8224, - 8224 + 3872, + 3872, + 3872, + 3872, + 3872 ], "sample_count": 5, - "median": 8224, - "p95": 8256, - "min": 8224, - "max": 8256, + "median": 3872, + "p95": 3872, + "min": 3872, + "max": 3872, "mad": 0, - "stdev": 12.8 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 948, - 943, - 947, - 950, - 955 + 909, + 909, + 908, + 908, + 906 ], "sample_count": 5, - "median": 948, - "p95": 955, - "min": 943, - "max": 955, - "mad": 2, - "stdev": 3.929377 + "median": 908, + "p95": 909, + "min": 906, + "max": 909, + "mad": 1, + "stdev": 1.095445 }, "rss_kb": { "samples": [ - 68816, - 68832, - 68880, - 68608, - 68432 + 68368, + 68512, + 68432, + 68384, + 68336 ], "sample_count": 5, - "median": 68816, - "p95": 68880, - "min": 68432, - "max": 68880, - "mad": 64, - "stdev": 168.904233 + "median": 68384, + "p95": 68512, + "min": 68336, + "max": 68512, + "mad": 48, + "stdev": 61.219605 } }, "bun": { "wall_ms": { "samples": [ - 523, - 527, - 519, - 525, - 521 + 505, + 503, + 499, + 504, + 504 ], "sample_count": 5, - "median": 523, - "p95": 527, - "min": 519, - "max": 527, - "mad": 2, - "stdev": 2.828427 + "median": 504, + "p95": 505, + "min": 499, + "max": 505, + "mad": 1, + "stdev": 2.097618 }, "rss_kb": { "samples": [ 29536, - 29520, + 29584, 29440, - 29488, - 29456 + 29536, + 29536 ], "sample_count": 5, - "median": 29488, - "p95": 29536, + "median": 29536, + "p95": 29584, "min": 29440, - "max": 29536, - "mad": 32, - "stdev": 36.485614 + "max": 29584, + "mad": 0, + "stdev": 47.030203 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.327004, - "rss": 0.119507 + "wall_time": 0.426211, + "rss": 0.056621 }, "perry_to_bun": { - "wall_time": 0.592734, - "rss": 0.278893 + "wall_time": 0.767857, + "rss": 0.131094 } }, "correctness": { @@ -665,128 +665,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 310, - "perry_rss_kb": 8224, - "node_ms": 948, - "node_rss_kb": 68816, - "bun_ms": 523, - "bun_rss_kb": 29488, - "speed_ratio": 0.327004, - "memory_ratio": 0.119507 + "perry_ms": 387, + "perry_rss_kb": 3872, + "node_ms": 908, + "node_rss_kb": 68384, + "bun_ms": 504, + "bun_rss_kb": 29536, + "speed_ratio": 0.426211, + "memory_ratio": 0.056621 }, "06_math_intensive": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 70, - 51, - 51, - 51, - 52 + 72, + 49, + 49, + 49, + 49 ], "sample_count": 5, - "median": 51, - "p95": 70, - "min": 51, - "max": 70, + "median": 49, + "p95": 72, + "min": 49, + "max": 72, "mad": 0, - "stdev": 7.509993 + "stdev": 9.2 }, "rss_kb": { "samples": [ - 8112, - 8112, - 8112, - 8112, - 8112 + 3824, + 3824, + 3824, + 3824, + 3840 ], "sample_count": 5, - "median": 8112, - "p95": 8112, - "min": 8112, - "max": 8112, + "median": 3824, + "p95": 3840, + "min": 3824, + "max": 3840, "mad": 0, - "stdev": 0 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 52, - 51, - 51, - 51, - 52 + 49, + 49, + 49, + 49, + 48 ], "sample_count": 5, - "median": 51, - "p95": 52, - "min": 51, - "max": 52, + "median": 49, + "p95": 49, + "min": 48, + "max": 49, "mad": 0, - "stdev": 0.489898 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 70608, - 70672, + 70992, 70528, - 70688, + 70944, + 70592, 70544 ], "sample_count": 5, - "median": 70608, - "p95": 70688, + "median": 70592, + "p95": 70992, "min": 70528, - "max": 70688, + "max": 70992, "mad": 64, - "stdev": 64.795062 + "stdev": 204.148965 } }, "bun": { "wall_ms": { "samples": [ - 51, - 51, - 51, - 51, - 51 + 48, + 49, + 48, + 49, + 49 ], "sample_count": 5, - "median": 51, - "p95": 51, - "min": 51, - "max": 51, + "median": 49, + "p95": 49, + "min": 48, + "max": 49, "mad": 0, - "stdev": 0 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 30784, 30816, - 30704, - 30688, - 30704 + 30800, + 30832, + 30816, + 30800 ], "sample_count": 5, - "median": 30704, - "p95": 30816, - "min": 30688, - "max": 30816, + "median": 30816, + "p95": 30832, + "min": 30800, + "max": 30832, "mad": 16, - "stdev": 50.999608 + "stdev": 11.973304 } } }, "ratios": { "perry_to_node": { "wall_time": 1.0, - "rss": 0.114888 + "rss": 0.05417 }, "perry_to_bun": { "wall_time": 1.0, - "rss": 0.2642 + "rss": 0.124091 } }, "correctness": { @@ -800,128 +800,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 51, - "perry_rss_kb": 8112, - "node_ms": 51, - "node_rss_kb": 70608, - "bun_ms": 51, - "bun_rss_kb": 30704, + "perry_ms": 49, + "perry_rss_kb": 3824, + "node_ms": 49, + "node_rss_kb": 70592, + "bun_ms": 49, + "bun_rss_kb": 30816, "speed_ratio": 1.0, - "memory_ratio": 0.114888 + "memory_ratio": 0.05417 }, "07_object_create": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 7, - 4, - 5, - 4, - 4 + 8, + 3, + 3, + 3, + 3 ], "sample_count": 5, - "median": 4, - "p95": 7, - "min": 4, - "max": 7, + "median": 3, + "p95": 8, + "min": 3, + "max": 8, "mad": 0, - "stdev": 1.16619 + "stdev": 2 }, "rss_kb": { "samples": [ - 8256, - 8272, - 8272, - 8256, - 8256 + 4656, + 4656, + 4656, + 4656, + 4656 ], "sample_count": 5, - "median": 8256, - "p95": 8272, - "min": 8256, - "max": 8272, + "median": 4656, + "p95": 4656, + "min": 4656, + "max": 4656, "mad": 0, - "stdev": 7.838367 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 6, 5, 5, - 6, - 5 + 5, + 5, + 4 ], "sample_count": 5, "median": 5, - "p95": 6, - "min": 5, - "max": 6, + "p95": 5, + "min": 4, + "max": 5, "mad": 0, - "stdev": 0.489898 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 70800, - 71232, - 71264, - 71424, - 71040 - ], - "sample_count": 5, - "median": 71232, - "p95": 71424, - "min": 70800, - "max": 71424, - "mad": 192, - "stdev": 214.184967 + 70944, + 71120, + 71184, + 71184, + 71152 + ], + "sample_count": 5, + "median": 71152, + "p95": 71184, + "min": 70944, + "max": 71184, + "mad": 32, + "stdev": 89.6 } }, "bun": { "wall_ms": { "samples": [ - 8, - 6, 6, 6, - 6 + 5, + 5, + 5 ], "sample_count": 5, - "median": 6, - "p95": 8, - "min": 6, - "max": 8, + "median": 5, + "p95": 6, + "min": 5, + "max": 6, "mad": 0, - "stdev": 0.8 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 54912, - 48672, + 49040, + 48896, 48912, - 50096, - 48960 + 49040, + 49056 ], "sample_count": 5, - "median": 48960, - "p95": 54912, - "min": 48672, - "max": 54912, - "mad": 288, - "stdev": 2353.046842 + "median": 49040, + "p95": 49056, + "min": 48896, + "max": 49056, + "mad": 16, + "stdev": 69.668931 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.8, - "rss": 0.115903 + "wall_time": 0.6, + "rss": 0.065437 }, "perry_to_bun": { - "wall_time": 0.666667, - "rss": 0.168627 + "wall_time": 0.6, + "rss": 0.094943 } }, "correctness": { @@ -935,47 +935,47 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 4, - "perry_rss_kb": 8256, + "perry_ms": 3, + "perry_rss_kb": 4656, "node_ms": 5, - "node_rss_kb": 71232, - "bun_ms": 6, - "bun_rss_kb": 48960, - "speed_ratio": 0.8, - "memory_ratio": 0.115903 + "node_rss_kb": 71152, + "bun_ms": 5, + "bun_rss_kb": 49040, + "speed_ratio": 0.6, + "memory_ratio": 0.065437 }, "08_string_concat": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 3, - 3, - 2, - 3, - 3 + 1, + 1, + 1, + 1, + 2 ], "sample_count": 5, - "median": 3, - "p95": 3, - "min": 2, - "max": 3, + "median": 1, + "p95": 2, + "min": 1, + "max": 2, "mad": 0, "stdev": 0.4 }, "rss_kb": { "samples": [ - 8544, - 8544, - 8560, - 8544, - 8544 + 4224, + 4224, + 4240, + 4224, + 4224 ], "sample_count": 5, - "median": 8544, - "p95": 8560, - "min": 8544, - "max": 8560, + "median": 4224, + "p95": 4240, + "min": 4224, + "max": 4240, "mad": 0, "stdev": 6.4 } @@ -983,80 +983,80 @@ "node": { "wall_ms": { "samples": [ - 6, - 5, - 5, - 5, - 5 + 4, + 4, + 4, + 4, + 4 ], "sample_count": 5, - "median": 5, - "p95": 6, - "min": 5, - "max": 6, + "median": 4, + "p95": 4, + "min": 4, + "max": 4, "mad": 0, - "stdev": 0.4 + "stdev": 0 }, "rss_kb": { "samples": [ 73840, - 74128, - 74032, - 73936, - 74096 + 73824, + 73760, + 73760, + 73696 ], "sample_count": 5, - "median": 74032, - "p95": 74128, - "min": 73840, - "max": 74128, - "mad": 96, - "stdev": 105.93885 + "median": 73760, + "p95": 73840, + "min": 73696, + "max": 73840, + "mad": 64, + "stdev": 51.59845 } }, "bun": { "wall_ms": { "samples": [ - 2, 1, 1, 1, - 2 + 1, + 1 ], "sample_count": 5, "median": 1, - "p95": 2, + "p95": 1, "min": 1, - "max": 2, + "max": 1, "mad": 0, - "stdev": 0.489898 + "stdev": 0 }, "rss_kb": { "samples": [ - 30048, - 30208, - 30304, - 30256, - 30352 + 30288, + 30288, + 30272, + 30288, + 30288 ], "sample_count": 5, - "median": 30256, - "p95": 30352, - "min": 30048, - "max": 30352, - "mad": 48, - "stdev": 104.478897 + "median": 30288, + "p95": 30288, + "min": 30272, + "max": 30288, + "mad": 0, + "stdev": 6.4 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.6, - "rss": 0.11541 + "wall_time": 0.25, + "rss": 0.057267 }, "perry_to_bun": { - "wall_time": 3.0, - "rss": 0.28239 + "wall_time": 1.0, + "rss": 0.139461 } }, "correctness": { @@ -1070,14 +1070,14 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 3, - "perry_rss_kb": 8544, - "node_ms": 5, - "node_rss_kb": 74032, + "perry_ms": 1, + "perry_rss_kb": 4224, + "node_ms": 4, + "node_rss_kb": 73760, "bun_ms": 1, - "bun_rss_kb": 30256, - "speed_ratio": 0.6, - "memory_ratio": 0.11541 + "bun_rss_kb": 30288, + "speed_ratio": 0.25, + "memory_ratio": 0.057267 }, "09_method_calls": { "runtimes": { @@ -1085,113 +1085,113 @@ "wall_ms": { "samples": [ 97, - 82, - 92, - 81, - 82 + 79, + 78, + 79, + 78 ], "sample_count": 5, - "median": 82, + "median": 79, "p95": 97, - "min": 81, + "min": 78, "max": 97, "mad": 1, - "stdev": 6.493073 + "stdev": 7.413501 }, "rss_kb": { "samples": [ - 11856, - 11808, - 11840, - 11824, - 11808 + 7792, + 7760, + 7760, + 7760, + 7760 ], "sample_count": 5, - "median": 11824, - "p95": 11856, - "min": 11808, - "max": 11856, - "mad": 16, - "stdev": 18.659046 + "median": 7760, + "p95": 7792, + "min": 7760, + "max": 7792, + "mad": 0, + "stdev": 12.8 } }, "node": { "wall_ms": { "samples": [ 11, + 10, 11, - 11, - 11, - 12 + 10, + 10 ], "sample_count": 5, - "median": 11, - "p95": 12, - "min": 11, - "max": 12, + "median": 10, + "p95": 11, + "min": 10, + "max": 11, "mad": 0, - "stdev": 0.4 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 69120, - 68880, - 69136, - 69024, - 69168 + 69040, + 68864, + 68800, + 68848, + 68912 ], "sample_count": 5, - "median": 69120, - "p95": 69168, - "min": 68880, - "max": 69168, + "median": 68864, + "p95": 69040, + "min": 68800, + "max": 69040, "mad": 48, - "stdev": 104.478897 + "stdev": 81.834956 } }, "bun": { "wall_ms": { "samples": [ - 10, + 9, + 8, 8, 8, - 9, 8 ], "sample_count": 5, "median": 8, - "p95": 10, + "p95": 9, "min": 8, - "max": 10, + "max": 9, "mad": 0, - "stdev": 0.8 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 32448, - 31664, - 31808, - 31744, - 32432 + 31696, + 31680, + 31696, + 31680, + 32400 ], "sample_count": 5, - "median": 31808, - "p95": 32448, - "min": 31664, - "max": 32448, - "mad": 144, - "stdev": 346.635486 + "median": 31696, + "p95": 32400, + "min": 31680, + "max": 32400, + "mad": 16, + "stdev": 284.889873 } } }, "ratios": { "perry_to_node": { - "wall_time": 7.454545, - "rss": 0.171065 + "wall_time": 7.9, + "rss": 0.112686 }, "perry_to_bun": { - "wall_time": 10.25, - "rss": 0.37173 + "wall_time": 9.875, + "rss": 0.244826 } }, "correctness": { @@ -1205,128 +1205,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 82, - "perry_rss_kb": 11824, - "node_ms": 11, - "node_rss_kb": 69120, + "perry_ms": 79, + "perry_rss_kb": 7760, + "node_ms": 10, + "node_rss_kb": 68864, "bun_ms": 8, - "bun_rss_kb": 31808, - "speed_ratio": 7.454545, - "memory_ratio": 0.171065 + "bun_rss_kb": 31696, + "speed_ratio": 7.9, + "memory_ratio": 0.112686 }, "10_nested_loops": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 181, - 162, - 165, - 163, - 164 + 61, + 42, + 42, + 42, + 42 ], "sample_count": 5, - "median": 164, - "p95": 181, - "min": 162, - "max": 181, - "mad": 1, - "stdev": 7.071068 + "median": 42, + "p95": 61, + "min": 42, + "max": 61, + "mad": 0, + "stdev": 7.6 }, "rss_kb": { "samples": [ - 11856, - 11856, - 11856, - 11888, - 11856 + 7648, + 7648, + 7648, + 7648, + 7648 ], "sample_count": 5, - "median": 11856, - "p95": 11888, - "min": 11856, - "max": 11888, + "median": 7648, + "p95": 7648, + "min": 7648, + "max": 7648, "mad": 0, - "stdev": 12.8 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 20, - 19, - 19, + 17, + 18, 18, - 18 + 17, + 17 ], "sample_count": 5, - "median": 19, - "p95": 20, - "min": 18, - "max": 20, - "mad": 1, - "stdev": 0.748331 + "median": 17, + "p95": 18, + "min": 17, + "max": 18, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 70832, - 71184, - 71072, - 71200, - 71104 + 70720, + 70864, + 70800, + 70560, + 70736 ], "sample_count": 5, - "median": 71104, - "p95": 71200, - "min": 70832, - "max": 71200, - "mad": 80, - "stdev": 132.172009 + "median": 70736, + "p95": 70864, + "min": 70560, + "max": 70864, + "mad": 64, + "stdev": 101.697591 } }, "bun": { "wall_ms": { "samples": [ - 20, - 20, - 20, - 20, - 20 + 18, + 18, + 18, + 19, + 19 ], "sample_count": 5, - "median": 20, - "p95": 20, - "min": 20, - "max": 20, + "median": 18, + "p95": 19, + "min": 18, + "max": 19, "mad": 0, - "stdev": 0 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 33184, 33024, - 33104, - 33200, - 33184 + 33024, + 33008, + 33008, + 33088 ], "sample_count": 5, - "median": 33184, - "p95": 33200, - "min": 33024, - "max": 33200, + "median": 33024, + "p95": 33088, + "min": 33008, + "max": 33088, "mad": 16, - "stdev": 66.664533 + "stdev": 29.675579 } } }, "ratios": { "perry_to_node": { - "wall_time": 8.631579, - "rss": 0.166742 + "wall_time": 2.470588, + "rss": 0.10812 }, "perry_to_bun": { - "wall_time": 8.2, - "rss": 0.357281 + "wall_time": 2.333333, + "rss": 0.231589 } }, "correctness": { @@ -1340,83 +1340,83 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 164, - "perry_rss_kb": 11856, - "node_ms": 19, - "node_rss_kb": 71104, - "bun_ms": 20, - "bun_rss_kb": 33184, - "speed_ratio": 8.631579, - "memory_ratio": 0.166742 + "perry_ms": 42, + "perry_rss_kb": 7648, + "node_ms": 17, + "node_rss_kb": 70736, + "bun_ms": 18, + "bun_rss_kb": 33024, + "speed_ratio": 2.470588, + "memory_ratio": 0.10812 }, "11_prime_sieve": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 258, - 253, - 254, - 254, - 250 + 114, + 107, + 106, + 108, + 106 ], "sample_count": 5, - "median": 254, - "p95": 258, - "min": 250, - "max": 258, + "median": 107, + "p95": 114, + "min": 106, + "max": 114, "mad": 1, - "stdev": 2.56125 + "stdev": 2.993326 }, "rss_kb": { "samples": [ - 30160, - 30160, - 30160, - 30192, - 30144 + 26672, + 26656, + 26656, + 26656, + 26656 ], "sample_count": 5, - "median": 30160, - "p95": 30192, - "min": 30144, - "max": 30192, + "median": 26656, + "p95": 26672, + "min": 26656, + "max": 26672, "mad": 0, - "stdev": 15.676734 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ + 5, 6, - 7, - 7, - 7, - 6 + 6, + 6, + 5 ], "sample_count": 5, - "median": 7, - "p95": 7, - "min": 6, - "max": 7, + "median": 6, + "p95": 6, + "min": 5, + "max": 6, "mad": 0, "stdev": 0.489898 }, "rss_kb": { "samples": [ - 101136, - 100720, - 100496, - 100320, - 100752 + 100400, + 100544, + 100576, + 100432, + 100640 ], "sample_count": 5, - "median": 100720, - "p95": 101136, - "min": 100320, - "max": 101136, - "mad": 224, - "stdev": 274.976654 + "median": 100544, + "p95": 100640, + "min": 100400, + "max": 100640, + "mad": 96, + "stdev": 89.714213 } }, "bun": { @@ -1424,44 +1424,44 @@ "samples": [ 5, 5, - 6, - 6, + 5, + 5, 5 ], "sample_count": 5, "median": 5, - "p95": 6, + "p95": 5, "min": 5, - "max": 6, + "max": 5, "mad": 0, - "stdev": 0.489898 + "stdev": 0 }, "rss_kb": { "samples": [ - 62128, - 62096, - 67360, - 67392, - 62176 + 62176, + 55744, + 62192, + 67344, + 67328 ], "sample_count": 5, - "median": 62176, - "p95": 67392, - "min": 62096, - "max": 67392, - "mad": 80, - "stdev": 2568.517829 + "median": 62192, + "p95": 67344, + "min": 55744, + "max": 67344, + "mad": 5136, + "stdev": 4279.578596 } } }, "ratios": { "perry_to_node": { - "wall_time": 36.285714, - "rss": 0.299444 + "wall_time": 17.833333, + "rss": 0.265118 }, "perry_to_bun": { - "wall_time": 50.8, - "rss": 0.485075 + "wall_time": 21.4, + "rss": 0.428608 } }, "correctness": { @@ -1475,128 +1475,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 254, - "perry_rss_kb": 30160, - "node_ms": 7, - "node_rss_kb": 100720, + "perry_ms": 107, + "perry_rss_kb": 26656, + "node_ms": 6, + "node_rss_kb": 100544, "bun_ms": 5, - "bun_rss_kb": 62176, - "speed_ratio": 36.285714, - "memory_ratio": 0.299444 + "bun_rss_kb": 62192, + "speed_ratio": 17.833333, + "memory_ratio": 0.265118 }, "12_binary_trees": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 12, + 10, 5, - 6, - 6, - 6 + 4, + 4, + 4 ], "sample_count": 5, - "median": 6, - "p95": 12, - "min": 5, - "max": 12, + "median": 4, + "p95": 10, + "min": 4, + "max": 10, "mad": 0, - "stdev": 2.529822 + "stdev": 2.332381 }, "rss_kb": { "samples": [ - 8288, - 8320, - 8304, - 8288, - 8288 + 4640, + 4640, + 4640, + 4656, + 4640 ], "sample_count": 5, - "median": 8288, - "p95": 8320, - "min": 8288, - "max": 8320, + "median": 4640, + "p95": 4656, + "min": 4640, + "max": 4656, "mad": 0, - "stdev": 12.8 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 7, - 7, - 7, - 7, - 7 + 5, + 6, + 6, + 6, + 6 ], "sample_count": 5, - "median": 7, - "p95": 7, - "min": 7, - "max": 7, + "median": 6, + "p95": 6, + "min": 5, + "max": 6, "mad": 0, - "stdev": 0 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 71104, - 71152, - 71472, + 71072, + 70976, + 71008, 71312, - 71360 + 71184 ], "sample_count": 5, - "median": 71312, - "p95": 71472, - "min": 71104, - "max": 71472, - "mad": 160, - "stdev": 135.386853 + "median": 71072, + "p95": 71312, + "min": 70976, + "max": 71312, + "mad": 96, + "stdev": 123.355746 } }, "bun": { "wall_ms": { "samples": [ - 9, - 8, - 9, - 8, - 8 + 6, + 6, + 6, + 6, + 7 ], "sample_count": 5, - "median": 8, - "p95": 9, - "min": 8, - "max": 9, + "median": 6, + "p95": 7, + "min": 6, + "max": 7, "mad": 0, - "stdev": 0.489898 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 54688, - 51328, - 52480, - 50880, - 51408 + 51584, + 51648, + 51360, + 51712, + 51648 ], "sample_count": 5, - "median": 51408, - "p95": 54688, - "min": 50880, - "max": 54688, - "mad": 528, - "stdev": 1370.34746 + "median": 51648, + "p95": 51712, + "min": 51360, + "max": 51712, + "mad": 64, + "stdev": 122.104218 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.857143, - "rss": 0.116222 + "wall_time": 0.666667, + "rss": 0.065286 }, "perry_to_bun": { - "wall_time": 0.75, - "rss": 0.16122 + "wall_time": 0.666667, + "rss": 0.089839 } }, "correctness": { @@ -1610,128 +1610,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 6, - "perry_rss_kb": 8288, - "node_ms": 7, - "node_rss_kb": 71312, - "bun_ms": 8, - "bun_rss_kb": 51408, - "speed_ratio": 0.857143, - "memory_ratio": 0.116222 + "perry_ms": 4, + "perry_rss_kb": 4640, + "node_ms": 6, + "node_rss_kb": 71072, + "bun_ms": 6, + "bun_rss_kb": 51648, + "speed_ratio": 0.666667, + "memory_ratio": 0.065286 }, "13_factorial": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 1568, - 1549, - 1554, - 1555, - 1641 + 116, + 94, + 93, + 93, + 94 ], "sample_count": 5, - "median": 1555, - "p95": 1641, - "min": 1549, - "max": 1641, - "mad": 6, - "stdev": 34.3779 + "median": 94, + "p95": 116, + "min": 93, + "max": 116, + "mad": 1, + "stdev": 9.011104 }, "rss_kb": { "samples": [ - 8160, - 8160, - 8160, - 8160, - 7392 + 3792, + 3792, + 3792, + 3808, + 3792 ], "sample_count": 5, - "median": 8160, - "p95": 8160, - "min": 7392, - "max": 8160, + "median": 3792, + "p95": 3808, + "min": 3792, + "max": 3808, "mad": 0, - "stdev": 307.2 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 115, - 98, - 99, - 106, - 98 + 94, + 95, + 95, + 95, + 94 ], "sample_count": 5, - "median": 99, - "p95": 115, - "min": 98, - "max": 115, - "mad": 1, - "stdev": 6.615134 + "median": 95, + "p95": 95, + "min": 94, + "max": 95, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 70128, - 70352, - 69968, - 70448, - 70016 + 69904, + 70048, + 69872, + 69760, + 69792 ], "sample_count": 5, - "median": 70128, - "p95": 70448, - "min": 69968, - "max": 70448, - "mad": 160, - "stdev": 187.575691 + "median": 69872, + "p95": 70048, + "min": 69760, + "max": 70048, + "mad": 80, + "stdev": 100.88885 } }, "bun": { "wall_ms": { "samples": [ - 116, - 99, - 99, - 100, - 98 + 95, + 94, + 95, + 95, + 95 ], "sample_count": 5, - "median": 99, - "p95": 116, - "min": 98, - "max": 116, - "mad": 1, - "stdev": 6.829348 + "median": 95, + "p95": 95, + "min": 94, + "max": 95, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ - 31088, - 31488, 31472, - 31408, - 31408 + 31456, + 31472, + 31472, + 31456 ], "sample_count": 5, - "median": 31408, - "p95": 31488, - "min": 31088, - "max": 31488, - "mad": 64, - "stdev": 146.082716 + "median": 31472, + "p95": 31472, + "min": 31456, + "max": 31472, + "mad": 0, + "stdev": 7.838367 } } }, "ratios": { "perry_to_node": { - "wall_time": 15.707071, - "rss": 0.116359 + "wall_time": 0.989474, + "rss": 0.054271 }, "perry_to_bun": { - "wall_time": 15.707071, - "rss": 0.259806 + "wall_time": 0.989474, + "rss": 0.120488 } }, "correctness": { @@ -1745,14 +1745,14 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 1555, - "perry_rss_kb": 8160, - "node_ms": 99, - "node_rss_kb": 70128, - "bun_ms": 99, - "bun_rss_kb": 31408, - "speed_ratio": 15.707071, - "memory_ratio": 0.116359 + "perry_ms": 94, + "perry_rss_kb": 3792, + "node_ms": 95, + "node_rss_kb": 69872, + "bun_ms": 95, + "bun_rss_kb": 31472, + "speed_ratio": 0.989474, + "memory_ratio": 0.054271 }, "14_closure": { "runtimes": { @@ -1760,113 +1760,113 @@ "wall_ms": { "samples": [ 67, - 49, - 49, - 48, - 48 + 46, + 47, + 46, + 46 ], "sample_count": 5, - "median": 49, + "median": 46, "p95": 67, - "min": 48, + "min": 46, "max": 67, - "mad": 1, - "stdev": 7.413501 + "mad": 0, + "stdev": 8.309031 }, "rss_kb": { "samples": [ - 8208, - 8208, - 8208, - 8240, - 8208 + 3888, + 3888, + 3888, + 3888, + 3888 ], "sample_count": 5, - "median": 8208, - "p95": 8240, - "min": 8208, - "max": 8240, + "median": 3888, + "p95": 3888, + "min": 3888, + "max": 3888, "mad": 0, - "stdev": 12.8 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 51, - 50, - 51, - 51, - 51 + 49, + 49, + 48, + 48, + 49 ], "sample_count": 5, - "median": 51, - "p95": 51, - "min": 50, - "max": 51, + "median": 49, + "p95": 49, + "min": 48, + "max": 49, "mad": 0, - "stdev": 0.4 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 71344, - 70992, - 71008, - 71008, - 70944 + 70880, + 70784, + 70832, + 70784, + 70912 ], "sample_count": 5, - "median": 71008, - "p95": 71344, - "min": 70944, - "max": 71344, - "mad": 16, - "stdev": 144.319645 + "median": 70832, + "p95": 70912, + "min": 70784, + "max": 70912, + "mad": 48, + "stdev": 51.2 } }, "bun": { "wall_ms": { "samples": [ - 52, - 50, - 50, - 52, - 51 + 49, + 49, + 49, + 49, + 49 ], "sample_count": 5, - "median": 51, - "p95": 52, - "min": 50, - "max": 52, - "mad": 1, - "stdev": 0.894427 + "median": 49, + "p95": 49, + "min": 49, + "max": 49, + "mad": 0, + "stdev": 0 }, "rss_kb": { "samples": [ - 31312, - 31424, - 31328, 31376, + 31376, + 31408, + 31360, 31376 ], "sample_count": 5, "median": 31376, - "p95": 31424, - "min": 31312, - "max": 31424, - "mad": 48, - "stdev": 39.710956 + "p95": 31408, + "min": 31360, + "max": 31408, + "mad": 0, + "stdev": 15.676734 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.960784, - "rss": 0.115593 + "wall_time": 0.938776, + "rss": 0.05489 }, "perry_to_bun": { - "wall_time": 0.960784, - "rss": 0.261601 + "wall_time": 0.938776, + "rss": 0.123916 } }, "correctness": { @@ -1880,128 +1880,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 49, - "perry_rss_kb": 8208, - "node_ms": 51, - "node_rss_kb": 71008, - "bun_ms": 51, + "perry_ms": 46, + "perry_rss_kb": 3888, + "node_ms": 49, + "node_rss_kb": 70832, + "bun_ms": 49, "bun_rss_kb": 31376, - "speed_ratio": 0.960784, - "memory_ratio": 0.115593 + "speed_ratio": 0.938776, + "memory_ratio": 0.05489 }, "15_mandelbrot": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 38, - 23, - 23, + 33, + 22, + 22, 22, 22 ], "sample_count": 5, - "median": 23, - "p95": 38, + "median": 22, + "p95": 33, "min": 22, - "max": 38, - "mad": 1, - "stdev": 6.216108 + "max": 33, + "mad": 0, + "stdev": 4.4 }, "rss_kb": { "samples": [ - 8128, - 8144, - 8144, - 8128, - 8128 + 3744, + 3744, + 3760, + 3744, + 3744 ], "sample_count": 5, - "median": 8128, - "p95": 8144, - "min": 8128, - "max": 8144, + "median": 3744, + "p95": 3760, + "min": 3744, + "max": 3760, "mad": 0, - "stdev": 7.838367 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 26, - 26, 25, - 26, + 24, + 24, + 24, 25 ], "sample_count": 5, - "median": 26, - "p95": 26, - "min": 25, - "max": 26, + "median": 24, + "p95": 25, + "min": 24, + "max": 25, "mad": 0, "stdev": 0.489898 }, "rss_kb": { "samples": [ - 71024, + 70512, 70560, - 70928, + 70592, 70704, - 70896 + 70512 ], "sample_count": 5, - "median": 70896, - "p95": 71024, - "min": 70560, - "max": 71024, - "mad": 128, - "stdev": 167.381719 + "median": 70560, + "p95": 70704, + "min": 70512, + "max": 70704, + "mad": 48, + "stdev": 70.83502 } }, "bun": { "wall_ms": { "samples": [ - 31, - 32, - 30, + 28, + 28, + 28, 29, - 30 + 28 ], "sample_count": 5, - "median": 30, - "p95": 32, - "min": 29, - "max": 32, - "mad": 1, - "stdev": 1.019804 + "median": 28, + "p95": 29, + "min": 28, + "max": 29, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ - 31616, + 31600, + 31584, + 31568, 31584, - 31616, - 31552, - 31504 + 31632 ], "sample_count": 5, "median": 31584, - "p95": 31616, - "min": 31504, - "max": 31616, - "mad": 32, - "stdev": 42.452797 + "p95": 31632, + "min": 31568, + "max": 31632, + "mad": 16, + "stdev": 21.703456 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.884615, - "rss": 0.114647 + "wall_time": 0.916667, + "rss": 0.053061 }, "perry_to_bun": { - "wall_time": 0.766667, - "rss": 0.257345 + "wall_time": 0.785714, + "rss": 0.118541 } }, "correctness": { @@ -2015,128 +2015,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 23, - "perry_rss_kb": 8128, - "node_ms": 26, - "node_rss_kb": 70896, - "bun_ms": 30, + "perry_ms": 22, + "perry_rss_kb": 3744, + "node_ms": 24, + "node_rss_kb": 70560, + "bun_ms": 28, "bun_rss_kb": 31584, - "speed_ratio": 0.884615, - "memory_ratio": 0.114647 + "speed_ratio": 0.916667, + "memory_ratio": 0.053061 }, "16_matrix_multiply": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 2219, - 2403, - 2192, - 2344, - 2311 + 648, + 637, + 643, + 636, + 635 ], "sample_count": 5, - "median": 2311, - "p95": 2403, - "min": 2192, - "max": 2403, - "mad": 92, - "stdev": 78.356621 + "median": 637, + "p95": 648, + "min": 635, + "max": 648, + "mad": 2, + "stdev": 4.955805 }, "rss_kb": { "samples": [ - 14832, - 14704, - 15424, - 15408, - 15408 + 11312, + 11312, + 11328, + 11312, + 11312 ], "sample_count": 5, - "median": 15408, - "p95": 15424, - "min": 14704, - "max": 15424, - "mad": 16, - "stdev": 318.781681 + "median": 11312, + "p95": 11328, + "min": 11312, + "max": 11328, + "mad": 0, + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 43, - 35, - 35, - 34, - 35 + 33, + 32, + 33, + 33, + 33 ], "sample_count": 5, - "median": 35, - "p95": 43, - "min": 34, - "max": 43, + "median": 33, + "p95": 33, + "min": 32, + "max": 33, "mad": 0, - "stdev": 3.32265 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 75376, - 75040, - 75184, - 75328, - 75040 + 74896, + 74960, + 75264, + 74816, + 74864 ], "sample_count": 5, - "median": 75184, - "p95": 75376, - "min": 75040, - "max": 75376, - "mad": 144, - "stdev": 140.435893 + "median": 74896, + "p95": 75264, + "min": 74816, + "max": 75264, + "mad": 64, + "stdev": 159.037103 } }, "bun": { "wall_ms": { "samples": [ - 40, - 35, - 34, - 34, - 35 + 33, + 33, + 33, + 33, + 34 ], "sample_count": 5, - "median": 35, - "p95": 40, - "min": 34, - "max": 40, - "mad": 1, - "stdev": 2.244994 + "median": 33, + "p95": 34, + "min": 33, + "max": 34, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ - 37904, - 38080, - 38080, - 38000, - 37968 + 38016, + 37952, + 37968, + 38048, + 37952 ], "sample_count": 5, - "median": 38000, - "p95": 38080, - "min": 37904, - "max": 38080, - "mad": 80, - "stdev": 67.579879 + "median": 37968, + "p95": 38048, + "min": 37952, + "max": 38048, + "mad": 16, + "stdev": 38.4 } } }, "ratios": { "perry_to_node": { - "wall_time": 66.028571, - "rss": 0.204937 + "wall_time": 19.30303, + "rss": 0.151036 }, "perry_to_bun": { - "wall_time": 66.028571, - "rss": 0.405474 + "wall_time": 19.30303, + "rss": 0.297935 } }, "correctness": { @@ -2150,128 +2150,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 2311, - "perry_rss_kb": 15408, - "node_ms": 35, - "node_rss_kb": 75184, - "bun_ms": 35, - "bun_rss_kb": 38000, - "speed_ratio": 66.028571, - "memory_ratio": 0.204937 + "perry_ms": 637, + "perry_rss_kb": 11312, + "node_ms": 33, + "node_rss_kb": 74896, + "bun_ms": 33, + "bun_rss_kb": 37968, + "speed_ratio": 19.30303, + "memory_ratio": 0.151036 }, "bench_gc_pressure": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 33, - 20, - 21, - 20, - 20 + 47, + 28, + 28, + 28, + 29 ], "sample_count": 5, - "median": 20, - "p95": 33, - "min": 20, - "max": 33, + "median": 28, + "p95": 47, + "min": 28, + "max": 47, "mad": 0, - "stdev": 5.114685 + "stdev": 7.509993 }, "rss_kb": { "samples": [ - 27888, - 27904, - 27888, - 27888, - 27904 + 24288, + 24272, + 24272, + 24272, + 24272 ], "sample_count": 5, - "median": 27888, - "p95": 27904, - "min": 27888, - "max": 27904, + "median": 24272, + "p95": 24288, + "min": 24272, + "max": 24288, "mad": 0, - "stdev": 7.838367 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 18, - 18, - 17, - 17, - 18 + 15, + 15, + 16, + 15, + 15 ], "sample_count": 5, - "median": 18, - "p95": 18, - "min": 17, - "max": 18, + "median": 15, + "p95": 16, + "min": 15, + "max": 16, "mad": 0, - "stdev": 0.489898 + "stdev": 0.4 }, "rss_kb": { "samples": [ 77872, - 77712, - 78304, - 77776, - 78160 + 77920, + 77888, + 77824, + 77872 ], "sample_count": 5, "median": 77872, - "p95": 78304, - "min": 77712, - "max": 78304, - "mad": 160, - "stdev": 228.61531 + "p95": 77920, + "min": 77824, + "max": 77920, + "mad": 16, + "stdev": 31.025151 } }, "bun": { "wall_ms": { "samples": [ - 29, - 23, - 22, - 34, - 37 + 19, + 20, + 19, + 19, + 20 ], "sample_count": 5, - "median": 29, - "p95": 37, - "min": 22, - "max": 37, - "mad": 6, - "stdev": 5.899152 + "median": 19, + "p95": 20, + "min": 19, + "max": 20, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 79504, - 78080, + 77808, 77792, - 78064, - 77872 + 77760, + 77840, + 77824 ], "sample_count": 5, - "median": 78064, - "p95": 79504, - "min": 77792, - "max": 79504, - "mad": 192, - "stdev": 630.538056 + "median": 77808, + "p95": 77840, + "min": 77760, + "max": 77840, + "mad": 16, + "stdev": 27.527441 } } }, "ratios": { "perry_to_node": { - "wall_time": 1.111111, - "rss": 0.358126 + "wall_time": 1.866667, + "rss": 0.311691 }, "perry_to_bun": { - "wall_time": 0.689655, - "rss": 0.357245 + "wall_time": 1.473684, + "rss": 0.311947 } }, "correctness": { @@ -2285,128 +2285,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 20, - "perry_rss_kb": 27888, - "node_ms": 18, + "perry_ms": 28, + "perry_rss_kb": 24272, + "node_ms": 15, "node_rss_kb": 77872, - "bun_ms": 29, - "bun_rss_kb": 78064, - "speed_ratio": 1.111111, - "memory_ratio": 0.358126 + "bun_ms": 19, + "bun_rss_kb": 77808, + "speed_ratio": 1.866667, + "memory_ratio": 0.311691 }, "bench_json_roundtrip": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 450, - 444, - 447, - 447, - 448 + 215, + 212, + 211, + 213, + 211 ], "sample_count": 5, - "median": 447, - "p95": 450, - "min": 444, - "max": 450, + "median": 212, + "p95": 215, + "min": 211, + "max": 215, "mad": 1, - "stdev": 1.939072 + "stdev": 1.496663 }, "rss_kb": { "samples": [ - 158816, - 158832, - 158816, - 158832, - 158832 + 112864, + 112928, + 112928, + 112928, + 113472 ], "sample_count": 5, - "median": 158832, - "p95": 158832, - "min": 158816, - "max": 158832, + "median": 112928, + "p95": 113472, + "min": 112864, + "max": 113472, "mad": 0, - "stdev": 7.838367 + "stdev": 225.367256 } }, "node": { "wall_ms": { "samples": [ - 423, - 416, - 425, - 421, - 418 + 390, + 383, + 396, + 386, + 395 ], "sample_count": 5, - "median": 421, - "p95": 425, - "min": 416, - "max": 425, - "mad": 3, - "stdev": 3.261901 + "median": 390, + "p95": 396, + "min": 383, + "max": 396, + "mad": 5, + "stdev": 5.01996 }, "rss_kb": { "samples": [ - 128320, - 126192, - 127024, - 127392, - 126832 + 122256, + 125232, + 124992, + 122032, + 121840 ], "sample_count": 5, - "median": 127024, - "p95": 128320, - "min": 126192, - "max": 128320, - "mad": 368, - "stdev": 701.741833 + "median": 122256, + "p95": 125232, + "min": 121840, + "max": 125232, + "mad": 416, + "stdev": 1511.321753 } }, "bun": { "wall_ms": { "samples": [ - 253, - 238, - 242, - 238, - 237 + 218, + 219, + 219, + 220, + 226 ], "sample_count": 5, - "median": 238, - "p95": 253, - "min": 237, - "max": 253, + "median": 219, + "p95": 226, + "min": 218, + "max": 226, "mad": 1, - "stdev": 5.95315 + "stdev": 2.87054 }, "rss_kb": { "samples": [ - 81840, - 83456, - 85648, - 84608, - 84736 + 82448, + 84592, + 82432, + 83440, + 86688 ], "sample_count": 5, - "median": 84608, - "p95": 85648, - "min": 81840, - "max": 85648, - "mad": 1040, - "stdev": 1309.367114 + "median": 83440, + "p95": 86688, + "min": 82432, + "max": 86688, + "mad": 1008, + "stdev": 1595.289065 } } }, "ratios": { "perry_to_node": { - "wall_time": 1.061758, - "rss": 1.250409 + "wall_time": 0.54359, + "rss": 0.923701 }, "perry_to_bun": { - "wall_time": 1.878151, - "rss": 1.877269 + "wall_time": 0.968037, + "rss": 1.353404 } }, "correctness": { @@ -2420,128 +2420,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 447, - "perry_rss_kb": 158832, - "node_ms": 421, - "node_rss_kb": 127024, - "bun_ms": 238, - "bun_rss_kb": 84608, - "speed_ratio": 1.061758, - "memory_ratio": 1.250409 + "perry_ms": 212, + "perry_rss_kb": 112928, + "node_ms": 390, + "node_rss_kb": 122256, + "bun_ms": 219, + "bun_rss_kb": 83440, + "speed_ratio": 0.54359, + "memory_ratio": 0.923701 }, "bench_object_property": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 284, - 268, - 273, - 283, - 275 + 142, + 126, + 126, + 127, + 125 ], "sample_count": 5, - "median": 275, - "p95": 284, - "min": 268, - "max": 284, - "mad": 7, - "stdev": 6.08605 + "median": 126, + "p95": 142, + "min": 125, + "max": 142, + "mad": 1, + "stdev": 6.431174 }, "rss_kb": { "samples": [ - 64912, - 64912, - 64912, - 64912, - 64896 + 18416, + 18416, + 18416, + 18416, + 18416 ], "sample_count": 5, - "median": 64912, - "p95": 64912, - "min": 64896, - "max": 64912, + "median": 18416, + "p95": 18416, + "min": 18416, + "max": 18416, "mad": 0, - "stdev": 6.4 + "stdev": 0 } }, "node": { "wall_ms": { "samples": [ - 17, + 15, 16, + 15, 16, - 17, 16 ], "sample_count": 5, "median": 16, - "p95": 17, - "min": 16, - "max": 17, + "p95": 16, + "min": 15, + "max": 16, "mad": 0, "stdev": 0.489898 }, "rss_kb": { "samples": [ - 70784, - 70864, - 70512, + 70656, + 70720, + 70608, 70640, - 71056 + 70704 ], "sample_count": 5, - "median": 70784, - "p95": 71056, - "min": 70512, - "max": 71056, - "mad": 144, - "stdev": 186.700187 + "median": 70656, + "p95": 70720, + "min": 70608, + "max": 70720, + "mad": 48, + "stdev": 41.229116 } }, "bun": { "wall_ms": { "samples": [ - 11, - 7, - 18, - 17, + 9, + 16, + 6, + 16, 6 ], "sample_count": 5, - "median": 11, - "p95": 18, + "median": 9, + "p95": 16, "min": 6, - "max": 18, - "mad": 5, - "stdev": 4.955805 + "max": 16, + "mad": 3, + "stdev": 4.543127 }, "rss_kb": { "samples": [ - 37792, - 33680, - 46208, - 46192, - 33712 + 37312, + 46176, + 33552, + 46272, + 33600 ], "sample_count": 5, - "median": 37792, - "p95": 46208, - "min": 33680, - "max": 46208, - "mad": 4112, - "stdev": 5658.079618 + "median": 37312, + "p95": 46272, + "min": 33552, + "max": 46272, + "mad": 3760, + "stdev": 5750.406233 } } }, "ratios": { "perry_to_node": { - "wall_time": 17.1875, - "rss": 0.917043 + "wall_time": 7.875, + "rss": 0.260643 }, "perry_to_bun": { - "wall_time": 25.0, - "rss": 1.717612 + "wall_time": 14.0, + "rss": 0.493568 } }, "correctness": { @@ -2555,47 +2555,47 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 275, - "perry_rss_kb": 64912, + "perry_ms": 126, + "perry_rss_kb": 18416, "node_ms": 16, - "node_rss_kb": 70784, - "bun_ms": 11, - "bun_rss_kb": 37792, - "speed_ratio": 17.1875, - "memory_ratio": 0.917043 + "node_rss_kb": 70656, + "bun_ms": 9, + "bun_rss_kb": 37312, + "speed_ratio": 7.875, + "memory_ratio": 0.260643 }, "bench_int_arithmetic": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 590, - 577, - 576, - 578, - 573 + 372, + 355, + 357, + 357, + 357 ], "sample_count": 5, - "median": 577, - "p95": 590, - "min": 573, - "max": 590, - "mad": 1, - "stdev": 5.844656 + "median": 357, + "p95": 372, + "min": 355, + "max": 372, + "mad": 0, + "stdev": 6.2482 }, "rss_kb": { "samples": [ - 8512, - 8512, - 8512, - 8512, - 8528 + 4192, + 4192, + 4192, + 4208, + 4192 ], "sample_count": 5, - "median": 8512, - "p95": 8528, - "min": 8512, - "max": 8528, + "median": 4192, + "p95": 4208, + "min": 4192, + "max": 4208, "mad": 0, "stdev": 6.4 } @@ -2603,80 +2603,80 @@ "node": { "wall_ms": { "samples": [ - 98, - 98, - 101, - 102, - 101 + 94, + 93, + 94, + 93, + 94 ], "sample_count": 5, - "median": 101, - "p95": 102, - "min": 98, - "max": 102, - "mad": 1, - "stdev": 1.67332 + "median": 94, + "p95": 94, + "min": 93, + "max": 94, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 69696, - 69360, + 69040, + 69120, 69184, - 68928, - 69504 + 69088, + 69216 ], "sample_count": 5, - "median": 69360, - "p95": 69696, - "min": 68928, - "max": 69696, - "mad": 176, - "stdev": 263.801137 + "median": 69120, + "p95": 69216, + "min": 69040, + "max": 69216, + "mad": 64, + "stdev": 63.679196 } }, "bun": { "wall_ms": { "samples": [ - 41, - 40, - 41, - 58, - 41 + 39, + 38, + 38, + 39, + 39 ], "sample_count": 5, - "median": 41, - "p95": 58, - "min": 40, - "max": 58, + "median": 39, + "p95": 39, + "min": 38, + "max": 39, "mad": 0, - "stdev": 6.910861 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 36160, - 36096, 36128, + 36160, + 36176, 36064, - 36240 + 36176 ], "sample_count": 5, - "median": 36128, - "p95": 36240, + "median": 36160, + "p95": 36176, "min": 36064, - "max": 36240, - "mad": 32, - "stdev": 60.377479 + "max": 36176, + "mad": 16, + "stdev": 42.210899 } } }, "ratios": { "perry_to_node": { - "wall_time": 5.712871, - "rss": 0.122722 + "wall_time": 3.797872, + "rss": 0.060648 }, "perry_to_bun": { - "wall_time": 14.073171, - "rss": 0.235607 + "wall_time": 9.153846, + "rss": 0.115929 } }, "correctness": { @@ -2690,47 +2690,47 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 577, - "perry_rss_kb": 8512, - "node_ms": 101, - "node_rss_kb": 69360, - "bun_ms": 41, - "bun_rss_kb": 36128, - "speed_ratio": 5.712871, - "memory_ratio": 0.122722 + "perry_ms": 357, + "perry_rss_kb": 4192, + "node_ms": 94, + "node_rss_kb": 69120, + "bun_ms": 39, + "bun_rss_kb": 36160, + "speed_ratio": 3.797872, + "memory_ratio": 0.060648 }, "bench_buffer_readwrite": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 108, - 101, - 96, - 96, - 96 + 116, + 93, + 93, + 97, + 100 ], "sample_count": 5, - "median": 96, - "p95": 108, - "min": 96, - "max": 108, - "mad": 0, - "stdev": 4.71593 + "median": 97, + "p95": 116, + "min": 93, + "max": 116, + "mad": 4, + "stdev": 8.518216 }, "rss_kb": { "samples": [ - 9440, - 9440, - 9440, - 9440, - 9440 + 5168, + 5168, + 5168, + 5168, + 5168 ], "sample_count": 5, - "median": 9440, - "p95": 9440, - "min": 9440, - "max": 9440, + "median": 5168, + "p95": 5168, + "min": 5168, + "max": 5168, "mad": 0, "stdev": 0 } @@ -2738,80 +2738,80 @@ "node": { "wall_ms": { "samples": [ - 100, - 99, - 100, - 99, - 100 + 96, + 98, + 96, + 98, + 98 ], "sample_count": 5, - "median": 100, - "p95": 100, - "min": 99, - "max": 100, + "median": 98, + "p95": 98, + "min": 96, + "max": 98, "mad": 0, - "stdev": 0.489898 + "stdev": 0.979796 }, "rss_kb": { "samples": [ - 69936, - 70176, - 69248, - 68960, - 69008 + 69072, + 69024, + 69040, + 68880, + 68896 ], "sample_count": 5, - "median": 69248, - "p95": 70176, - "min": 68960, - "max": 70176, - "mad": 288, - "stdev": 497.65916 + "median": 69024, + "p95": 69072, + "min": 68880, + "max": 69072, + "mad": 48, + "stdev": 78.774615 } }, "bun": { "wall_ms": { "samples": [ - 104, - 104, - 109, - 105, - 105 + 103, + 200, + 194, + 197, + 109 ], "sample_count": 5, - "median": 105, - "p95": 109, - "min": 104, - "max": 109, - "mad": 1, - "stdev": 1.854724 + "median": 194, + "p95": 200, + "min": 103, + "max": 200, + "mad": 6, + "stdev": 44.661393 }, "rss_kb": { "samples": [ - 34192, - 34176, - 34240, - 34240, - 34176 + 34224, + 34288, + 34336, + 34288, + 34224 ], "sample_count": 5, - "median": 34192, - "p95": 34240, - "min": 34176, - "max": 34240, - "mad": 16, - "stdev": 29.328484 + "median": 34288, + "p95": 34336, + "min": 34224, + "max": 34336, + "mad": 48, + "stdev": 42.932505 } } }, "ratios": { "perry_to_node": { - "wall_time": 0.96, - "rss": 0.136322 + "wall_time": 0.989796, + "rss": 0.074873 }, "perry_to_bun": { - "wall_time": 0.914286, - "rss": 0.276088 + "wall_time": 0.5, + "rss": 0.150723 } }, "correctness": { @@ -2825,128 +2825,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 96, - "perry_rss_kb": 9440, - "node_ms": 100, - "node_rss_kb": 69248, - "bun_ms": 105, - "bun_rss_kb": 34192, - "speed_ratio": 0.96, - "memory_ratio": 0.136322 + "perry_ms": 97, + "perry_rss_kb": 5168, + "node_ms": 98, + "node_rss_kb": 69024, + "bun_ms": 194, + "bun_rss_kb": 34288, + "speed_ratio": 0.989796, + "memory_ratio": 0.074873 }, "bench_array_grow": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 164, - 150, - 150, - 151, - 150 + 29, + 20, + 20, + 21, + 21 ], "sample_count": 5, - "median": 150, - "p95": 164, - "min": 150, - "max": 164, - "mad": 0, - "stdev": 5.51362 + "median": 21, + "p95": 29, + "min": 20, + "max": 29, + "mad": 1, + "stdev": 3.429286 }, "rss_kb": { "samples": [ - 45152, - 45120, - 45104, - 45136, - 45120 + 42448, + 42432, + 42448, + 42448, + 42448 ], "sample_count": 5, - "median": 45120, - "p95": 45152, - "min": 45104, - "max": 45152, - "mad": 16, - "stdev": 16.316862 + "median": 42448, + "p95": 42448, + "min": 42432, + "max": 42448, + "mad": 0, + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 26, - 21, - 20, - 23, - 20 + 14, + 13, + 14, + 14, + 14 ], "sample_count": 5, - "median": 21, - "p95": 26, - "min": 20, - "max": 26, - "mad": 1, - "stdev": 2.280351 + "median": 14, + "p95": 14, + "min": 13, + "max": 14, + "mad": 0, + "stdev": 0.4 }, "rss_kb": { "samples": [ - 133104, 132896, - 132912, - 133168, - 133232 + 132944, + 133008, + 133184, + 132960 ], "sample_count": 5, - "median": 133104, - "p95": 133232, + "median": 132960, + "p95": 133184, "min": 132896, - "max": 133232, - "mad": 128, - "stdev": 135.613569 + "max": 133184, + "mad": 48, + "stdev": 99.45773 } }, "bun": { "wall_ms": { "samples": [ - 11, - 12, - 13, - 10, - 11 + 8, + 8, + 9, + 9, + 9 ], "sample_count": 5, - "median": 11, - "p95": 13, - "min": 10, - "max": 13, - "mad": 1, - "stdev": 1.019804 + "median": 9, + "p95": 9, + "min": 8, + "max": 9, + "mad": 0, + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 75824, - 67040, - 75488, - 71008, - 75920 + 75904, + 67008, + 79280, + 75840, + 79312 ], "sample_count": 5, - "median": 75488, - "p95": 75920, - "min": 67040, - "max": 75920, - "mad": 432, - "stdev": 3526.060238 + "median": 75904, + "p95": 79312, + "min": 67008, + "max": 79312, + "mad": 3376, + "stdev": 4499.061164 } } }, "ratios": { "perry_to_node": { - "wall_time": 7.142857, - "rss": 0.338983 + "wall_time": 1.5, + "rss": 0.319254 }, "perry_to_bun": { - "wall_time": 13.636364, - "rss": 0.597711 + "wall_time": 2.333333, + "rss": 0.559233 } }, "correctness": { @@ -2962,128 +2962,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 150, - "perry_rss_kb": 45120, - "node_ms": 21, - "node_rss_kb": 133104, - "bun_ms": 11, - "bun_rss_kb": 75488, - "speed_ratio": 7.142857, - "memory_ratio": 0.338983 + "perry_ms": 21, + "perry_rss_kb": 42448, + "node_ms": 14, + "node_rss_kb": 132960, + "bun_ms": 9, + "bun_rss_kb": 75904, + "speed_ratio": 1.5, + "memory_ratio": 0.319254 }, "bench_string_heavy": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 84, - 66, - 72, - 74, - 77 + 78, + 55, + 55, + 56, + 56 ], "sample_count": 5, - "median": 74, - "p95": 84, - "min": 66, - "max": 84, - "mad": 3, - "stdev": 5.919459 + "median": 56, + "p95": 78, + "min": 55, + "max": 78, + "mad": 1, + "stdev": 9.011104 }, "rss_kb": { "samples": [ - 63744, - 63728, - 63728, - 63744, - 63728 + 59552, + 59568, + 59568, + 59568, + 59568 ], "sample_count": 5, - "median": 63728, - "p95": 63744, - "min": 63728, - "max": 63744, + "median": 59568, + "p95": 59568, + "min": 59552, + "max": 59568, "mad": 0, - "stdev": 7.838367 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ - 55, - 52, - 52, - 45, - 45 + 42, + 41, + 41, + 44, + 41 ], "sample_count": 5, - "median": 52, - "p95": 55, - "min": 45, - "max": 55, - "mad": 3, - "stdev": 4.069398 + "median": 41, + "p95": 44, + "min": 41, + "max": 44, + "mad": 0, + "stdev": 1.16619 }, "rss_kb": { "samples": [ - 68704, - 68768, - 68672, - 69056, - 68480 + 68656, + 68640, + 68544, + 68848, + 68560 ], "sample_count": 5, - "median": 68704, - "p95": 69056, - "min": 68480, - "max": 69056, - "mad": 64, - "stdev": 186.590461 + "median": 68640, + "p95": 68848, + "min": 68544, + "max": 68848, + "mad": 80, + "stdev": 108.32839 } }, "bun": { "wall_ms": { "samples": [ - 32, - 33, - 31, + 29, + 28, 30, - 31 + 29, + 28 ], "sample_count": 5, - "median": 31, - "p95": 33, - "min": 30, - "max": 33, + "median": 29, + "p95": 30, + "min": 28, + "max": 30, "mad": 1, - "stdev": 1.019804 + "stdev": 0.748331 }, "rss_kb": { "samples": [ 62560, - 62592, + 62576, + 62624, 62560, - 62496, - 62544 + 62624 ], "sample_count": 5, - "median": 62560, - "p95": 62592, - "min": 62496, - "max": 62592, + "median": 62576, + "p95": 62624, + "min": 62560, + "max": 62624, "mad": 16, - "stdev": 31.353469 + "stdev": 29.328484 } } }, "ratios": { "perry_to_node": { - "wall_time": 1.423077, - "rss": 0.927573 + "wall_time": 1.365854, + "rss": 0.867832 }, "perry_to_bun": { - "wall_time": 2.387097, - "rss": 1.01867 + "wall_time": 1.931034, + "rss": 0.95193 } }, "correctness": { @@ -3097,128 +3097,128 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 74, - "perry_rss_kb": 63728, - "node_ms": 52, - "node_rss_kb": 68704, - "bun_ms": 31, - "bun_rss_kb": 62560, - "speed_ratio": 1.423077, - "memory_ratio": 0.927573 + "perry_ms": 56, + "perry_rss_kb": 59568, + "node_ms": 41, + "node_rss_kb": 68640, + "bun_ms": 29, + "bun_rss_kb": 62576, + "speed_ratio": 1.365854, + "memory_ratio": 0.867832 }, "bench_numeric_array_numeric": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 154, - 154, - 154, - 157, - 154 + 70, + 69, + 69, + 69, + 70 ], "sample_count": 5, - "median": 154, - "p95": 157, - "min": 154, - "max": 157, + "median": 69, + "p95": 70, + "min": 69, + "max": 70, "mad": 0, - "stdev": 1.2 + "stdev": 0.489898 }, "rss_kb": { "samples": [ - 30128, - 30128, - 30144, - 30128, - 30144 + 26048, + 26048, + 26064, + 26048, + 26048 ], "sample_count": 5, - "median": 30128, - "p95": 30144, - "min": 30128, - "max": 30144, + "median": 26048, + "p95": 26064, + "min": 26048, + "max": 26064, "mad": 0, - "stdev": 7.838367 + "stdev": 6.4 } }, "node": { "wall_ms": { "samples": [ + 5, + 5, + 5, 6, - 7, - 6, - 7, - 6 + 5 ], "sample_count": 5, - "median": 6, - "p95": 7, - "min": 6, - "max": 7, + "median": 5, + "p95": 6, + "min": 5, + "max": 6, "mad": 0, - "stdev": 0.489898 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 89184, - 89632, - 89568, - 89744, - 89936 + 89728, + 89264, + 89344, + 89280, + 89440 ], "sample_count": 5, - "median": 89632, - "p95": 89936, - "min": 89184, - "max": 89936, - "mad": 112, - "stdev": 248.159948 + "median": 89344, + "p95": 89728, + "min": 89264, + "max": 89728, + "mad": 80, + "stdev": 170.052227 } }, "bun": { "wall_ms": { "samples": [ 4, - 6, - 6, 4, - 6 + 4, + 5, + 4 ], "sample_count": 5, - "median": 6, - "p95": 6, + "median": 4, + "p95": 5, "min": 4, - "max": 6, + "max": 5, "mad": 0, - "stdev": 0.979796 + "stdev": 0.4 }, "rss_kb": { "samples": [ - 46400, - 46608, - 46496, + 46672, + 46592, 46640, - 46560 + 46688, + 46656 ], "sample_count": 5, - "median": 46560, - "p95": 46640, - "min": 46400, - "max": 46640, - "mad": 64, - "stdev": 85.506491 + "median": 46656, + "p95": 46688, + "min": 46592, + "max": 46688, + "mad": 16, + "stdev": 32.946016 } } }, "ratios": { "perry_to_node": { - "wall_time": 25.666667, - "rss": 0.33613 + "wall_time": 13.8, + "rss": 0.291547 }, "perry_to_bun": { - "wall_time": 25.666667, - "rss": 0.647079 + "wall_time": 17.25, + "rss": 0.558299 } }, "correctness": { @@ -3232,96 +3232,96 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 154, - "perry_rss_kb": 30128, - "node_ms": 6, - "node_rss_kb": 89632, - "bun_ms": 6, - "bun_rss_kb": 46560, - "speed_ratio": 25.666667, - "memory_ratio": 0.33613 + "perry_ms": 69, + "perry_rss_kb": 26048, + "node_ms": 5, + "node_rss_kb": 89344, + "bun_ms": 4, + "bun_rss_kb": 46656, + "speed_ratio": 13.8, + "memory_ratio": 0.291547 }, "bench_numeric_array_downgrade": { "runtimes": { "perry": { "wall_ms": { "samples": [ - 11052, - 11028, - 11011, - 11016, - 11071 + 19, + 19, + 19, + 19, + 19 ], "sample_count": 5, - "median": 11028, - "p95": 11071, - "min": 11011, - "max": 11071, - "mad": 17, - "stdev": 22.668039 + "median": 19, + "p95": 19, + "min": 19, + "max": 19, + "mad": 0, + "stdev": 0 }, "rss_kb": { "samples": [ - 19360, - 15872, - 17712, - 21472, - 19568 + 26656, + 26656, + 26640, + 26640, + 26656 ], "sample_count": 5, - "median": 19360, - "p95": 21472, - "min": 15872, - "max": 21472, - "mad": 1648, - "stdev": 1886.790121 + "median": 26656, + "p95": 26656, + "min": 26640, + "max": 26656, + "mad": 0, + "stdev": 7.838367 } }, "node": { "wall_ms": { "samples": [ - 10, - 7, - 7, - 7, - 7 + 6, + 6, + 6, + 6, + 6 ], "sample_count": 5, - "median": 7, - "p95": 10, - "min": 7, - "max": 10, + "median": 6, + "p95": 6, + "min": 6, + "max": 6, "mad": 0, - "stdev": 1.2 + "stdev": 0 }, "rss_kb": { "samples": [ - 89840, - 90320, - 89856, - 89952, - 89792 + 89424, + 89392, + 89504, + 89360, + 89440 ], "sample_count": 5, - "median": 89856, - "p95": 90320, - "min": 89792, - "max": 90320, - "mad": 64, - "stdev": 191.198326 + "median": 89424, + "p95": 89504, + "min": 89360, + "max": 89504, + "mad": 32, + "stdev": 48.530403 } }, "bun": { "wall_ms": { "samples": [ - 6, - 6, 5, - 6, + 5, + 5, + 5, 6 ], "sample_count": 5, - "median": 6, + "median": 5, "p95": 6, "min": 5, "max": 6, @@ -3330,30 +3330,30 @@ }, "rss_kb": { "samples": [ - 47680, - 48000, - 48048, - 47760, - 48016 + 48112, + 48096, + 48096, + 48112, + 48096 ], "sample_count": 5, - "median": 48000, - "p95": 48048, - "min": 47680, - "max": 48048, - "mad": 48, - "stdev": 150.570117 + "median": 48096, + "p95": 48112, + "min": 48096, + "max": 48112, + "mad": 0, + "stdev": 7.838367 } } }, "ratios": { "perry_to_node": { - "wall_time": 1575.428571, - "rss": 0.215456 + "wall_time": 3.166667, + "rss": 0.298086 }, "perry_to_bun": { - "wall_time": 1838.0, - "rss": 0.403333 + "wall_time": 3.8, + "rss": 0.554225 } }, "correctness": { @@ -3367,22 +3367,22 @@ ], "reason": "all 5 Perry sample(s) matched node semantic output" }, - "perry_ms": 11028, - "perry_rss_kb": 19360, - "node_ms": 7, - "node_rss_kb": 89856, - "bun_ms": 6, - "bun_rss_kb": 48000, - "speed_ratio": 1575.428571, - "memory_ratio": 0.215456 + "perry_ms": 19, + "perry_rss_kb": 26656, + "node_ms": 6, + "node_rss_kb": 89424, + "bun_ms": 5, + "bun_rss_kb": 48096, + "speed_ratio": 3.166667, + "memory_ratio": 0.298086 } } }, "polyglot": { "schema_version": 1, "suite": "polyglot", - "commit": "36cf04e0147c68a55f362689ab6c56e2b39a3c67", - "generated_at": "2026-07-13T13:08:20Z", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", + "generated_at": "2026-08-03T05:11:46Z", "run_config": { "warmup": "none beyond benchmark-specific setup", "requested_samples": 11, @@ -3397,11 +3397,11 @@ "" ], "node": [ - "/tmp/perry-bench-tools/bin/node", + "/Users/amlug/.cache/perry-bench-tools/bin/node", "" ], "bun": [ - "/tmp/perry-bench-tools/bin/bun", + "/Users/amlug/.cache/perry-bench-tools/bin/bun", "run", "" ], @@ -3412,16 +3412,16 @@ }, "runtime_metadata": { "perry": { - "version": "perry 0.5.1258", - "resolved_executable": "/private/tmp/perry-performance-baseline-0713/target/release/perry" + "version": "perry 0.5.1279", + "resolved_executable": "target/release/perry" }, "node": { "version": "v22.23.1", - "resolved_executable": "/tmp/perry-bench-tools/bin/node" + "resolved_executable": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node" }, "bun": { "version": "1.3.14", - "resolved_executable": "/tmp/perry-bench-tools/bin/bun" + "resolved_executable": "~/.cache/perry-bench-tools/bun/bun" } }, "benchmarks": { @@ -3435,72 +3435,72 @@ "perry": { "wall_ms": { "samples": [ - 1511.0, - 1496.0, - 1500.0, - 1494.0, - 1494.0, - 1495.0, - 1503.0, - 1501.0, - 1495.0, - 1505.0, - 1502.0 + 110.0, + 94.0, + 93.0, + 94.0, + 94.0, + 94.0, + 94.0, + 93.0, + 93.0, + 93.0, + 94.0 ], "sample_count": 11, - "median": 1500.0, - "p95": 1511.0, - "min": 1494.0, - "max": 1511.0, - "stdev": 5.192174658652231 + "median": 94.0, + "p95": 110.0, + "min": 93.0, + "max": 110.0, + "stdev": 4.737750625743776 }, "output_sha256": "45e7000362b678343915ceae0bbf34e9c236096552f86ca83f6cb91d6b0b5c67" }, "node": { "wall_ms": { "samples": [ + 96.0, + 96.0, + 95.0, + 95.0, 95.0, - 94.0, - 94.0, - 94.0, 95.0, 95.0, 94.0, - 94.0, - 94.0, - 94.0, + 95.0, + 96.0, 95.0 ], "sample_count": 11, - "median": 94.0, - "p95": 95.0, + "median": 95.0, + "p95": 96.0, "min": 94.0, - "max": 95.0, - "stdev": 0.48104569292083466 + "max": 96.0, + "stdev": 0.5749595745760689 }, "output_sha256": "45e7000362b678343915ceae0bbf34e9c236096552f86ca83f6cb91d6b0b5c67" }, "bun": { "wall_ms": { "samples": [ - 97.0, - 98.0, - 98.0, - 97.0, - 98.0, - 99.0, - 98.0, - 99.0, - 99.0, 95.0, - 96.0 + 95.0, + 95.0, + 94.0, + 95.0, + 95.0, + 94.0, + 95.0, + 95.0, + 95.0, + 95.0 ], "sample_count": 11, - "median": 98.0, - "p95": 99.0, - "min": 95.0, - "max": 99.0, - "stdev": 1.2264306875665492 + "median": 95.0, + "p95": 95.0, + "min": 94.0, + "max": 95.0, + "stdev": 0.38569460791993504 }, "output_sha256": "45e7000362b678343915ceae0bbf34e9c236096552f86ca83f6cb91d6b0b5c67" } @@ -3516,24 +3516,24 @@ "perry": { "wall_ms": { "samples": [ - 93.0, - 93.0, - 92.0, - 94.0, - 93.0, - 92.0, - 93.0, - 92.0, - 92.0, - 92.0, - 99.0 + 34.0, + 24.0, + 24.0, + 24.0, + 24.0, + 24.0, + 24.0, + 24.0, + 25.0, + 24.0, + 24.0 ], "sample_count": 11, - "median": 93.0, - "p95": 99.0, - "min": 92.0, - "max": 99.0, - "stdev": 1.9455395053666087 + "median": 24.0, + "p95": 34.0, + "min": 24.0, + "max": 34.0, + "stdev": 2.860387767736777 }, "output_sha256": "9a59b9a771dcc3170ca6608099bc1dbe482831939679e81ae72f7bf4bd249674" }, @@ -3541,47 +3541,47 @@ "wall_ms": { "samples": [ 11.0, - 10.0, - 14.0, 11.0, 11.0, 11.0, 11.0, 11.0, 10.0, - 10.0, - 15.0 + 11.0, + 11.0, + 11.0, + 10.0 ], "sample_count": 11, "median": 11.0, - "p95": 15.0, + "p95": 11.0, "min": 10.0, - "max": 15.0, - "stdev": 1.5534552264213692 + "max": 11.0, + "stdev": 0.38569460791993504 }, "output_sha256": "9a59b9a771dcc3170ca6608099bc1dbe482831939679e81ae72f7bf4bd249674" }, "bun": { "wall_ms": { "samples": [ - 15.0, - 16.0, - 15.0, - 16.0, 14.0, - 15.0, - 19.0, - 20.0, - 17.0, - 18.0, - 19.0 + 14.0, + 13.0, + 14.0, + 14.0, + 14.0, + 14.0, + 13.0, + 13.0, + 14.0, + 14.0 ], "sample_count": 11, - "median": 16.0, - "p95": 20.0, - "min": 14.0, - "max": 20.0, - "stdev": 1.9112541856026035 + "median": 14.0, + "p95": 14.0, + "min": 13.0, + "max": 14.0, + "stdev": 0.4453617714151233 }, "output_sha256": "9a59b9a771dcc3170ca6608099bc1dbe482831939679e81ae72f7bf4bd249674" } @@ -3597,72 +3597,72 @@ "perry": { "wall_ms": { "samples": [ - 6.0, - 3.0, - 3.0, - 10.0, - 9.0, - 10.0, 2.0, - 3.0, 2.0, - 7.0, - 3.0 + 2.0, + 1.0, + 2.0, + 1.0, + 1.0, + 2.0, + 1.0, + 2.0, + 1.0 ], "sample_count": 11, - "median": 3.0, - "p95": 10.0, - "min": 2.0, - "max": 10.0, - "stdev": 3.0775110690565013 + "median": 2.0, + "p95": 2.0, + "min": 1.0, + "max": 2.0, + "stdev": 0.4979295977319692 }, "output_sha256": "a76ae1255a79f86acf51281a91633021374b072ef8c7fc75e6f1adf69e1e9ed4" }, "node": { "wall_ms": { "samples": [ - 8.0, 7.0, 7.0, 7.0, - 6.0, 7.0, 7.0, 7.0, 7.0, 7.0, - 7.0 + 7.0, + 7.0, + 6.0 ], "sample_count": 11, "median": 7.0, - "p95": 8.0, + "p95": 7.0, "min": 6.0, - "max": 8.0, - "stdev": 0.4264014327112209 + "max": 7.0, + "stdev": 0.28747978728803447 }, "output_sha256": "a76ae1255a79f86acf51281a91633021374b072ef8c7fc75e6f1adf69e1e9ed4" }, "bun": { "wall_ms": { "samples": [ - 12.0, - 11.0, 5.0, - 12.0, - 6.0, - 6.0, - 11.0, - 7.0, 5.0, - 7.0, - 11.0 + 4.0, + 5.0, + 5.0, + 5.0, + 5.0, + 5.0, + 5.0, + 5.0, + 5.0 ], "sample_count": 11, - "median": 7.0, - "p95": 12.0, - "min": 5.0, - "max": 12.0, - "stdev": 2.7753340949952268 + "median": 5.0, + "p95": 5.0, + "min": 4.0, + "max": 5.0, + "stdev": 0.28747978728803447 }, "output_sha256": "a76ae1255a79f86acf51281a91633021374b072ef8c7fc75e6f1adf69e1e9ed4" } @@ -3678,72 +3678,72 @@ "perry": { "wall_ms": { "samples": [ - 300.0, - 302.0, - 299.0, - 299.0, - 299.0, - 298.0, - 300.0, - 299.0, - 299.0, - 299.0, - 304.0 + 420.0, + 395.0, + 394.0, + 394.0, + 394.0, + 394.0, + 394.0, + 394.0, + 394.0, + 395.0, + 395.0 ], "sample_count": 11, - "median": 299.0, - "p95": 304.0, - "min": 298.0, - "max": 304.0, - "stdev": 1.6414063713879807 + "median": 394.0, + "p95": 420.0, + "min": 394.0, + "max": 420.0, + "stdev": 7.401139068017317 }, "output_sha256": "834774a30aeb60ab0f0a8dac4482efb07689d7b249da0942aa1260a78a3fa77d" }, "node": { "wall_ms": { "samples": [ - 922.0, 924.0, - 938.0, - 939.0, - 926.0, - 922.0, - 922.0, - 922.0, + 945.0, + 1018.0, + 984.0, + 940.0, 923.0, - 921.0, - 922.0 + 924.0, + 923.0, + 923.0, + 924.0, + 923.0 ], "sample_count": 11, - "median": 922.0, - "p95": 939.0, - "min": 921.0, - "max": 939.0, - "stdev": 6.2430126230506895 + "median": 924.0, + "p95": 1018.0, + "min": 923.0, + "max": 1018.0, + "stdev": 30.087750452181155 }, "output_sha256": "834774a30aeb60ab0f0a8dac4482efb07689d7b249da0942aa1260a78a3fa77d" }, "bun": { "wall_ms": { "samples": [ - 522.0, - 510.0, + 512.0, + 507.0, + 512.0, + 512.0, + 512.0, + 515.0, 512.0, 512.0, - 529.0, - 522.0, - 548.0, - 519.0, - 517.0, - 522.0, - 521.0 + 513.0, + 509.0, + 507.0 ], "sample_count": 11, - "median": 521.0, - "p95": 548.0, - "min": 510.0, - "max": 548.0, - "stdev": 9.991732119297517 + "median": 512.0, + "p95": 515.0, + "min": 507.0, + "max": 515.0, + "stdev": 2.3671302847802793 }, "output_sha256": "834774a30aeb60ab0f0a8dac4482efb07689d7b249da0942aa1260a78a3fa77d" } @@ -3759,37 +3759,37 @@ "perry": { "wall_ms": { "samples": [ - 1724.0, - 1736.0, - 1729.0, - 1743.0, - 1727.0, - 1718.0, - 1727.0, - 1722.0, - 1714.0, - 1728.0, - 1714.0 + 241.0, + 218.0, + 217.0, + 218.0, + 218.0, + 217.0, + 217.0, + 217.0, + 218.0, + 217.0, + 218.0 ], "sample_count": 11, - "median": 1727.0, - "p95": 1743.0, - "min": 1714.0, - "max": 1743.0, - "stdev": 8.391258733974055 + "median": 218.0, + "p95": 241.0, + "min": 217.0, + "max": 241.0, + "stdev": 6.772574738977882 }, "output_sha256": "6cb3a76d1ca7915e12bb42333de96a572ad2f85a93f3d7bb6c2148d08be2bb2d" }, "node": { "wall_ms": { "samples": [ - 223.0, - 221.0, - 221.0, - 221.0, 219.0, 220.0, - 221.0, + 222.0, + 220.0, + 220.0, + 220.0, + 219.0, 220.0, 220.0, 220.0, @@ -3797,34 +3797,34 @@ ], "sample_count": 11, "median": 220.0, - "p95": 223.0, + "p95": 222.0, "min": 219.0, - "max": 223.0, - "stdev": 0.9875254992000196 + "max": 222.0, + "stdev": 0.7385489458759964 }, "output_sha256": "6cb3a76d1ca7915e12bb42333de96a572ad2f85a93f3d7bb6c2148d08be2bb2d" }, "bun": { "wall_ms": { "samples": [ - 229.0, - 231.0, - 226.0, - 233.0, - 230.0, - 222.0, - 222.0, - 223.0, - 223.0, - 227.0, - 224.0 + 220.0, + 219.0, + 220.0, + 221.0, + 221.0, + 219.0, + 219.0, + 219.0, + 219.0, + 220.0, + 223.0 ], "sample_count": 11, - "median": 226.0, - "p95": 233.0, - "min": 222.0, - "max": 233.0, - "stdev": 3.7239452996843716 + "median": 220.0, + "p95": 223.0, + "min": 219.0, + "max": 223.0, + "stdev": 1.2060453783110545 }, "output_sha256": "6cb3a76d1ca7915e12bb42333de96a572ad2f85a93f3d7bb6c2148d08be2bb2d" } @@ -3840,24 +3840,24 @@ "perry": { "wall_ms": { "samples": [ - 94.0, - 94.0, - 94.0, + 116.0, + 93.0, + 93.0, + 93.0, + 93.0, + 93.0, 93.0, - 94.0, - 94.0, - 94.0, - 94.0, 94.0, 93.0, - 93.0 + 93.0, + 94.0 ], "sample_count": 11, - "median": 94.0, - "p95": 94.0, + "median": 93.0, + "p95": 116.0, "min": 93.0, - "max": 94.0, - "stdev": 0.4453617714151233 + "max": 116.0, + "stdev": 6.565625485551923 }, "output_sha256": "d68797a2b161b634fec27feb8b6bc77e100157293c334376792cb0341b9c5f51" }, @@ -3872,7 +3872,7 @@ 63.0, 63.0, 64.0, - 63.0, + 64.0, 63.0, 63.0 ], @@ -3881,31 +3881,31 @@ "p95": 64.0, "min": 63.0, "max": 64.0, - "stdev": 0.28747978728803447 + "stdev": 0.38569460791993504 }, "output_sha256": "d68797a2b161b634fec27feb8b6bc77e100157293c334376792cb0341b9c5f51" }, "bun": { "wall_ms": { "samples": [ - 42.0, - 40.0, - 40.0, - 42.0, - 40.0, 39.0, - 40.0, 39.0, 39.0, - 40.0, + 39.0, + 39.0, + 39.0, + 39.0, + 39.0, + 39.0, + 39.0, 39.0 ], "sample_count": 11, - "median": 40.0, - "p95": 42.0, + "median": 39.0, + "p95": 39.0, "min": 39.0, - "max": 42.0, - "stdev": 1.044465935734187 + "max": 39.0, + "stdev": 0.0 }, "output_sha256": "d68797a2b161b634fec27feb8b6bc77e100157293c334376792cb0341b9c5f51" } @@ -3921,36 +3921,36 @@ "perry": { "wall_ms": { "samples": [ + 71.0, 49.0, 49.0, 49.0, 49.0, 49.0, 49.0, - 48.0, 49.0, 49.0, - 50.0, - 49.0 + 49.0, + 48.0 ], "sample_count": 11, "median": 49.0, - "p95": 50.0, + "p95": 71.0, "min": 48.0, - "max": 50.0, - "stdev": 0.4264014327112209 + "max": 71.0, + "stdev": 6.359739066324619 }, "output_sha256": "02dbcc45c8e22eb2287af9c9106f65c992f093273c79f14f5fa49a4fc7ef0289" }, "node": { "wall_ms": { "samples": [ + 50.0, 49.0, 49.0, - 48.0, 49.0, 48.0, - 48.0, + 49.0, 49.0, 49.0, 49.0, @@ -3959,34 +3959,34 @@ ], "sample_count": 11, "median": 49.0, - "p95": 49.0, + "p95": 50.0, "min": 48.0, - "max": 49.0, - "stdev": 0.4453617714151233 + "max": 50.0, + "stdev": 0.4264014327112209 }, "output_sha256": "02dbcc45c8e22eb2287af9c9106f65c992f093273c79f14f5fa49a4fc7ef0289" }, "bun": { "wall_ms": { "samples": [ - 62.0, - 50.0, + 48.0, + 48.0, 49.0, + 48.0, + 48.0, 49.0, - 50.0, - 50.0, - 50.0, - 51.0, 49.0, - 50.0, - 50.0 + 49.0, + 48.0, + 48.0, + 49.0 ], "sample_count": 11, - "median": 50.0, - "p95": 62.0, - "min": 49.0, - "max": 62.0, - "stdev": 3.553603688307648 + "median": 48.0, + "p95": 49.0, + "min": 48.0, + "max": 49.0, + "stdev": 0.4979295977319692 }, "output_sha256": "02dbcc45c8e22eb2287af9c9106f65c992f093273c79f14f5fa49a4fc7ef0289" } @@ -4002,72 +4002,72 @@ "perry": { "wall_ms": { "samples": [ - 162.0, - 160.0, - 157.0, - 157.0, - 158.0, - 157.0, - 157.0, - 160.0, - 157.0, - 158.0, - 157.0 + 60.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0, + 43.0 ], "sample_count": 11, - "median": 157.0, - "p95": 162.0, - "min": 157.0, - "max": 162.0, - "stdev": 1.6414063713879807 + "median": 43.0, + "p95": 60.0, + "min": 43.0, + "max": 60.0, + "stdev": 4.887156383896587 }, "output_sha256": "8e77f4e216b88148ae91a1b1fafd99b59948aa3d0a447313af68e39a25cc21e2" }, "node": { "wall_ms": { "samples": [ - 18.0, 18.0, 18.0, 17.0, - 19.0, + 17.0, 18.0, 18.0, 18.0, 17.0, 18.0, - 17.0 + 18.0, + 18.0 ], "sample_count": 11, "median": 18.0, - "p95": 19.0, + "p95": 18.0, "min": 17.0, - "max": 19.0, - "stdev": 0.5749595745760689 + "max": 18.0, + "stdev": 0.4453617714151233 }, "output_sha256": "8e77f4e216b88148ae91a1b1fafd99b59948aa3d0a447313af68e39a25cc21e2" }, "bun": { "wall_ms": { "samples": [ + 18.0, 19.0, + 18.0, + 18.0, 19.0, 19.0, + 18.0, 19.0, - 19.0, - 19.0, - 19.0, - 20.0, - 19.0, - 19.0, + 18.0, + 18.0, 19.0 ], "sample_count": 11, - "median": 19.0, - "p95": 20.0, - "min": 19.0, - "max": 20.0, - "stdev": 0.28747978728803447 + "median": 18.0, + "p95": 19.0, + "min": 18.0, + "max": 19.0, + "stdev": 0.4979295977319692 }, "output_sha256": "8e77f4e216b88148ae91a1b1fafd99b59948aa3d0a447313af68e39a25cc21e2" } @@ -4083,24 +4083,24 @@ "perry": { "wall_ms": { "samples": [ - 5.0, - 4.0, - 4.0, - 4.0, - 5.0, - 4.0, - 4.0, - 4.0, - 5.0, - 4.0, - 4.0 + 7.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0, + 3.0 ], "sample_count": 11, - "median": 4.0, - "p95": 5.0, - "min": 4.0, - "max": 5.0, - "stdev": 0.4453617714151233 + "median": 3.0, + "p95": 7.0, + "min": 3.0, + "max": 7.0, + "stdev": 1.1499191491521379 }, "output_sha256": "e70c38907b55a22165abecab6fbc7e4901cc69e6aeee9fb0c32635455ec55134" }, @@ -4110,7 +4110,7 @@ 5.0, 5.0, 5.0, - 6.0, + 5.0, 5.0, 5.0, 5.0, @@ -4121,34 +4121,34 @@ ], "sample_count": 11, "median": 5.0, - "p95": 6.0, + "p95": 5.0, "min": 5.0, - "max": 6.0, - "stdev": 0.28747978728803447 + "max": 5.0, + "stdev": 0.0 }, "output_sha256": "e70c38907b55a22165abecab6fbc7e4901cc69e6aeee9fb0c32635455ec55134" }, "bun": { "wall_ms": { "samples": [ - 8.0, - 6.0, - 6.0, - 6.0, - 7.0, 6.0, + 5.0, 6.0, + 5.0, + 5.0, 6.0, 6.0, 5.0, - 6.0 + 5.0, + 6.0, + 5.0 ], "sample_count": 11, - "median": 6.0, - "p95": 8.0, + "median": 5.0, + "p95": 6.0, "min": 5.0, - "max": 8.0, - "stdev": 0.7158188976374373 + "max": 6.0, + "stdev": 0.4979295977319692 }, "output_sha256": "e70c38907b55a22165abecab6fbc7e4901cc69e6aeee9fb0c32635455ec55134" } @@ -4159,8 +4159,8 @@ "json_polyglot": { "schema_version": 1, "suite": "json_polyglot", - "commit": "36cf04e0147c68a55f362689ab6c56e2b39a3c67", - "generated_at": "2026-07-13T13:27:59Z", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", + "generated_at": "2026-08-03T05:19:38Z", "run_config": { "warmup": "3 untimed iterations inside each benchmark process", "requested_samples": 11, @@ -4168,18 +4168,18 @@ }, "commands": { "perry": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", "compile", "bench.ts", "-o", "" ], "node": [ - "/tmp/perry-bench-tools/bin/node", + "/Users/amlug/.cache/perry-bench-tools/bin/node", "" ], "bun": [ - "/tmp/perry-bench-tools/bin/bun", + "/Users/amlug/.cache/perry-bench-tools/bin/bun", "bench.ts" ], "runner": [ @@ -4188,16 +4188,16 @@ }, "runtime_metadata": { "perry": { - "version": "perry 0.5.1258", - "resolved_executable": "/private/tmp/perry-performance-baseline-0713/target/release/perry" + "version": "perry 0.5.1279", + "resolved_executable": "target/release/perry" }, "node": { "version": "v22.23.1", - "resolved_executable": "/tmp/perry-bench-tools/bin/node" + "resolved_executable": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node" }, "bun": { "version": "1.3.14", - "resolved_executable": "/tmp/perry-bench-tools/bin/bun" + "resolved_executable": "~/.cache/perry-bench-tools/bun/bun" } }, "benchmarks": { @@ -4211,70 +4211,70 @@ "perry": { "wall_ms": { "samples": [ - 410.0, - 428.0, - 421.0, - 445.0, - 414.0, - 401.0, - 398.0, - 500.0, - 468.0, - 485.0, - 425.0 + 221.0, + 213.0, + 214.0, + 214.0, + 214.0, + 214.0, + 213.0, + 212.0, + 213.0, + 213.0, + 213.0 ], "sample_count": 11, - "median": 425.0, - "p95": 500.0, - "min": 398.0, - "max": 500.0, - "stdev": 32.80924078657925 + "median": 213.0, + "p95": 221.0, + "min": 212.0, + "max": 221.0, + "stdev": 2.2962419891481978 } }, "node": { "wall_ms": { "samples": [ - 427.0, - 427.0, - 412.0, - 408.0, + 384.0, + 382.0, + 387.0, + 387.0, + 393.0, + 389.0, + 392.0, + 387.0, 397.0, 395.0, - 400.0, - 412.0, - 394.0, - 395.0, - 474.0 + 386.0 ], "sample_count": 11, - "median": 408.0, - "p95": 474.0, - "min": 394.0, - "max": 474.0, - "stdev": 22.509869277186688 + "median": 387.0, + "p95": 397.0, + "min": 382.0, + "max": 397.0, + "stdev": 4.47213595499958 } }, "bun": { "wall_ms": { "samples": [ - 244.0, - 239.0, - 254.0, - 237.0, - 239.0, - 238.0, - 236.0, - 237.0, - 240.0, - 241.0, - 241.0 + 222.0, + 223.0, + 221.0, + 222.0, + 223.0, + 223.0, + 225.0, + 224.0, + 224.0, + 222.0, + 223.0 ], "sample_count": 11, - "median": 239.0, - "p95": 254.0, - "min": 236.0, - "max": 254.0, - "stdev": 4.774242183818503 + "median": 223.0, + "p95": 225.0, + "min": 221.0, + "max": 225.0, + "stdev": 1.083306844346635 } } } @@ -4289,70 +4289,70 @@ "perry": { "wall_ms": { "samples": [ - 6800.0, - 6732.0, - 6908.0, - 6690.0, - 6916.0, - 7472.0, - 7670.0, - 6886.0, - 16330.0, - 6700.0, - 6730.0 + 2651.0, + 2641.0, + 2656.0, + 2683.0, + 2640.0, + 2638.0, + 2630.0, + 2653.0, + 2669.0, + 2920.0, + 2659.0 ], "sample_count": 11, - "median": 6886.0, - "p95": 16330.0, - "min": 6690.0, - "max": 16330.0, - "stdev": 2714.027850548649 + "median": 2653.0, + "p95": 2920.0, + "min": 2630.0, + "max": 2920.0, + "stdev": 78.36774931201869 } }, "node": { "wall_ms": { "samples": [ - 405.0, - 387.0, - 399.0, - 392.0, - 414.0, - 417.0, - 412.0, - 407.0, - 401.0, - 400.0, - 412.0 + 389.0, + 389.0, + 394.0, + 395.0, + 393.0, + 386.0, + 390.0, + 390.0, + 398.0, + 388.0, + 388.0 ], "sample_count": 11, - "median": 405.0, - "p95": 417.0, - "min": 387.0, - "max": 417.0, - "stdev": 8.993110310557258 + "median": 390.0, + "p95": 398.0, + "min": 386.0, + "max": 398.0, + "stdev": 3.4497574474564137 } }, "bun": { "wall_ms": { "samples": [ - 242.0, - 258.0, - 243.0, - 244.0, - 242.0, - 240.0, - 243.0, - 242.0, - 243.0, - 257.0, - 244.0 + 225.0, + 226.0, + 225.0, + 226.0, + 224.0, + 225.0, + 224.0, + 226.0, + 224.0, + 230.0, + 224.0 ], "sample_count": 11, - "median": 243.0, - "p95": 258.0, - "min": 240.0, - "max": 258.0, - "stdev": 5.863460180580764 + "median": 225.0, + "p95": 230.0, + "min": 224.0, + "max": 230.0, + "stdev": 1.6663911618021237 } } } @@ -4362,8 +4362,8 @@ "app_patterns": { "schema_version": 1, "suite": "app_patterns", - "commit": "36cf04e0147c68a55f362689ab6c56e2b39a3c67", - "generated_at": "2026-07-13T13:44:50Z", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", + "generated_at": "2026-08-03T05:24:53Z", "run_config": { "warmup": 3, "requested_samples": 15, @@ -4371,18 +4371,18 @@ }, "commands": { "perry": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", "", "-o", "" ], "node": [ - "/tmp/perry-bench-tools/bin/node", + "/Users/amlug/.cache/perry-bench-tools/bin/node", "--experimental-strip-types", "" ], "bun": [ - "/tmp/perry-bench-tools/bin/bun", + "/Users/amlug/.cache/perry-bench-tools/bin/bun", "run", "" ], @@ -4396,19 +4396,109 @@ }, "runtime_metadata": { "perry": { - "version": "perry 0.5.1258", - "resolved_executable": "/private/tmp/perry-performance-baseline-0713/target/release/perry" + "version": "perry 0.5.1279", + "resolved_executable": "target/release/perry" }, "node": { "version": "v22.23.1", - "resolved_executable": "/tmp/perry-bench-tools/bin/node" + "resolved_executable": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node" }, "bun": { "version": "1.3.14", - "resolved_executable": "/tmp/perry-bench-tools/bin/bun" + "resolved_executable": "~/.cache/perry-bench-tools/bun/bun" } }, "benchmarks": { + "batch": { + "correctness": { + "status": "pass", + "reference": "node+bun", + "checksum": "checksum: 1601043.5000" + }, + "runtimes": { + "perry": { + "wall_ms": { + "samples": [ + 147.218373, + 147.563415, + 148.319123, + 148.588331, + 147.047039, + 147.475956, + 149.793123, + 149.041539, + 147.116373, + 147.21754, + 147.755748, + 146.228248, + 147.309582, + 147.098581, + 147.486082 + ], + "sample_count": 15, + "median": 147.475956, + "p95": 149.793123, + "min": 146.228248, + "max": 149.793123, + "stdev": 0.8709795764199335 + } + }, + "node": { + "wall_ms": { + "samples": [ + 72.169206, + 72.557457, + 72.308915, + 72.926331, + 76.50079, + 73.465165, + 74.92779, + 71.350331, + 72.158664, + 75.012748, + 72.280831, + 72.884165, + 75.039248, + 76.18954, + 73.68379 + ], + "sample_count": 15, + "median": 72.926331, + "p95": 76.50079, + "min": 71.350331, + "max": 76.50079, + "stdev": 1.5406037767142005 + } + }, + "bun": { + "wall_ms": { + "samples": [ + 25.970373, + 25.614206, + 26.462331, + 27.980664, + 26.638539, + 26.546415, + 27.715165, + 26.040789, + 25.989623, + 25.949289, + 26.352582, + 26.001581, + 25.895248, + 26.690956, + 26.028665 + ], + "sample_count": 15, + "median": 26.040789, + "p95": 27.980664, + "min": 25.614206, + "max": 27.980664, + "stdev": 0.6455128507137528 + } + } + } + }, "buffer_transcode": { "correctness": { "status": "pass", @@ -4419,82 +4509,82 @@ "perry": { "wall_ms": { "samples": [ - 61.561556, - 62.221139, - 62.843264, - 60.287847, - 60.289347, - 70.488722, - 72.200223, - 62.138306, - 63.877723, - 59.238556, - 61.352431, - 60.233014, - 59.991098, - 60.914389, - 62.680514 + 60.305001, + 58.597292, + 62.840792, + 61.188126, + 61.672833, + 61.763792, + 63.943292, + 62.022042, + 61.6565, + 58.381709, + 58.095167, + 58.474625, + 61.912042, + 62.300501, + 60.806667 ], "sample_count": 15, - "median": 61.561556, - "p95": 72.200223, - "min": 59.238556, - "max": 72.200223, - "stdev": 3.6166730952279584 + "median": 61.6565, + "p95": 63.943292, + "min": 58.095167, + "max": 63.943292, + "stdev": 1.7323205430691497 } }, "node": { "wall_ms": { "samples": [ - 84.757056, - 87.497555, - 84.881223, - 87.681764, - 85.975806, - 85.900597, - 85.899973, - 85.053347, - 85.185222, - 87.33968, - 87.161347, - 86.738389, - 94.197472, - 84.183014, - 85.665055 + 84.637292, + 86.313876, + 84.234209, + 83.661042, + 86.273667, + 86.746376, + 84.959917, + 84.164583, + 83.712708, + 86.087417, + 85.436208, + 85.543542, + 87.463417, + 88.285375, + 85.782167 ], "sample_count": 15, - "median": 85.900597, - "p95": 94.197472, - "min": 84.183014, - "max": 94.197472, - "stdev": 2.30008696088534 + "median": 85.543542, + "p95": 88.285375, + "min": 83.661042, + "max": 88.285375, + "stdev": 1.3118234461153921 } }, "bun": { "wall_ms": { "samples": [ - 43.383306, - 45.107723, - 43.271139, - 44.102556, - 43.573556, - 45.508222, - 43.86918, - 44.584473, - 44.613181, - 44.144931, - 42.607931, - 43.614222, - 46.107722, - 43.887805, - 43.044431 + 42.817251, + 41.782167, + 45.947459, + 42.62075, + 44.180209, + 42.484667, + 43.12925, + 43.918208, + 41.706042, + 42.890792, + 44.076958, + 41.446292, + 44.456625, + 41.399375, + 43.21125 ], "sample_count": 15, - "median": 43.887805, - "p95": 46.107722, - "min": 42.607931, - "max": 46.107722, - "stdev": 0.9194853193613534 + "median": 42.890792, + "p95": 45.947459, + "min": 41.399375, + "max": 45.947459, + "stdev": 1.2323061115668736 } } } @@ -4509,82 +4599,82 @@ "perry": { "wall_ms": { "samples": [ - 43.453237, - 42.840488, - 43.124487, - 43.318529, - 43.011363, - 42.95982, - 43.901029, - 43.205237, - 43.222154, - 42.542446, - 43.928404, - 47.158904, - 48.569154, - 48.360445, - 46.100904 + 36.118822, + 36.582072, + 36.959697, + 36.06178, + 36.126406, + 36.337905, + 36.444947, + 38.163905, + 37.021364, + 36.62503, + 35.936822, + 36.580947, + 36.335822, + 37.064489, + 35.665572 ], "sample_count": 15, - "median": 43.318529, - "p95": 48.569154, - "min": 42.542446, - "max": 48.569154, - "stdev": 2.0071456037585573 + "median": 36.444947, + "p95": 38.163905, + "min": 35.665572, + "max": 38.163905, + "stdev": 0.5846640082545037 } }, "node": { "wall_ms": { "samples": [ - 119.326237, - 113.787195, - 115.17607, - 117.339529, - 113.749029, - 113.91907, - 114.91482, - 112.677862, - 113.141862, - 115.559029, - 119.955612, - 114.947571, - 118.141446, - 112.867237, - 115.447487 + 114.596364, + 112.459406, + 116.042322, + 118.203113, + 118.302989, + 122.282989, + 113.81378, + 114.24703, + 113.799406, + 117.675488, + 115.937197, + 113.91328, + 115.947697, + 114.580531, + 117.778614 ], "sample_count": 15, - "median": 114.947571, - "p95": 119.955612, - "min": 112.677862, - "max": 119.955612, - "stdev": 2.227224904334265 + "median": 115.937197, + "p95": 122.282989, + "min": 112.459406, + "max": 122.282989, + "stdev": 2.43818558849886 } }, "bun": { "wall_ms": { "samples": [ - 45.620904, - 46.08982, - 45.339821, - 45.423863, - 45.076113, - 44.946904, - 46.283154, - 45.978029, - 45.946529, - 45.274237, - 45.906946, - 47.777487, - 49.434196, - 47.870112, - 45.829863 + 45.165281, + 46.989614, + 46.075572, + 44.456364, + 45.499072, + 46.885905, + 48.050989, + 50.768572, + 46.555364, + 44.759739, + 45.742572, + 45.73003, + 46.743947, + 48.117614, + 48.079947 ], "sample_count": 15, - "median": 45.906946, - "p95": 49.434196, - "min": 44.946904, - "max": 49.434196, - "stdev": 1.196064508058539 + "median": 46.555364, + "p95": 50.768572, + "min": 44.456364, + "max": 50.768572, + "stdev": 1.575343100051916 } } } @@ -4599,82 +4689,82 @@ "perry": { "wall_ms": { "samples": [ - 277.046861, - 305.702819, - 283.582319, - 277.38961, - 276.212652, - 288.151694, - 275.919069, - 277.66261, - 280.287027, - 273.945527, - 276.461735, - 277.191444, - 276.070235, - 274.808527, - 272.624319 + 132.734229, + 133.399145, + 133.746645, + 132.168728, + 133.866103, + 132.934853, + 135.36527, + 133.255603, + 135.762645, + 132.412187, + 133.539562, + 135.224937, + 134.465395, + 133.572145, + 132.861062 ], "sample_count": 15, - "median": 277.046861, - "p95": 305.702819, - "min": 272.624319, - "max": 305.702819, - "stdev": 7.927344424039686 + "median": 133.539562, + "p95": 135.762645, + "min": 132.168728, + "max": 135.762645, + "stdev": 1.04949317187015 } }, "node": { "wall_ms": { "samples": [ - 122.622361, - 124.778027, - 128.35461, - 126.450569, - 133.490444, - 126.166527, - 132.111611, - 125.377194, - 122.091319, - 125.507986, - 124.472569, - 127.266235, - 129.493527, - 124.263485, - 122.921193 + 128.884186, + 123.067562, + 122.665562, + 127.81502, + 124.524061, + 124.05377, + 123.09227, + 126.699687, + 127.089437, + 121.493478, + 125.48452, + 127.060187, + 121.050604, + 123.014312, + 123.171853 ], "sample_count": 15, - "median": 125.507986, - "p95": 133.490444, - "min": 122.091319, - "max": 133.490444, - "stdev": 3.21203745590347 + "median": 124.05377, + "p95": 128.884186, + "min": 121.050604, + "max": 128.884186, + "stdev": 2.332382675848307 } }, "bun": { "wall_ms": { "samples": [ - 73.500486, - 68.536986, - 68.403735, - 68.689735, - 68.251611, - 68.707194, - 73.923819, - 68.700486, - 67.98236, - 68.657194, - 68.718318, - 68.266777, - 67.862152, - 68.297361, - 69.382527 + 67.32977, + 70.482937, + 68.445562, + 67.75302, + 67.960603, + 69.478728, + 67.557479, + 68.19902, + 69.211645, + 68.302687, + 68.031936, + 69.184854, + 68.744187, + 69.06002, + 68.462062 ], "sample_count": 15, - "median": 68.657194, - "p95": 73.923819, - "min": 67.862152, - "max": 73.923819, - "stdev": 1.8083441035266403 + "median": 68.445562, + "p95": 70.482937, + "min": 67.32977, + "max": 70.482937, + "stdev": 0.8027159063728316 } } } @@ -4689,82 +4779,82 @@ "perry": { "wall_ms": { "samples": [ - 98.815099, - 98.414517, - 99.843891, - 99.917308, - 99.745641, - 100.358766, - 99.142183, - 99.411183, - 99.013183, - 99.922224, - 98.707266, - 99.400141, - 100.359433, - 99.329475, - 99.00435 + 99.602463, + 99.299338, + 97.624588, + 97.007588, + 96.965212, + 96.674255, + 97.462962, + 96.446838, + 97.07613, + 96.454712, + 97.319671, + 96.322296, + 96.615046, + 96.459463, + 96.535088 ], "sample_count": 15, - "median": 99.400141, - "p95": 100.359433, - "min": 98.414517, - "max": 100.359433, - "stdev": 0.5690701883673042 + "median": 96.965212, + "p95": 99.602463, + "min": 96.322296, + "max": 99.602463, + "stdev": 0.9678579573305635 } }, "node": { "wall_ms": { "samples": [ - 94.095683, - 99.038433, - 109.336558, - 108.479933, - 97.265267, - 97.337266, - 94.167016, - 96.014933, - 96.482683, - 95.080225, - 95.2771, - 96.309933, - 94.861308, - 96.846558, - 95.613808 + 98.166754, + 94.093296, + 94.303755, + 92.181921, + 93.129296, + 90.792546, + 93.21763, + 92.581838, + 94.421421, + 94.743713, + 94.734213, + 95.519338, + 93.101546, + 91.562712, + 91.394796 ], "sample_count": 15, - "median": 96.309933, - "p95": 109.336558, - "min": 94.095683, - "max": 109.336558, - "stdev": 4.555540118666806 + "median": 93.21763, + "p95": 98.166754, + "min": 90.792546, + "max": 98.166754, + "stdev": 1.8093433910884404 } }, "bun": { "wall_ms": { "samples": [ - 38.400475, - 38.914016, - 37.637392, - 37.780599, - 38.368808, - 38.084641, - 39.125016, - 38.260849, - 38.276891, - 38.028099, - 37.99485, - 37.837183, - 37.775349, - 39.247225, - 43.77785 + 37.110713, + 36.752754, + 37.444421, + 37.596421, + 38.415296, + 37.917463, + 38.789171, + 39.102379, + 37.290546, + 37.789879, + 38.051629, + 38.283837, + 37.300921, + 37.707005, + 38.120129 ], "sample_count": 15, - "median": 38.260849, - "p95": 43.77785, - "min": 37.637392, - "max": 43.77785, - "stdev": 1.4541324168392584 + "median": 37.789879, + "p95": 39.102379, + "min": 36.752754, + "max": 39.102379, + "stdev": 0.6161100651940687 } } } @@ -4779,82 +4869,82 @@ "perry": { "wall_ms": { "samples": [ - 853.893171, - 884.38863, - 918.820504, - 861.530755, - 861.589963, - 845.464463, - 892.072922, - 858.361213, - 843.786296, - 887.588004, - 849.774671, - 871.659004, - 890.025338, - 849.166754, - 854.865838 + 670.628515, + 678.62114, + 672.53739, + 715.324557, + 677.396348, + 673.312474, + 686.217724, + 690.753265, + 673.566265, + 671.68214, + 666.264057, + 669.331557, + 711.285516, + 679.584765, + 678.088182 ], "sample_count": 15, - "median": 861.530755, - "p95": 918.820504, - "min": 843.786296, - "max": 918.820504, - "stdev": 21.04087690691445 + "median": 677.396348, + "p95": 715.324557, + "min": 666.264057, + "max": 715.324557, + "stdev": 14.09614465230331 } }, "node": { "wall_ms": { "samples": [ - 263.412046, - 278.21438, - 344.044379, - 263.435545, - 258.02638, - 275.066213, - 260.407504, - 270.322046, - 282.001838, - 263.636797, - 282.335045, - 296.706838, - 296.124088, - 301.784045, - 285.116379 + 263.947723, + 272.72139, + 260.509307, + 274.69239, + 266.672557, + 263.809015, + 273.571098, + 264.700891, + 271.997974, + 271.281682, + 262.769391, + 268.102182, + 269.20514, + 259.029557, + 315.493557 ], "sample_count": 15, - "median": 278.21438, - "p95": 344.044379, - "min": 258.02638, - "max": 344.044379, - "stdev": 21.49074407912306 + "median": 268.102182, + "p95": 315.493557, + "min": 259.029557, + "max": 315.493557, + "stdev": 12.893679099485109 } }, "bun": { "wall_ms": { "samples": [ - 227.214628, - 234.87888, - 236.508255, - 231.006088, - 228.968713, - 231.175378, - 227.51713, - 234.309463, - 239.174879, - 225.417171, - 242.516672, - 235.032504, - 227.565754, - 233.228129, - 235.73217 + 224.164932, + 226.521432, + 222.369223, + 239.209557, + 228.265266, + 231.752557, + 224.711932, + 255.568348, + 225.641807, + 226.625265, + 225.793557, + 233.289807, + 237.853516, + 223.861015, + 216.927849 ], "sample_count": 15, - "median": 233.228129, - "p95": 242.516672, - "min": 225.417171, - "max": 242.516672, - "stdev": 4.694030859786649 + "median": 226.521432, + "p95": 255.568348, + "min": 216.927849, + "max": 255.568348, + "stdev": 8.953321556245223 } } } @@ -4869,82 +4959,82 @@ "perry": { "wall_ms": { "samples": [ - 781.44291, - 793.640826, - 800.82991, - 797.234368, - 826.808326, - 765.107243, - 772.361535, - 780.295702, - 770.95191, - 799.007702, - 784.482285, - 802.288035, - 835.05766, - 764.802451, - 805.454744 + 564.163518, + 547.065935, + 548.072685, + 546.375102, + 547.43531, + 546.87481, + 560.912435, + 567.621101, + 562.97406, + 563.982852, + 576.741393, + 570.51531, + 560.254935, + 567.023477, + 564.169602 ], "sample_count": 15, - "median": 793.640826, - "p95": 835.05766, - "min": 764.802451, - "max": 835.05766, - "stdev": 20.17621558184826 + "median": 562.97406, + "p95": 576.741393, + "min": 546.375102, + "max": 576.741393, + "stdev": 9.597420144132398 } }, "node": { "wall_ms": { "samples": [ - 55.341577, - 56.181077, - 57.897326, - 56.15191, - 57.030868, - 54.493702, - 55.527369, - 55.523577, - 56.41866, - 56.329119, - 56.719576, - 56.436493, - 61.627618, - 59.457994, - 55.735535 + 55.644976, + 54.454685, + 56.165768, + 54.56906, + 56.66406, + 57.293018, + 54.76031, + 55.378935, + 57.914851, + 55.975935, + 53.64056, + 54.505643, + 54.754018, + 55.06381, + 54.493851 ], "sample_count": 15, - "median": 56.329119, - "p95": 61.627618, - "min": 54.493702, - "max": 61.627618, - "stdev": 1.7258865687911031 + "median": 55.06381, + "p95": 57.914851, + "min": 53.64056, + "max": 57.914851, + "stdev": 1.1465717857513031 } }, "bun": { "wall_ms": { "samples": [ - 17.44741, - 18.051535, - 18.241368, - 18.230619, - 17.11891, - 18.294118, - 17.81816, - 18.177993, - 18.984201, - 18.56516, - 17.225494, - 18.503243, - 20.152743, - 18.137743, - 18.462535 + 18.153143, + 17.31931, + 17.690268, + 16.850019, + 17.745101, + 18.213435, + 17.338144, + 16.892685, + 17.429393, + 17.419852, + 16.922477, + 17.770519, + 17.056435, + 17.307893, + 18.665935 ], "sample_count": 15, - "median": 18.230619, - "p95": 20.152743, - "min": 17.11891, - "max": 20.152743, - "stdev": 0.7108513787847983 + "median": 17.419852, + "p95": 18.665935, + "min": 16.850019, + "max": 18.665935, + "stdev": 0.5091279621778749 } } } @@ -4959,82 +5049,82 @@ "perry": { "wall_ms": { "samples": [ - 212.555857, - 207.330524, - 206.933898, - 207.192023, - 206.936357, - 209.023232, - 206.321107, - 208.006066, - 207.947649, - 211.736399, - 205.210607, - 208.729857, - 269.515315, - 273.424524, - 218.365649 + 158.238034, + 161.78495, + 158.180159, + 159.123533, + 158.794533, + 156.883242, + 161.536784, + 156.601909, + 157.26195, + 158.157075, + 156.559284, + 160.095533, + 158.23895, + 160.584951, + 158.626659 ], "sample_count": 15, - "median": 208.006066, - "p95": 273.424524, - "min": 205.210607, - "max": 273.424524, - "stdev": 21.494031462960333 + "median": 158.23895, + "p95": 161.78495, + "min": 156.559284, + "max": 161.78495, + "stdev": 1.6041792692532217 } }, "node": { "wall_ms": { "samples": [ - 67.776982, - 64.302815, - 64.699816, - 67.892065, - 70.489691, - 68.94494, - 73.067523, - 77.755524, - 72.292232, - 68.659607, - 71.504357, - 69.097023, - 68.669857, - 68.150024, - 67.03744 + 62.833117, + 63.682117, + 60.764908, + 62.01095, + 60.647742, + 62.816283, + 62.116742, + 63.035576, + 61.156325, + 64.943659, + 65.20945, + 61.046992, + 61.892367, + 62.502992, + 62.20695 ], "sample_count": 15, - "median": 68.669857, - "p95": 77.755524, - "min": 64.302815, - "max": 77.755524, - "stdev": 3.252922612912587 + "median": 62.20695, + "p95": 65.20945, + "min": 60.647742, + "max": 65.20945, + "stdev": 1.3261551053862772 } }, "bun": { "wall_ms": { "samples": [ - 26.199482, - 25.727232, - 23.668399, - 23.765982, - 23.91719, - 23.37519, - 22.916024, - 23.681024, - 22.761232, - 22.932023, - 23.803816, - 31.490065, - 29.736982, - 27.323232, - 27.692024 + 22.019284, + 23.417908, + 22.879617, + 22.325742, + 22.473117, + 22.421033, + 23.017325, + 24.355534, + 22.469701, + 22.740367, + 22.538783, + 22.18545, + 22.355242, + 23.006742, + 23.016075 ], "sample_count": 15, - "median": 23.803816, - "p95": 31.490065, - "min": 22.761232, - "max": 31.490065, - "stdev": 2.6079525569492983 + "median": 22.538783, + "p95": 24.355534, + "min": 22.019284, + "max": 24.355534, + "stdev": 0.5624595553225137 } } } @@ -5049,82 +5139,82 @@ "perry": { "wall_ms": { "samples": [ - 61.324555, - 62.282263, - 61.97843, - 61.276013, - 61.26693, - 61.101179, - 61.269721, - 58.674054, - 60.601638, - 57.94693, - 57.780138, - 56.69868, - 58.116263, - 57.966929, - 56.768138 + 57.213988, + 57.025405, + 57.186155, + 57.470072, + 57.715489, + 57.666197, + 57.16953, + 56.77828, + 58.294905, + 60.95928, + 57.545155, + 57.838614, + 57.700238, + 57.740989, + 58.13753 ], "sample_count": 15, - "median": 60.601638, - "p95": 62.282263, - "min": 56.69868, - "max": 62.282263, - "stdev": 1.925126218541093 + "median": 57.666197, + "p95": 60.95928, + "min": 56.77828, + "max": 60.95928, + "stdev": 0.9414359264274167 } }, "node": { "wall_ms": { "samples": [ - 97.908138, - 99.401846, - 97.682346, - 98.977471, - 101.751305, - 100.254138, - 100.747679, - 103.399429, - 98.118888, - 99.520554, - 99.24993, - 101.530347, - 99.970054, - 99.088388, - 104.129929 + 101.284697, + 101.710655, + 103.668447, + 102.875988, + 103.60603, + 102.124321, + 104.281071, + 101.02178, + 100.900405, + 101.161613, + 103.45578, + 99.645405, + 101.477447, + 100.803072, + 102.481155 ], "sample_count": 15, - "median": 99.520554, - "p95": 104.129929, - "min": 97.682346, - "max": 104.129929, - "stdev": 1.839550544279417 + "median": 101.710655, + "p95": 104.281071, + "min": 99.645405, + "max": 104.281071, + "stdev": 1.2753440131930143 } }, "bun": { "wall_ms": { "samples": [ - 54.177096, - 49.974055, - 48.332888, - 50.095805, - 48.836888, - 51.196263, - 53.01943, - 76.618054, - 58.343013, - 54.04493, - 50.715638, - 49.847305, - 49.990221, - 50.336471, - 49.547471 + 52.57903, + 50.906321, + 51.580697, + 52.687155, + 51.061696, + 50.424072, + 51.016321, + 51.177613, + 51.758905, + 50.72803, + 52.099489, + 51.471447, + 50.866905, + 50.944322, + 51.80328 ], "sample_count": 15, - "median": 50.336471, - "p95": 76.618054, - "min": 48.332888, - "max": 76.618054, - "stdev": 6.792280897260824 + "median": 51.177613, + "p95": 52.687155, + "min": 50.424072, + "max": 52.687155, + "stdev": 0.6488592672688345 } } } @@ -5139,82 +5229,82 @@ "perry": { "wall_ms": { "samples": [ - 55.952237, - 56.390987, - 56.619071, - 59.49082, - 60.104737, - 59.529945, - 63.394862, - 65.227695, - 68.353946, - 61.636654, - 60.489279, - 96.189153, - 65.362945, - 57.611946, - 58.019945 + 40.187997, + 39.877415, + 39.725873, + 39.458039, + 39.353331, + 40.413665, + 40.136498, + 40.245748, + 39.535706, + 39.869539, + 41.119914, + 40.411289, + 39.842789, + 40.019165, + 39.950873 ], "sample_count": 15, - "median": 60.104737, - "p95": 96.189153, - "min": 55.952237, - "max": 96.189153, - "stdev": 9.555659785329802 + "median": 39.950873, + "p95": 41.119914, + "min": 39.353331, + "max": 41.119914, + "stdev": 0.42969404077591 } }, "node": { "wall_ms": { "samples": [ - 88.211695, - 90.555362, - 99.42807, - 89.74657, - 98.351737, - 93.091445, - 96.645571, - 92.917904, - 90.855153, - 93.36657, - 89.495112, - 89.878029, - 87.420404, - 89.126112, - 88.33107 + 86.077248, + 86.517164, + 85.024081, + 87.409415, + 86.17754, + 85.559623, + 85.289789, + 86.829414, + 85.98704, + 86.041123, + 87.328831, + 87.10054, + 84.64229, + 88.785956, + 86.105748 ], "sample_count": 15, - "median": 90.555362, - "p95": 99.42807, - "min": 87.420404, - "max": 99.42807, - "stdev": 3.6226786209615627 + "median": 86.105748, + "p95": 88.785956, + "min": 84.64229, + "max": 88.785956, + "stdev": 1.021114644245255 } }, "bun": { "wall_ms": { "samples": [ - 31.135945, - 28.613987, - 29.368404, - 28.239612, - 30.96957, - 29.302154, - 29.64157, - 33.601904, - 29.952487, - 55.411695, - 34.250695, - 29.557487, - 29.808154, - 30.038612, - 32.313696 + 28.559831, + 27.965706, + 27.850206, + 28.02754, + 29.351122, + 28.674331, + 27.947497, + 27.585581, + 28.395331, + 27.840456, + 29.275664, + 27.958748, + 27.735956, + 27.872414, + 28.648914 ], "sample_count": 15, - "median": 29.952487, - "p95": 55.411695, - "min": 28.239612, - "max": 55.411695, - "stdev": 6.4368855001559275 + "median": 27.965706, + "p95": 29.351122, + "min": 27.585581, + "max": 29.351122, + "stdev": 0.5293385841296494 } } } @@ -5229,82 +5319,82 @@ "perry": { "wall_ms": { "samples": [ - 53.03551, - 58.133885, - 53.643052, - 53.051718, - 57.332719, - 53.278677, - 50.823261, - 52.002802, - 50.674594, - 55.451219, - 51.745219, - 52.236177, - 50.656219, - 51.792427, - 51.256885 + 41.402353, + 41.208311, + 40.738686, + 40.994727, + 42.295728, + 40.814061, + 40.452353, + 40.594519, + 40.429811, + 41.08077, + 40.334852, + 41.088728, + 41.041311, + 41.098852, + 41.538061 ], "sample_count": 15, - "median": 52.236177, - "p95": 58.133885, - "min": 50.656219, - "max": 58.133885, - "stdev": 2.234874292962014 + "median": 41.041311, + "p95": 42.295728, + "min": 40.334852, + "max": 42.295728, + "stdev": 0.48535068449590985 } }, "node": { "wall_ms": { "samples": [ - 84.878927, - 82.588344, - 88.59376, - 83.901094, - 81.933636, - 81.443052, - 85.252677, - 82.829552, - 80.693344, - 82.843593, - 80.859094, - 85.618802, - 83.368594, - 80.616469, - 81.390552 + 82.016769, + 80.041853, + 78.743228, + 79.586477, + 78.080561, + 78.892019, + 79.356228, + 79.020394, + 78.743436, + 81.132061, + 78.912019, + 78.789395, + 80.680061, + 78.024436, + 79.87952 ], "sample_count": 15, - "median": 82.829552, - "p95": 88.59376, - "min": 80.616469, - "max": 88.59376, - "stdev": 2.151621707867814 + "median": 79.020394, + "p95": 82.016769, + "min": 78.024436, + "max": 82.016769, + "stdev": 1.0838047643520083 } }, "bun": { "wall_ms": { "samples": [ - 52.714677, - 48.912219, - 46.802261, - 47.107718, - 49.965802, - 46.211552, - 46.56001, - 45.563719, - 47.215635, - 45.381802, - 44.871718, - 45.702511, - 45.700427, - 47.181219, - 44.926468 + 46.502228, + 47.555894, + 46.763144, + 50.838645, + 49.870061, + 48.350811, + 47.630644, + 46.438061, + 47.322144, + 46.153561, + 45.845477, + 46.873561, + 45.894019, + 47.177811, + 50.413978 ], "sample_count": 15, - "median": 46.56001, - "p95": 52.714677, - "min": 44.871718, - "max": 52.714677, - "stdev": 2.0483508894096962 + "median": 47.177811, + "p95": 50.838645, + "min": 45.845477, + "max": 50.838645, + "stdev": 1.5542961961690767 } } } @@ -5319,82 +5409,82 @@ "perry": { "wall_ms": { "samples": [ - 86.025622, - 84.922079, - 86.350663, - 84.824622, - 84.673371, - 87.812579, - 88.880871, - 85.709329, - 85.605788, - 85.222288, - 86.11983, - 88.647163, - 88.227497, - 87.254038, - 83.377579 + 68.923938, + 67.972396, + 68.507437, + 68.192021, + 69.105896, + 69.345479, + 69.19877, + 67.759521, + 69.096063, + 67.542437, + 67.288146, + 67.118562, + 68.112021, + 68.436021, + 68.194063 ], "sample_count": 15, - "median": 86.025622, - "p95": 88.880871, - "min": 83.377579, - "max": 88.880871, - "stdev": 1.5577778256793788 + "median": 68.194063, + "p95": 69.345479, + "min": 67.118562, + "max": 69.345479, + "stdev": 0.6870381237224479 } }, "node": { "wall_ms": { "samples": [ - 112.672496, - 115.451663, - 107.742163, - 112.304538, - 108.110497, - 107.802329, - 115.22287, - 113.826079, - 108.540788, - 111.748871, - 108.304747, - 107.62558, - 106.887912, - 112.093038, - 113.060163 + 105.245687, + 102.995063, + 101.649938, + 102.485313, + 105.113479, + 104.383812, + 105.259354, + 102.835854, + 103.613938, + 101.620771, + 108.529729, + 104.522729, + 103.985188, + 105.378688, + 104.948104 ], "sample_count": 15, - "median": 111.748871, - "p95": 115.451663, - "min": 106.887912, - "max": 115.451663, - "stdev": 2.899016387147231 + "median": 104.383812, + "p95": 108.529729, + "min": 101.620771, + "max": 108.529729, + "stdev": 1.706241551925004 } }, "bun": { "wall_ms": { "samples": [ - 47.892746, - 48.464288, - 46.47233, - 50.458496, - 49.333788, - 49.339329, - 47.333078, - 47.788747, - 48.62758, - 52.414912, - 47.36258, - 45.518829, - 46.336663, - 50.641371, - 49.287288 + 40.947313, + 40.970979, + 41.252354, + 42.347229, + 41.647229, + 41.135021, + 43.765229, + 44.364854, + 44.653604, + 42.763104, + 41.888437, + 42.788688, + 44.333729, + 42.984604, + 43.878854 ], "sample_count": 15, - "median": 48.464288, - "p95": 52.414912, - "min": 45.518829, - "max": 52.414912, - "stdev": 1.7699382298741637 + "median": 42.763104, + "p95": 44.653604, + "min": 40.947313, + "max": 44.653604, + "stdev": 1.2736266953282587 } } } @@ -5404,8 +5494,8 @@ "honest_bench": { "schema_version": 1, "suite": "honest_bench", - "commit": "36cf04e0147c68a55f362689ab6c56e2b39a3c67", - "generated_at": "2026-07-13T14:04:19.584429Z", + "commit": "defa4d6012fb480fca237ea10509da74bd41624d", + "generated_at": "2026-08-03T05:25:59.733855Z", "run_config": { "warmup": 5, "requested_samples": 20 @@ -5415,18 +5505,18 @@ "" ], "perry_compile": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", "", "-o", "" ], "node": [ - "/tmp/perry-bench-tools/bin/node", + "/Users/amlug/.cache/perry-bench-tools/bin/node", "--experimental-strip-types", "" ], "bun": [ - "/tmp/perry-bench-tools/bin/bun", + "/Users/amlug/.cache/perry-bench-tools/bin/bun", "run", "" ], @@ -5434,7 +5524,7 @@ "" ], "perry_http_compile": [ - "/private/tmp/perry-performance-baseline-0713/target/release/perry", + "/Users/amlug/projects/perry/wt-baseline2/target/release/perry", "", "-o", "" @@ -5466,16 +5556,16 @@ }, "runtime_metadata": { "perry": { - "version": "perry 0.5.1258", - "resolved_executable": "/private/tmp/perry-performance-baseline-0713/target/release/perry" + "version": "perry 0.5.1279", + "resolved_executable": "target/release/perry" }, "node": { "version": "v22.23.1", - "resolved_executable": "/tmp/perry-bench-tools/bin/node" + "resolved_executable": "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node" }, "bun": { "version": "1.3.14", - "resolved_executable": "/tmp/perry-bench-tools/bin/bun" + "resolved_executable": "~/.cache/perry-bench-tools/bun/bun" } }, "benchmarks": { @@ -5488,201 +5578,201 @@ "perry": { "wall_ms": { "samples": [ - 305.148041, - 303.918958, - 303.849625, - 304.390708, - 303.592125, - 304.011209, - 304.911083, - 304.407458, - 304.221083, - 302.936541, - 303.79225, - 305.190541, - 327.3785, - 311.18975, - 304.264, - 310.239458, - 309.620209, - 304.634208, - 305.197792, - 303.585291 + 276.567417, + 276.578, + 279.139125, + 278.086917, + 283.254834, + 278.398834, + 288.628292, + 284.261625, + 286.069375, + 288.061125, + 282.857583, + 283.008708, + 278.262375, + 278.460458, + 276.023833, + 279.091125, + 290.197792, + 275.7535, + 277.823292, + 275.293 ], "sample_count": 20, - "median": 304.399083, - "p95": 311.18975, - "min": 302.936541, - "max": 327.3785, - "stdev": 5.329782639417633 + "median": 278.77579149999997, + "p95": 288.628292, + "min": 275.293, + "max": 290.197792, + "stdev": 4.53395696602886 }, "rss_kb": { "samples": [ - 61456.0, - 61440.0, - 61440.0, - 61456.0, - 61440.0, - 61456.0, - 61456.0, - 61440.0, - 61456.0, - 61440.0, - 61440.0, - 61456.0, - 61440.0, - 61440.0, - 61456.0, - 61440.0, - 61440.0, - 61440.0, - 61456.0, - 61456.0 + 57360.0, + 57344.0, + 57344.0, + 57360.0, + 57344.0, + 57360.0, + 57344.0, + 57360.0, + 57344.0, + 57344.0, + 57360.0, + 57360.0, + 57344.0, + 57344.0, + 57360.0, + 57360.0, + 57344.0, + 57344.0, + 57360.0, + 57344.0 ], "sample_count": 20, - "median": 61440.0, - "p95": 61456.0, - "min": 61440.0, - "max": 61456.0, + "median": 57344.0, + "p95": 57360.0, + "min": 57344.0, + "max": 57360.0, "stdev": 7.95989949685296 }, "measured_command": [ - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" + "benchmarks/honest_bench/workloads/3_image_convolution/perry/image_conv" ] }, "node": { "wall_ms": { "samples": [ - 1217.942834, - 1217.252, - 1215.709708, - 1216.76425, - 1221.413042, - 1221.242875, - 1215.722125, - 1221.337916, - 1213.143917, - 1225.192292, - 1215.167334, - 1224.893875, - 1222.175333, - 1211.241458, - 1223.111708, - 1241.298833, - 1218.937459, - 1216.710833, - 1224.819208, - 1217.772084 + 1231.628875, + 1231.856458, + 1231.788958, + 1237.020875, + 1232.6435, + 1231.673041, + 1233.081417, + 1234.069708, + 1228.575833, + 1234.768459, + 1233.776833, + 1239.754833, + 1240.383584, + 1228.644333, + 1231.665417, + 1235.899708, + 1233.7075, + 1230.914833, + 1231.7945, + 1227.493166 ], "sample_count": 20, - "median": 1218.4401465, - "p95": 1225.192292, - "min": 1211.241458, - "max": 1241.298833, - "stdev": 6.206022884752623 + "median": 1232.249979, + "p95": 1239.754833, + "min": 1227.493166, + "max": 1240.383584, + "stdev": 3.2636849715380865 }, "rss_kb": { "samples": [ - 120320.0, - 120896.0, - 120512.0, - 120464.0, - 120640.0, - 120432.0, - 120480.0, - 120544.0, - 120352.0, - 120320.0, 120672.0, - 120512.0, - 120640.0, - 120640.0, - 120544.0, - 120592.0, - 120464.0, - 120480.0, - 120560.0, - 120496.0 + 120768.0, + 120720.0, + 120720.0, + 120720.0, + 120528.0, + 120704.0, + 120768.0, + 120688.0, + 120688.0, + 120800.0, + 120688.0, + 120800.0, + 120800.0, + 120496.0, + 120832.0, + 120976.0, + 120800.0, + 120720.0, + 120544.0 ], "sample_count": 20, - "median": 120512.0, - "p95": 120672.0, - "min": 120320.0, - "max": 120896.0, - "stdev": 130.47605144240072 + "median": 120720.0, + "p95": 120832.0, + "min": 120496.0, + "max": 120976.0, + "stdev": 107.67655269370394 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/node", + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", "--experimental-strip-types", "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" ] }, "bun": { "wall_ms": { "samples": [ - 869.799208, - 912.699667, - 902.608584, - 894.959334, - 897.634458, - 973.888416, - 862.893833, - 864.126083, - 862.553208, - 895.642333, - 901.769459, - 904.755542, - 870.550416, - 868.566584, - 906.519583, - 918.389208, - 894.307958, - 889.638459, - 879.471916, - 1012.531209 + 925.063, + 908.066625, + 872.349667, + 907.244583, + 913.362958, + 904.167459, + 902.129375, + 904.128, + 870.287583, + 1039.200667, + 870.899917, + 923.231083, + 911.051625, + 918.951959, + 926.158, + 924.485625, + 883.202708, + 909.644292, + 924.097042, + 909.704125 ], "sample_count": 20, - "median": 895.3008335, - "p95": 973.888416, - "min": 862.553208, - "max": 1012.531209, - "stdev": 36.14414593758989 + "median": 909.6742085, + "p95": 926.158, + "min": 870.287583, + "max": 1039.200667, + "stdev": 34.00589952718631 }, "rss_kb": { "samples": [ - 84944.0, - 85104.0, + 85264.0, + 85136.0, + 84976.0, 85120.0, - 85024.0, - 85088.0, 85136.0, - 84944.0, - 84928.0, - 84960.0, - 85152.0, - 85040.0, - 85008.0, - 84928.0, - 84912.0, - 85008.0, + 85136.0, + 85088.0, + 85120.0, 85056.0, - 85024.0, + 85248.0, 85072.0, - 84944.0, - 85152.0 + 85152.0, + 85056.0, + 85120.0, + 85056.0, + 85120.0, + 84960.0, + 85120.0, + 85104.0, + 85120.0 ], "sample_count": 20, - "median": 85024.0, - "p95": 85152.0, - "min": 84912.0, - "max": 85152.0, - "stdev": 78.48159019795662 + "median": 85120.0, + "p95": 85248.0, + "min": 84960.0, + "max": 85264.0, + "stdev": 70.08566187174092 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/bun", + "~/.cache/perry-bench-tools/bun/bun", "run", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" + "benchmarks/honest_bench/workloads/3_image_convolution/node/image_conv.ts" ] } } @@ -5696,207 +5786,207 @@ "perry": { "wall_ms": { "samples": [ - 3518.109666, - 3549.768375, - 3513.453584, - 3541.486584, - 3811.164792, - 3642.191, - 3709.851291, - 3687.651584, - 3754.142292, - 3783.563042, - 3779.859, - 3772.413209, - 3623.724458, - 3520.407666, - 3579.668084, - 3537.071375, - 3551.982791, - 3526.684542, - 3628.441583, - 3543.547375 + 2598.6255, + 2594.918375, + 2601.07225, + 2583.418, + 2598.241541, + 2591.548125, + 2660.178292, + 2595.250834, + 2585.578375, + 2585.214458, + 2589.28175, + 2599.656791, + 2599.879792, + 2589.810291, + 2605.305875, + 2586.511709, + 2590.769584, + 2588.119167, + 2583.219916, + 2587.612542 ], "sample_count": 20, - "median": 3601.696271, - "p95": 3783.563042, - "min": 3513.453584, - "max": 3811.164792, - "stdev": 103.00509650693311 + "median": 2591.1588545, + "p95": 2605.305875, + "min": 2583.219916, + "max": 2660.178292, + "stdev": 16.079899830910573 }, "rss_kb": { "samples": [ - 1002128.0, - 933632.0, - 1002128.0, - 1002128.0, - 1002128.0, - 1002432.0, - 1002144.0, - 1002432.0, - 935328.0, - 984816.0, - 1002080.0, - 976208.0, - 1002448.0, - 1002128.0, - 933616.0, - 977184.0, - 1002432.0, - 1002128.0, - 1002080.0, - 985136.0 + 749328.0, + 749312.0, + 749328.0, + 749328.0, + 749312.0, + 749328.0, + 749328.0, + 749312.0, + 749328.0, + 749328.0, + 749312.0, + 749328.0, + 749328.0, + 749328.0, + 749328.0, + 749328.0, + 749312.0, + 749328.0, + 749328.0, + 749328.0 ], "sample_count": 20, - "median": 1002128.0, - "p95": 1002432.0, - "min": 933616.0, - "max": 1002448.0, - "stdev": 24071.32201105706 + "median": 749328.0, + "p95": 749328.0, + "min": 749312.0, + "max": 749328.0, + "stdev": 6.928203230275509 }, "measured_command": [ - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input.json", - "/tmp/out_perry.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_perry.json" ] }, "node": { "wall_ms": { "samples": [ - 1177.850208, - 1178.8145, - 1157.770333, - 1148.726083, - 1151.347375, - 1152.115625, - 1191.983917, - 1170.108917, - 1158.799834, - 1137.887833, - 1152.506458, - 1169.959, - 1211.888666, - 1186.638083, - 1166.519666, - 1194.302208, - 1163.824417, - 1187.153708, - 1193.8205, - 1190.642417 + 892.495459, + 887.494167, + 890.852625, + 904.171667, + 892.476041, + 885.758834, + 885.87825, + 882.494375, + 896.185625, + 888.26725, + 887.598291, + 894.838042, + 886.48575, + 887.145334, + 874.855292, + 893.845667, + 892.256833, + 896.750042, + 891.299084, + 887.35775 ], "sample_count": 20, - "median": 1170.0339585000002, - "p95": 1194.302208, - "min": 1137.887833, - "max": 1211.888666, - "stdev": 19.00568140852154 + "median": 889.5599374999999, + "p95": 896.750042, + "min": 874.855292, + "max": 904.171667, + "stdev": 5.940600518304061 }, "rss_kb": { "samples": [ - 793712.0, - 793472.0, - 793664.0, - 793632.0, - 793504.0, 793600.0, + 793568.0, + 793840.0, + 795296.0, + 793584.0, + 793696.0, + 793824.0, + 793680.0, + 794912.0, 793632.0, - 793792.0, - 793392.0, - 793712.0, - 793280.0, - 793504.0, - 797360.0, - 795280.0, - 793648.0, - 793328.0, - 793504.0, - 795856.0, + 793840.0, 793664.0, - 793632.0 + 793680.0, + 793728.0, + 793728.0, + 797808.0, + 797472.0, + 793744.0, + 794416.0, + 794064.0 ], "sample_count": 20, - "median": 793632.0, - "p95": 795856.0, - "min": 793280.0, - "max": 797360.0, - "stdev": 995.482917985035 + "median": 793736.0, + "p95": 797472.0, + "min": 793568.0, + "max": 797808.0, + "stdev": 1202.8496830443944 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/node", + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", "--experimental-strip-types", "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input.json", - "/tmp/out_node.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_node.json" ] }, "bun": { "wall_ms": { "samples": [ - 575.4055, - 572.179041, - 599.701166, - 576.903334, - 630.339167, - 582.149541, - 574.841208, - 589.411166, - 570.27875, - 581.733791, - 586.508333, - 570.968458, - 573.62675, - 625.739167, - 595.050292, - 580.682834, - 583.081208, - 571.579958, - 576.525833, - 571.054083 + 576.591417, + 572.655834, + 569.313958, + 568.1435, + 575.178708, + 570.246375, + 573.849167, + 573.43825, + 567.414125, + 569.610125, + 574.128208, + 568.492083, + 571.805709, + 574.22625, + 569.445125, + 568.898834, + 570.351875, + 566.418292, + 567.380125, + 570.735042 ], "sample_count": 20, - "median": 578.7930839999999, - "p95": 625.739167, - "min": 570.27875, - "max": 630.339167, - "stdev": 16.586656871562763 + "median": 570.299125, + "p95": 575.178708, + "min": 566.418292, + "max": 576.591417, + "stdev": 2.8310916513151834 }, "rss_kb": { "samples": [ - 594064.0, - 591600.0, - 594112.0, - 593584.0, - 594016.0, - 594448.0, - 594112.0, - 593152.0, - 593552.0, - 591584.0, - 593264.0, - 593952.0, - 591632.0, - 594288.0, - 592944.0, - 591200.0, - 593936.0, - 594960.0, - 593520.0, - 593392.0 + 593296.0, + 593248.0, + 591840.0, + 594640.0, + 594464.0, + 593632.0, + 593616.0, + 593712.0, + 593648.0, + 594320.0, + 593104.0, + 593744.0, + 593872.0, + 593840.0, + 594048.0, + 593760.0, + 594176.0, + 591552.0, + 593856.0, + 593248.0 ], "sample_count": 20, - "median": 593568.0, - "p95": 594448.0, - "min": 591200.0, - "max": 594960.0, - "stdev": 1038.8951053884123 + "median": 593728.0, + "p95": 594464.0, + "min": 591552.0, + "max": 594640.0, + "stdev": 741.9343367172057 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/bun", + "~/.cache/perry-bench-tools/bun/bun", "run", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input.json", - "/tmp/out_bun.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input.json", + "/private/tmp/out_bun.json" ] } } @@ -5910,207 +6000,207 @@ "perry": { "wall_ms": { "samples": [ - 59.002, - 59.581958, - 58.936125, - 59.229583, - 59.77425, - 60.93, - 58.834875, - 58.971166, - 59.4195, - 60.964833, - 59.122667, - 58.531209, - 60.794083, - 58.67925, - 63.269958, - 63.349292, - 62.816875, - 62.591708, - 63.956542, - 60.846667 + 74.484541, + 72.373792, + 63.763583, + 66.528208, + 63.400125, + 64.811667, + 61.802875, + 63.018875, + 66.304709, + 63.41575, + 64.049834, + 67.898083, + 63.95725, + 63.971458, + 64.484, + 63.880208, + 64.398208, + 63.658416, + 64.195375, + 65.641834 ], "sample_count": 20, - "median": 59.678104000000005, - "p95": 63.349292, - "min": 58.531209, - "max": 63.956542, - "stdev": 1.7481512093715317 + "median": 64.1226045, + "p95": 72.373792, + "min": 61.802875, + "max": 74.484541, + "stdev": 3.0291274415533653 }, "rss_kb": { "samples": [ - 12976.0, - 12976.0, - 12960.0, - 12960.0, - 12960.0, - 12976.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0, - 12976.0, - 12976.0, - 12960.0, - 12960.0, - 12960.0, - 12960.0 + 8688.0, + 8704.0, + 8688.0, + 8704.0, + 8704.0, + 8688.0, + 8704.0, + 8688.0, + 8688.0, + 8704.0, + 8688.0, + 8688.0, + 8688.0, + 8704.0, + 8688.0, + 8688.0, + 8688.0, + 8688.0, + 8688.0, + 8688.0 ], "sample_count": 20, - "median": 12960.0, - "p95": 12976.0, - "min": 12960.0, - "max": 12976.0, - "stdev": 6.928203230275509 + "median": 8688.0, + "p95": 8704.0, + "min": 8688.0, + "max": 8704.0, + "stdev": 7.332121111929344 }, "measured_command": [ - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input_small.json", - "/tmp/out_perry.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/perry/json_pipeline", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_perry.json" ] }, "node": { "wall_ms": { "samples": [ - 110.445875, - 104.884125, - 100.940625, - 103.365792, - 106.667375, - 100.778042, - 102.51825, - 102.9125, - 100.867041, - 103.38225, - 193.011292, - 117.896583, - 111.740666, - 116.791833, - 110.930375, - 107.069666, - 135.800084, - 101.626833, - 127.81125, - 119.3865 + 114.376583, + 109.124917, + 109.219042, + 109.8325, + 111.078125, + 110.178959, + 108.106375, + 114.425166, + 111.40575, + 109.001541, + 109.845916, + 111.87775, + 111.882375, + 111.566417, + 109.949916, + 110.031375, + 111.129375, + 117.884375, + 114.042875, + 109.632333 ], "sample_count": 20, - "median": 106.8685205, - "p95": 135.800084, - "min": 100.778042, - "max": 193.011292, - "stdev": 20.401324060536414 + "median": 110.62854200000001, + "p95": 114.425166, + "min": 108.106375, + "max": 117.884375, + "stdev": 2.314358401902283 }, "rss_kb": { "samples": [ - 65872.0, - 65632.0, - 65632.0, - 65504.0, - 65632.0, - 65568.0, - 65520.0, - 65488.0, - 65472.0, + 65824.0, 65728.0, + 65632.0, + 65776.0, + 65856.0, 65728.0, - 65296.0, - 65312.0, - 65600.0, + 65840.0, + 65808.0, + 65648.0, 65760.0, + 66160.0, + 65792.0, + 65872.0, + 65744.0, + 65776.0, + 65600.0, + 65712.0, 65648.0, - 65520.0, - 65520.0, - 65472.0, - 66064.0 + 65760.0, + 65648.0 ], "sample_count": 20, - "median": 65584.0, + "median": 65760.0, "p95": 65872.0, - "min": 65296.0, - "max": 66064.0, - "stdev": 173.649762453048 + "min": 65600.0, + "max": 66160.0, + "stdev": 118.25667000216097 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/node", + "~/.cache/perry-bench-tools/node-v22.23.1-darwin-arm64/bin/node", "--experimental-strip-types", "--disable-warning=MODULE_TYPELESS_PACKAGE_JSON", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input_small.json", - "/tmp/out_node.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_node.json" ] }, "bun": { "wall_ms": { "samples": [ - 80.517125, - 69.320708, - 68.838459, - 67.22125, - 66.322208, - 66.148458, - 65.898625, - 66.67725, - 66.162375, - 67.424917, - 66.391917, - 67.006042, - 72.998834, - 104.80575, - 72.398417, - 67.330791, - 67.461084, - 69.695542, - 66.2685, - 68.871292 + 76.791542, + 76.54475, + 78.537875, + 75.875625, + 77.474875, + 75.874542, + 77.070417, + 77.074125, + 77.01825, + 76.444833, + 75.430375, + 75.753958, + 75.587, + 75.806875, + 77.589, + 76.401875, + 79.846625, + 75.48775, + 78.423583, + 75.915708 ], "sample_count": 20, - "median": 67.377854, - "p95": 80.517125, - "min": 65.898625, - "max": 104.80575, - "stdev": 8.578291149453086 + "median": 76.49479149999999, + "p95": 78.537875, + "min": 75.430375, + "max": 79.846625, + "stdev": 1.1434464265550117 }, "rss_kb": { "samples": [ - 30704.0, - 30688.0, - 30832.0, - 30832.0, - 30896.0, - 30896.0, - 30896.0, - 30880.0, - 30928.0, - 30912.0, - 30880.0, - 30880.0, - 30880.0, - 30912.0, - 30896.0, - 30896.0, - 30880.0, - 30896.0, - 30896.0, - 30880.0 + 31120.0, + 31120.0, + 30960.0, + 31024.0, + 31072.0, + 31024.0, + 31072.0, + 30976.0, + 31760.0, + 30976.0, + 30960.0, + 30976.0, + 30976.0, + 30976.0, + 30976.0, + 31040.0, + 31984.0, + 31088.0, + 31056.0, + 30976.0 ], "sample_count": 20, - "median": 30888.0, - "p95": 30912.0, - "min": 30688.0, - "max": 30928.0, - "stdev": 61.527229744236 + "median": 31024.0, + "p95": 31760.0, + "min": 30960.0, + "max": 31984.0, + "stdev": 262.9506417562049 }, "measured_command": [ - "/tmp/perry-bench-tools/bin/bun", + "~/.cache/perry-bench-tools/bun/bun", "run", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", - "/private/tmp/perry-performance-baseline-0713/benchmarks/honest_bench/assets/input_small.json", - "/tmp/out_bun.json" + "benchmarks/honest_bench/workloads/1_json_pipeline/node/json_pipeline.ts", + "benchmarks/honest_bench/assets/input_small.json", + "/private/tmp/out_bun.json" ] } } diff --git a/benchmarks/suite/results/RESULTS.md b/benchmarks/suite/results/RESULTS.md index 39df966e4a..8730432798 100644 --- a/benchmarks/suite/results/RESULTS.md +++ b/benchmarks/suite/results/RESULTS.md @@ -1,40 +1,40 @@ # suite/ Node and Bun Results (generated) -Evidence: [`public-node-bun-v1.json`](../../results/public-node-bun-v1.json) · commit `36cf04e0147c68a55f362689ab6c56e2b39a3c67` -Perry: `perry 0.5.1258` · Node: `v22.23.1` · Bun: `1.3.14` +Evidence: [`public-node-bun-v1.json`](../../results/public-node-bun-v1.json) · commit `defa4d6012fb480fca237ea10509da74bd41624d` +Perry: `perry 0.5.1279` · Node: `v22.23.1` · Bun: `1.3.14` Policy: 5 measured samples per runtime and benchmark; incomplete or incorrect rows are rejected. | Benchmark | Perry median | Node median | Bun median | Result | |---|---:|---:|---:|---| -| 02_loop_overhead | 97 ms | 66 ms | 41 ms | loss vs both | -| 03_array_write | 5 ms | 8 ms | 6 ms | win vs both | -| 04_array_read | 97 ms | 12 ms | 17 ms | loss vs both | -| 05_fibonacci | 310 ms | 948 ms | 523 ms | win vs both | -| 06_math_intensive | 51 ms | 51 ms | 51 ms | tie | -| 07_object_create | 4 ms | 5 ms | 6 ms | win vs both | -| 08_string_concat | 3 ms | 5 ms | 1 ms | mixed | -| 09_method_calls | 82 ms | 11 ms | 8 ms | loss vs both | -| 10_nested_loops | 164 ms | 19 ms | 20 ms | loss vs both | -| 11_prime_sieve | 254 ms | 7 ms | 5 ms | loss vs both | -| 12_binary_trees | 6 ms | 7 ms | 8 ms | win vs both | -| 13_factorial | 1555 ms | 99 ms | 99 ms | loss vs both | -| 14_closure | 49 ms | 51 ms | 51 ms | win vs both | -| 15_mandelbrot | 23 ms | 26 ms | 30 ms | win vs both | -| 16_matrix_multiply | 2311 ms | 35 ms | 35 ms | loss vs both | -| bench_gc_pressure | 20 ms | 18 ms | 29 ms | mixed | -| bench_json_roundtrip | 447 ms | 421 ms | 238 ms | loss vs both | -| bench_object_property | 275 ms | 16 ms | 11 ms | loss vs both | -| bench_int_arithmetic | 577 ms | 101 ms | 41 ms | loss vs both | -| bench_buffer_readwrite | 96 ms | 100 ms | 105 ms | win vs both | -| bench_array_grow | 150 ms | 21 ms | 11 ms | loss vs both | -| bench_string_heavy | 74 ms | 52 ms | 31 ms | loss vs both | -| bench_numeric_array_numeric | 154 ms | 6 ms | 6 ms | loss vs both | -| bench_numeric_array_downgrade | 11028 ms | 7 ms | 6 ms | loss vs both | +| 02_loop_overhead | 99 ms | 65 ms | 39 ms | loss vs both | +| 03_array_write | 1 ms | 7 ms | 5 ms | win vs both | +| 04_array_read | 24 ms | 10 ms | 13 ms | loss vs both | +| 05_fibonacci | 387 ms | 908 ms | 504 ms | win vs both | +| 06_math_intensive | 49 ms | 49 ms | 49 ms | tie | +| 07_object_create | 3 ms | 5 ms | 5 ms | win vs both | +| 08_string_concat | 1 ms | 4 ms | 1 ms | mixed | +| 09_method_calls | 79 ms | 10 ms | 8 ms | loss vs both | +| 10_nested_loops | 42 ms | 17 ms | 18 ms | loss vs both | +| 11_prime_sieve | 107 ms | 6 ms | 5 ms | loss vs both | +| 12_binary_trees | 4 ms | 6 ms | 6 ms | win vs both | +| 13_factorial | 94 ms | 95 ms | 95 ms | win vs both | +| 14_closure | 46 ms | 49 ms | 49 ms | win vs both | +| 15_mandelbrot | 22 ms | 24 ms | 28 ms | win vs both | +| 16_matrix_multiply | 637 ms | 33 ms | 33 ms | loss vs both | +| bench_gc_pressure | 28 ms | 15 ms | 19 ms | loss vs both | +| bench_json_roundtrip | 212 ms | 390 ms | 219 ms | win vs both | +| bench_object_property | 126 ms | 16 ms | 9 ms | loss vs both | +| bench_int_arithmetic | 357 ms | 94 ms | 39 ms | loss vs both | +| bench_buffer_readwrite | 97 ms | 98 ms | 194 ms | win vs both | +| bench_array_grow | 21 ms | 14 ms | 9 ms | loss vs both | +| bench_string_heavy | 56 ms | 41 ms | 29 ms | loss vs both | +| bench_numeric_array_numeric | 69 ms | 5 ms | 4 ms | loss vs both | +| bench_numeric_array_downgrade | 19 ms | 6 ms | 5 ms | loss vs both | ## Summary -- Wins versus both peers: **7** -- Losses versus both peers: **14** -- Mixed or tied rows: **3** +- Wins versus both peers: **9** +- Losses versus both peers: **13** +- Mixed or tied rows: **2** > Historical note: the former v0.5.908 single-run commentary is archived in Git history and is not current evidence. diff --git a/changelog.d/7283-regenerate-public-baseline.md b/changelog.d/7283-regenerate-public-baseline.md new file mode 100644 index 0000000000..c0529a50ac --- /dev/null +++ b/changelog.d/7283-regenerate-public-baseline.md @@ -0,0 +1,15 @@ +Regenerates `benchmarks/results/public-node-bun-v1.json`, which had been stale for +40+ commits. The freshness gate is `lint`'s step 9, so while it failed, **steps +10-13 never executed in CI at all** — file-size, GC store-site inventory, +addr-class audit, and #7253's gate-wiring check had to be reproduced locally to +even be seen, and every merge required an `--admin` bypass. + +**The measurement host changed** (see the PR for why): Apple M1 Pro / 16 GB → +Apple M1 Max / 64 GB. Node, Bun and Zig are held at their original pins, so the +discontinuity is one variable rather than three. Numbers before and after +2026-08-03 are not directly comparable. + +Also fixes `EXPECTED_WORKLOADS["app_patterns"]`, which never gained the `batch` +kernel added by #7037. That omission meant #7037 both invalidated the artifact +(kernels are in `SOURCE_PATHS`) and made regenerating it impossible — assembly +aborted with `extra=['batch']` after all five measurement legs had already run.