Skip to main content

Benchmarks

This section summarizes the benchmark evidence used by the zsasa manuscript. The current headline results come from the pinned zsasa v0.6.0 benchmark harness in zsasa-benchmarks, with figures copied from the paper and benchmark repositories.

The older exploratory benchmark pages have been replaced with the current benchmark suite layout. The only pre-pinned result retained here is the SwissProt-scale batch benchmark, labeled as legacy context on the Batch page.

Benchmark suites

SuitePurposePrimary datasetMain readouts
ValidationAgreement with established SASA implementationsE. coli AFDB and 5wvo_C trajectoryR², relative error
Batch throughputProteome-scale directory processingE. coli and Human AFDBRuntime, structures/s, RSS, scaling
Single-file stress testsLarge structures and parser-heavy cases8 curated structures up to 4.5M atomsRuntime, RSS, parse/SASA timing
MD trajectoriesStreaming frame-wise trajectory SASA5wvo_C, 6sup_A, 5vz0_AFrames/s, RSS, comparator speedup

Test environment

The pinned current pinned benchmarks were run on one consumer laptop:

ItemValue
MachineMacBook Pro (Mac16,1)
ChipApple M4
Cores10 total: 4 performance + 6 efficiency
Memory32 GB
OSmacOS 26.2
Timinghyperfine 1.20.0, with warmups and measured runs per suite
Tool pinningNix for native tools, uv for Python dependencies
zsasa versionv0.6.0

Interpreting the numbers

  • Speedups are comparator runtime divided by zsasa runtime; higher is better.
  • RSS is peak resident set size; lower memory means a higher RSS-reduction ratio.
  • Exact f64/f32 modes target numerical continuity with matched Shrake--Rupley outputs.
  • Bitmask mode is a throughput-oriented approximation with an explicit validation envelope.
  • Batch FreeSASA timings use a freesasa_batch wrapper because upstream FreeSASA has no native directory mode.

Evidence sources