github-repos/benchmark
1
0
Fork 0
mirror of https://github.com/google/benchmark.git synced 2024-12-28 05:20:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
4f8070590c
benchmark/docs
History
Roman Lebedev 45b194e4d4
Introduce Coefficient of variation aggregate (#1220) 
* Introduce Coefficient of variation aggregate

I believe, it is much more useful / use to understand,
because it is already normalized by the mean,
so it is not affected by the duration of the benchmark,
unlike the standard deviation.

Example of real-world output:
```
raw.pixls.us-unique/GoPro/HERO6 Black$ ~/rawspeed/build-old/src/utilities/rsbench/rsbench GOPR9172.GPR --benchmark_repetitions=27 --benchmark_display_aggregates_only=true --benchmark_counters_tabular=true
2021-09-03T18:05:56+03:00
Running /home/lebedevri/rawspeed/build-old/src/utilities/rsbench/rsbench
Run on (32 X 3596.16 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x16)
  L1 Instruction 32 KiB (x16)
  L2 Unified 512 KiB (x16)
  L3 Unified 32768 KiB (x2)
Load Average: 7.00, 2.99, 1.85
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Benchmark                                                      Time             CPU   Iterations  CPUTime,s CPUTime/WallTime     Pixels Pixels/CPUTime Pixels/WallTime Raws/CPUTime Raws/WallTime WallTime,s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
GOPR9172.GPR/threads:32/process_time/real_time_mean         11.1 ms          353 ms           27   0.353122          31.9473        12M       33.9879M        1085.84M      2.83232       90.4864  0.0110535
GOPR9172.GPR/threads:32/process_time/real_time_median       11.0 ms          352 ms           27   0.351696          31.9599        12M       34.1203M        1090.11M      2.84336       90.8425  0.0110081
GOPR9172.GPR/threads:32/process_time/real_time_stddev      0.159 ms         4.60 ms           27   4.59539m        0.0462064          0       426.371k        14.9631M    0.0355309       1.24692   158.944u
GOPR9172.GPR/threads:32/process_time/real_time_cv           1.44 %          1.30 %            27  0.0130136         1.44633m          0      0.0125448       0.0137802    0.0125448     0.0137802  0.0143795
```

Fixes https://github.com/google/benchmark/issues/1146

* Be consistent, it's CV, not 'rel std dev'
2021-09-03 18:44:10 +01:00
..
_config.yml Set theme jekyll-theme-minimal 2021-08-18 10:07:38 +01:00
AssemblyTests.md Add tests to verify assembler output -- Fix DoNotOptimize. (#530) 2018-03-23 16:10:47 -06:00
dependencies.md refactor the documentation to minimise README.md (#1211) 2021-08-17 21:45:33 +01:00
index.md refactor the documentation to minimise README.md (#1211) 2021-08-17 21:45:33 +01:00
perf_counters.md [PFM] Extend perf counter support to multi-threaded cases. (#1153) 2021-05-19 09:49:05 +01:00
platform_specific_build_instructions.md refactor the documentation to minimise README.md (#1211) 2021-08-17 21:45:33 +01:00
random_interleaving.md Random interleaving of benchmark repetitions - the sequel (fixes #1051) (#1163) 2021-06-03 21:16:54 +03:00
releasing.md Un-disable github actions :] 2021-06-01 13:04:32 +03:00
tools.md Add requirements.txt for python dependencies (#994) 2020-06-29 13:22:03 +01:00
user_guide.md Introduce Coefficient of variation aggregate (#1220) 2021-09-03 18:44:10 +01:00