Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Wick benchmark #254

Merged
merged 2 commits into from
Feb 7, 2025
Merged

Implement Wick benchmark #254

merged 2 commits into from
Feb 7, 2025

Conversation

Krzmbrzl
Copy link
Collaborator

@Krzmbrzl Krzmbrzl commented Feb 7, 2025

No description provided.

@Krzmbrzl
Copy link
Collaborator Author

Krzmbrzl commented Feb 7, 2025

Using this benchmark on my machine to test the difference between using TNv1 or TNv2 in the Wick implementation implementation yields

TNv1 
2025-02-07T16:57:33+01:00
Running ./benchmarks/sequant_benchmarks
Run on (8 X 3,900 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x4)
  L1 Instruction 32 KiB (x4)
  L2 Unified 256 KiB (x4)
  L3 Unified 8,192 KiB (x1)
Load Average: 0.81, 1.06, 1.15
***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead.
-----------------------------------------------------------------------------------------------------------------------------
Benchmark                                                                   Time             CPU   Iterations UserCounters...
-----------------------------------------------------------------------------------------------------------------------------
wick<Statistics::BoseEinstein>/all_with_topology/1_cv                    0.70 %          0.69 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/1_mean                 0.075 ms        0.075 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_with_topology/1_median               0.075 ms        0.075 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_with_topology/1_stddev               0.001 ms        0.001 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/2_cv                    4.02 %          4.01 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/2_mean                 0.176 ms        0.176 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::BoseEinstein>/all_with_topology/2_median               0.177 ms        0.177 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::BoseEinstein>/all_with_topology/2_stddev               0.007 ms        0.007 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/3_cv                    4.14 %          4.12 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/3_mean                 0.221 ms        0.221 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::BoseEinstein>/all_with_topology/3_median               0.221 ms        0.221 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::BoseEinstein>/all_with_topology/3_stddev               0.009 ms        0.009 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/4_cv                    2.47 %          2.50 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/4_mean                  3.21 ms         3.21 ms            5 attempted=304 percentage=158 produced=481
wick<Statistics::BoseEinstein>/all_with_topology/4_median                3.23 ms         3.23 ms            5 attempted=304 percentage=158 produced=481
wick<Statistics::BoseEinstein>/all_with_topology/4_stddev               0.079 ms        0.080 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/5_cv                    6.57 %          6.57 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/5_mean                  26.6 ms         26.6 ms            5 attempted=3.395k percentage=152 produced=5.164k
wick<Statistics::BoseEinstein>/all_with_topology/5_median                27.1 ms         27.1 ms            5 attempted=3.395k percentage=152 produced=5.164k
wick<Statistics::BoseEinstein>/all_with_topology/5_stddev                1.75 ms         1.75 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/1_cv                 1.04 %          1.06 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/1_mean              0.059 ms        0.059 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_without_topology/1_median            0.059 ms        0.059 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_without_topology/1_stddev            0.001 ms        0.001 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/2_cv                 5.59 %          5.56 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/2_mean              0.351 ms        0.351 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_without_topology/2_median            0.352 ms        0.352 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_without_topology/2_stddev            0.020 ms        0.019 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/3_cv                 1.93 %          1.93 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/3_mean               1.09 ms         1.09 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_without_topology/3_median             1.08 ms         1.08 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_without_topology/3_stddev            0.021 ms        0.021 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/4_cv                 5.86 %          5.86 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/4_mean                986 ms          986 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_without_topology/4_median              988 ms          987 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_without_topology/4_stddev             57.8 ms         57.7 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/5_cv                 6.16 %          6.14 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/5_mean               1983 ms         1982 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_without_topology/5_median             2027 ms         2026 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_without_topology/5_stddev              122 ms          122 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/1_cv              0.57 %          0.57 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/1_mean           0.069 ms        0.069 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_with_topology/1_median         0.069 ms        0.069 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_with_topology/1_stddev         0.000 ms        0.000 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/2_cv              3.30 %          3.30 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/2_mean           0.140 ms        0.140 ms            5 attempted=4 percentage=100 produced=4
wick<Statistics::BoseEinstein>/full_only_with_topology/2_median         0.136 ms        0.136 ms            5 attempted=4 percentage=100 produced=4
wick<Statistics::BoseEinstein>/full_only_with_topology/2_stddev         0.005 ms        0.005 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_cv              3.15 %          3.16 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/3_mean           0.113 ms        0.113 ms            5 attempted=2 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_median         0.113 ms        0.112 ms            5 attempted=2 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_stddev         0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/4_cv              1.64 %          1.66 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/4_mean           0.557 ms        0.557 ms            5 attempted=41 percentage=56 produced=23
wick<Statistics::BoseEinstein>/full_only_with_topology/4_median         0.557 ms        0.557 ms            5 attempted=41 percentage=56 produced=23
wick<Statistics::BoseEinstein>/full_only_with_topology/4_stddev         0.009 ms        0.009 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/5_cv              4.49 %          4.45 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/5_mean            2.52 ms         2.52 ms            5 attempted=321 percentage=71 produced=230
wick<Statistics::BoseEinstein>/full_only_with_topology/5_median          2.51 ms         2.51 ms            5 attempted=321 percentage=71 produced=230
wick<Statistics::BoseEinstein>/full_only_with_topology/5_stddev         0.113 ms        0.112 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/1_cv           3.09 %          3.09 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/1_mean        0.052 ms        0.052 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_without_topology/1_median      0.052 ms        0.052 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_without_topology/1_stddev      0.002 ms        0.002 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/2_cv           1.51 %          1.54 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/2_mean        0.138 ms        0.138 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_without_topology/2_median      0.137 ms        0.137 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_without_topology/2_stddev      0.002 ms        0.002 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_cv           3.64 %          3.63 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/3_mean        0.077 ms        0.076 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_median      0.077 ms        0.077 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_stddev      0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/4_cv           3.13 %          3.13 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/4_mean         69.3 ms         69.3 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_without_topology/4_median       69.1 ms         69.1 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_without_topology/4_stddev       2.17 ms         2.17 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/5_cv           5.53 %          5.52 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/5_mean          143 ms          143 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_without_topology/5_median        147 ms          147 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_without_topology/5_stddev       7.93 ms         7.91 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/1_cv                      1.54 %          1.56 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/1_mean                   0.076 ms        0.076 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_with_topology/1_median                 0.076 ms        0.076 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_with_topology/1_stddev                 0.001 ms        0.001 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/2_cv                      2.75 %          2.72 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/2_mean                   0.175 ms        0.175 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::FermiDirac>/all_with_topology/2_median                 0.176 ms        0.176 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::FermiDirac>/all_with_topology/2_stddev                 0.005 ms        0.005 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/3_cv                      2.66 %          2.64 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/3_mean                   0.219 ms        0.219 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::FermiDirac>/all_with_topology/3_median                 0.221 ms        0.221 ms            5 attempted=8 percentage=162 produced=13
wick<Statistics::FermiDirac>/all_with_topology/3_stddev                 0.006 ms        0.006 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/4_cv                      6.97 %          6.94 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/4_mean                    3.02 ms         3.02 ms            5 attempted=304 percentage=158 produced=481
wick<Statistics::FermiDirac>/all_with_topology/4_median                  3.16 ms         3.16 ms            5 attempted=304 percentage=158 produced=481
wick<Statistics::FermiDirac>/all_with_topology/4_stddev                 0.210 ms        0.210 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/5_cv                      1.91 %          1.92 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/5_mean                    27.5 ms         27.5 ms            5 attempted=3.395k percentage=152 produced=5.164k
wick<Statistics::FermiDirac>/all_with_topology/5_median                  27.6 ms         27.6 ms            5 attempted=3.395k percentage=152 produced=5.164k
wick<Statistics::FermiDirac>/all_with_topology/5_stddev                 0.527 ms        0.529 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/1_cv                   4.43 %          4.41 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/1_mean                0.056 ms        0.056 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_without_topology/1_median              0.058 ms        0.058 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_without_topology/1_stddev              0.002 ms        0.002 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/2_cv                   0.87 %          0.87 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/2_mean                0.351 ms        0.351 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_without_topology/2_median              0.351 ms        0.351 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_without_topology/2_stddev              0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/3_cv                   3.49 %          3.49 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/3_mean                 1.07 ms         1.07 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_without_topology/3_median               1.07 ms         1.07 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_without_topology/3_stddev              0.037 ms        0.037 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/4_cv                   8.27 %          8.26 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/4_mean                  933 ms          933 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_without_topology/4_median                908 ms          908 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_without_topology/4_stddev               77.2 ms         77.1 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/5_cv                   3.54 %          3.49 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/5_mean                 2029 ms         2028 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_without_topology/5_median               2032 ms         2031 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_without_topology/5_stddev               71.8 ms         70.8 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/1_cv                4.14 %          4.10 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/1_mean             0.069 ms        0.069 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_with_topology/1_median           0.069 ms        0.069 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_with_topology/1_stddev           0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/2_cv                0.83 %          0.84 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/2_mean             0.136 ms        0.136 ms            5 attempted=4 percentage=100 produced=4
wick<Statistics::FermiDirac>/full_only_with_topology/2_median           0.137 ms        0.137 ms            5 attempted=4 percentage=100 produced=4
wick<Statistics::FermiDirac>/full_only_with_topology/2_stddev           0.001 ms        0.001 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_cv                2.43 %          2.43 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/3_mean             0.114 ms        0.114 ms            5 attempted=2 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_median           0.113 ms        0.113 ms            5 attempted=2 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_stddev           0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/4_cv                0.89 %          0.90 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/4_mean             0.551 ms        0.551 ms            5 attempted=41 percentage=56 produced=23
wick<Statistics::FermiDirac>/full_only_with_topology/4_median           0.552 ms        0.552 ms            5 attempted=41 percentage=56 produced=23
wick<Statistics::FermiDirac>/full_only_with_topology/4_stddev           0.005 ms        0.005 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/5_cv                7.66 %          7.67 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/5_mean              2.63 ms         2.63 ms            5 attempted=321 percentage=71 produced=230
wick<Statistics::FermiDirac>/full_only_with_topology/5_median            2.54 ms         2.53 ms            5 attempted=321 percentage=71 produced=230
wick<Statistics::FermiDirac>/full_only_with_topology/5_stddev           0.201 ms        0.202 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/1_cv             2.03 %          2.05 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/1_mean          0.053 ms        0.053 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_without_topology/1_median        0.052 ms        0.052 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_without_topology/1_stddev        0.001 ms        0.001 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/2_cv             1.55 %          1.58 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/2_mean          0.140 ms        0.140 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_without_topology/2_median        0.141 ms        0.141 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_without_topology/2_stddev        0.002 ms        0.002 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_cv             3.76 %          3.75 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/3_mean          0.076 ms        0.076 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_median        0.077 ms        0.077 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_stddev        0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/4_cv             3.79 %          3.79 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/4_mean           70.9 ms         70.9 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_without_topology/4_median         72.7 ms         72.6 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_without_topology/4_stddev         2.69 ms         2.69 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/5_cv             4.80 %          4.79 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/5_mean            140 ms          140 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_without_topology/5_median          140 ms          140 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_without_topology/5_stddev         6.72 ms         6.70 ms            5 attempted=0 percentage=0 produced=0
TNv2 
2025-02-07T17:55:55+01:00
Running ./benchmarks/sequant_benchmarks
Run on (8 X 3,900 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x4)
  L1 Instruction 32 KiB (x4)
  L2 Unified 256 KiB (x4)
  L3 Unified 8,192 KiB (x1)
Load Average: 0.33, 0.47, 0.95
***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead.
-----------------------------------------------------------------------------------------------------------------------------
Benchmark                                                                   Time             CPU   Iterations UserCounters...
-----------------------------------------------------------------------------------------------------------------------------
wick<Statistics::BoseEinstein>/all_with_topology/1_cv                    7.36 %          7.36 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/1_mean                 0.076 ms        0.076 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_with_topology/1_median               0.078 ms        0.078 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_with_topology/1_stddev               0.006 ms        0.006 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/2_cv                    5.49 %          5.45 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/2_mean                 0.386 ms        0.386 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_with_topology/2_median               0.388 ms        0.388 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_with_topology/2_stddev               0.021 ms        0.021 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/3_cv                    5.29 %          5.29 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/3_mean                  1.10 ms         1.10 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_with_topology/3_median                1.08 ms         1.08 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_with_topology/3_stddev               0.058 ms        0.058 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/4_cv                    6.62 %          6.57 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/4_mean                  1021 ms         1021 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_with_topology/4_median                1062 ms         1061 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_with_topology/4_stddev                67.6 ms         67.1 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_with_topology/5_cv                    2.48 %          2.48 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_with_topology/5_mean                  1923 ms         1923 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_with_topology/5_median                1907 ms         1907 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_with_topology/5_stddev                47.7 ms         47.7 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/1_cv                 6.72 %          6.69 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/1_mean              0.057 ms        0.057 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_without_topology/1_median            0.060 ms        0.060 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::BoseEinstein>/all_without_topology/1_stddev            0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/2_cv                 4.86 %          4.86 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/2_mean              0.340 ms        0.340 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_without_topology/2_median            0.342 ms        0.342 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::BoseEinstein>/all_without_topology/2_stddev            0.017 ms        0.017 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/3_cv                 2.42 %          2.42 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/3_mean               1.01 ms         1.01 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_without_topology/3_median             1.01 ms         1.01 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::BoseEinstein>/all_without_topology/3_stddev            0.025 ms        0.025 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/4_cv                 1.79 %          1.84 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/4_mean               1024 ms         1024 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_without_topology/4_median             1036 ms         1036 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::BoseEinstein>/all_without_topology/4_stddev             18.3 ms         18.9 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/all_without_topology/5_cv                 1.95 %          1.93 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/all_without_topology/5_mean               1971 ms         1970 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_without_topology/5_median             1980 ms         1980 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::BoseEinstein>/all_without_topology/5_stddev             38.5 ms         38.1 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/1_cv              4.77 %          4.73 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/1_mean           0.066 ms        0.066 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_with_topology/1_median         0.064 ms        0.064 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_with_topology/1_stddev         0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/2_cv              3.93 %          3.91 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/2_mean           0.178 ms        0.178 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_with_topology/2_median         0.180 ms        0.180 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_with_topology/2_stddev         0.007 ms        0.007 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_cv              5.35 %          5.33 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/3_mean           0.122 ms        0.122 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_median         0.126 ms        0.126 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/3_stddev         0.007 ms        0.007 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/4_cv              7.69 %          7.67 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/4_mean            69.9 ms         69.9 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_with_topology/4_median          71.8 ms         71.8 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_with_topology/4_stddev          5.37 ms         5.36 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_with_topology/5_cv              4.56 %          4.51 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_with_topology/5_mean             147 ms          147 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_with_topology/5_median           151 ms          151 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_with_topology/5_stddev          6.71 ms         6.63 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/1_cv           5.56 %          5.56 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/1_mean        0.053 ms        0.053 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_without_topology/1_median      0.054 ms        0.054 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::BoseEinstein>/full_only_without_topology/1_stddev      0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/2_cv           4.99 %          4.94 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/2_mean        0.135 ms        0.135 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_without_topology/2_median      0.139 ms        0.139 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::BoseEinstein>/full_only_without_topology/2_stddev      0.007 ms        0.007 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_cv           4.74 %          4.69 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/3_mean        0.076 ms        0.076 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_median      0.078 ms        0.078 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/3_stddev      0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/4_cv           2.85 %          2.82 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/4_mean         68.5 ms         68.5 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_without_topology/4_median       69.8 ms         69.8 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::BoseEinstein>/full_only_without_topology/4_stddev       1.95 ms         1.93 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::BoseEinstein>/full_only_without_topology/5_cv           1.03 %          1.03 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::BoseEinstein>/full_only_without_topology/5_mean          132 ms          132 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_without_topology/5_median        132 ms          132 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::BoseEinstein>/full_only_without_topology/5_stddev       1.36 ms         1.36 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/1_cv                      5.23 %          5.17 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/1_mean                   0.077 ms        0.077 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_with_topology/1_median                 0.076 ms        0.076 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_with_topology/1_stddev                 0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/2_cv                      4.39 %          4.39 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/2_mean                   0.389 ms        0.389 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_with_topology/2_median                 0.384 ms        0.384 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_with_topology/2_stddev                 0.017 ms        0.017 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/3_cv                      3.99 %          3.99 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/3_mean                    1.13 ms         1.13 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_with_topology/3_median                  1.13 ms         1.13 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_with_topology/3_stddev                 0.045 ms        0.045 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/4_cv                      9.13 %          9.12 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/4_mean                    1000 ms         1000 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_with_topology/4_median                   973 ms          973 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_with_topology/4_stddev                  91.4 ms         91.2 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_with_topology/5_cv                      5.06 %          5.06 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_with_topology/5_mean                    2156 ms         2156 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_with_topology/5_median                  2190 ms         2190 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_with_topology/5_stddev                   109 ms          109 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/1_cv                   4.84 %          4.84 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/1_mean                0.057 ms        0.057 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_without_topology/1_median              0.056 ms        0.056 ms            5 attempted=3 percentage=133 produced=4
wick<Statistics::FermiDirac>/all_without_topology/1_stddev              0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/2_cv                   5.95 %          5.95 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/2_mean                0.355 ms        0.355 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_without_topology/2_median              0.350 ms        0.350 ms            5 attempted=48 percentage=141 produced=68
wick<Statistics::FermiDirac>/all_without_topology/2_stddev              0.021 ms        0.021 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/3_cv                   6.55 %          6.54 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/3_mean                 1.09 ms         1.09 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_without_topology/3_median               1.13 ms         1.13 ms            5 attempted=168 percentage=138 produced=232
wick<Statistics::FermiDirac>/all_without_topology/3_stddev              0.071 ms        0.071 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/4_cv                   4.60 %          4.60 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/4_mean                  975 ms          975 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_without_topology/4_median                954 ms          954 ms            5 attempted=150.675k percentage=138 produced=208.176k
wick<Statistics::FermiDirac>/all_without_topology/4_stddev               44.8 ms         44.8 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/all_without_topology/5_cv                   3.14 %          3.13 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/all_without_topology/5_mean                 2035 ms         2035 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_without_topology/5_median               2073 ms         2070 ms            5 attempted=306.304k percentage=140 produced=431.1k
wick<Statistics::FermiDirac>/all_without_topology/5_stddev               64.0 ms         63.6 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/1_cv                5.04 %          5.03 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/1_mean             0.073 ms        0.073 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_with_topology/1_median           0.074 ms        0.074 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_with_topology/1_stddev           0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/2_cv                6.15 %          6.13 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/2_mean             0.179 ms        0.179 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_with_topology/2_median           0.174 ms        0.174 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_with_topology/2_stddev           0.011 ms        0.011 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_cv                4.77 %          4.74 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/3_mean             0.123 ms        0.123 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_median           0.123 ms        0.123 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/3_stddev           0.006 ms        0.006 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/4_cv                5.59 %          5.58 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/4_mean              74.1 ms         74.1 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_with_topology/4_median            76.0 ms         76.0 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_with_topology/4_stddev            4.14 ms         4.14 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_with_topology/5_cv                5.80 %          5.79 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_with_topology/5_mean               150 ms          149 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_with_topology/5_median             144 ms          144 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_with_topology/5_stddev            8.67 ms         8.65 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/1_cv             5.25 %          5.24 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/1_mean          0.053 ms        0.053 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_without_topology/1_median        0.053 ms        0.053 ms            5 attempted=2 percentage=100 produced=2
wick<Statistics::FermiDirac>/full_only_without_topology/1_stddev        0.003 ms        0.003 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/2_cv             3.18 %          3.18 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/2_mean          0.133 ms        0.133 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_without_topology/2_median        0.131 ms        0.131 ms            5 attempted=12 percentage=100 produced=12
wick<Statistics::FermiDirac>/full_only_without_topology/2_stddev        0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_cv             5.39 %          5.38 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/3_mean          0.075 ms        0.075 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_median        0.072 ms        0.072 ms            5 attempted=4 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/3_stddev        0.004 ms        0.004 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/4_cv             4.57 %          4.57 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/4_mean           73.2 ms         73.2 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_without_topology/4_median         74.0 ms         74.0 ms            5 attempted=11.449k percentage=53 produced=6.157k
wick<Statistics::FermiDirac>/full_only_without_topology/4_stddev         3.35 ms         3.35 ms            5 attempted=0 percentage=0 produced=0
wick<Statistics::FermiDirac>/full_only_without_topology/5_cv             6.21 %          6.17 %             5 attempted=0.00% percentage=0.00% produced=0.00%
wick<Statistics::FermiDirac>/full_only_without_topology/5_mean            148 ms          148 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_without_topology/5_median          150 ms          150 ms            5 attempted=23.116k percentage=71 produced=16.62k
wick<Statistics::FermiDirac>/full_only_without_topology/5_stddev         9.21 ms         9.15 ms            5 attempted=0 percentage=0 produced=0

The interesting part is that on the right I have included information about how many contractions have been produced and besides the statistics seemingly being broken for the case of generating all contractions, TNv1 and TNv2 produce (drastically) different amounts. This proves that they are not yet functionally identical.
Besides, I encountered a non-reproducible segmentation fault while using TNv2.

@Krzmbrzl Krzmbrzl merged commit c70044d into ValeevGroup:master Feb 7, 2025
6 checks passed
@evaleev
Copy link
Member

evaleev commented Feb 7, 2025

@Krzmbrzl thanks, would be good to move benchmark -> tests/bench to keep the top of the tree as narrow as possible ... this will be super useful!

@Krzmbrzl
Copy link
Collaborator Author

Krzmbrzl commented Feb 7, 2025

I agree with trying to keep the root uncluttered, but imo benchmarks are very much not tests of any kind. That's why I chose to create a new subdirectory instead.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Krzmbrzl @evaleev