Changes

Page history
Adjusted paths in Wiki page. Renamed CLOCK group to INSTRUCTIONS authored by Thomas.Roehl's avatar Thomas.Roehl
Show whitespace changes
Inline Side-by-side
AccuracyHaswell.md
View page @ 76bbc76b
...@@ -14,7 +14,7 @@ Not all performance groups can be tested for accuracy. We don't have a test appl ...@@ -14,7 +14,7 @@ Not all performance groups can be tested for accuracy. We don't have a test appl
| Group | Tests | | Group | Tests |
|-------|-------| |-------|-------|
| BRANCH | load, triad, copy, store, stream | | BRANCH | load, triad, copy, store, stream |
| INSTRUCTIONS | daxpy, ddot | | INSTRUCTIONS | load, daxpy, stream, ddot, triad, copy, store |
| DATA | triad, copy, stream, store | | DATA | triad, copy, stream, store |
| FLOPS_AVX | triad_avx, stream_avx, daxpy_avx, ddot_avx | | FLOPS_AVX | triad_avx, stream_avx, daxpy_avx, ddot_avx |
| L2 | load, triad, copy, stream, store | | L2 | load, triad, copy, stream, store |
...@@ -129,44 +129,144 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres ...@@ -129,44 +129,144 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres
### Verification of Group INSTRUCTIONS ### Verification of Group INSTRUCTIONS
#### Verification of Group INSTRUCTIONS with Test load
Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_INSTRUCTIONS_load](./images/accuracy/haswell/INSTRUCTIONS_load.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 218725kB | 2669128434.00 | 2669134000.00 | 0.00% | 2593941718.00 | 2593948000.00 | 0.00% | 2639053747.60 | 2639059600.00 | 0.00% |
| 426801kB | 2640830956.00 | 2640836000.00 | 0.00% | 2640830956.00 | 2640836000.00 | 0.00% | 2655502239.00 | 2655507200.00 | 0.00% |
| 634877kB | 2618867608.00 | 2618872000.00 | 0.00% | 2400628642.00 | 2400633000.00 | 0.00% | 2531572021.60 | 2531576400.00 | 0.00% |
| 842953kB | 2607885736.00 | 2607890000.00 | 0.00% | 2173238116.00 | 2173243000.00 | 0.00% | 2520956212.00 | 2520960600.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test daxpy #### Verification of Group INSTRUCTIONS with Test daxpy
Benchmark performed with data sizes: 1263kB, 2485kB, 3707kB, 4929kB. Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 1263kB and so on. Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_INSTRUCTIONS_daxpy](./images/accuracy/haswell/INSTRUCTIONS_daxpy.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 218725kB | 3701236991.00 | 3701243000.00 | 0.00% | 3571369027.00 | 3571375000.00 | 0.00% | 3649289805.40 | 3649295800.00 | 0.00% |
| 426801kB | 3547782997.00 | 3547788000.00 | 0.00% | 3294369927.00 | 3294375000.00 | 0.00% | 3522441690.00 | 3522446800.00 | 0.00% |
| 634877kB | 3581103050.00 | 3581108000.00 | 0.00% | 3581103050.00 | 3581108000.00 | 0.00% | 3581103050.00 | 3581108000.00 | 0.00% |
| 842953kB | 3503523257.00 | 3503528000.00 | 0.00% | 3503523257.00 | 3503528000.00 | 0.00% | 3503523257.00 | 3503528000.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test stream
Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_CLOCK_daxpy](./images/accuracy/haswell/CLOCK_daxpy.jpg) ![haswell_INSTRUCTIONS_stream](./images/accuracy/haswell/INSTRUCTIONS_stream.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) | | Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 1263kB | 8565266441.00 | 8565887000.00 | 0.01% | 8618133827.00 | 8618759000.00 | 0.01% | 8654653567.40 | 8655281000.00 | 0.01% | | 218725kB | 2770516177.00 | 2770522000.00 | 0.00% | 2770516177.00 | 2770522000.00 | 0.00% | 2770516177.00 | 2770522000.00 | 0.00% |
| 2485kB | 8663186893.00 | 8663508000.00 | 0.00% | 8591626889.00 | 8591946000.00 | 0.00% | 8677351347.40 | 8677673200.00 | 0.00% | | 426801kB | 2703072561.00 | 2703078000.00 | 0.00% | 2703072561.00 | 2703078000.00 | 0.00% | 2703072561.00 | 2703078000.00 | 0.00% |
| 3707kB | 8525565770.00 | 8525779000.00 | 0.00% | 8602600700.00 | 8602816000.00 | 0.00% | 8651022656.00 | 8651239200.00 | 0.00% | | 634877kB | 2638707515.00 | 2638712000.00 | 0.00% | 2513054777.00 | 2513060000.00 | 0.00% | 2588446419.80 | 2588451200.00 | 0.00% |
| 4929kB | 8213418722.00 | 8213574000.00 | 0.00% | 8566070407.00 | 8566233000.00 | 0.00% | 8491735529.00 | 8491896400.00 | 0.00% | | 842953kB | 2669351057.00 | 2669356000.00 | 0.00% | 2335682177.00 | 2335687000.00 | 0.00% | 2602617281.00 | 2602622200.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test ddot #### Verification of Group INSTRUCTIONS with Test ddot
Benchmark performed with data sizes: 1263kB, 2485kB, 3707kB, 4929kB. Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 1263kB and so on. Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_INSTRUCTIONS_ddot](./images/accuracy/haswell/INSTRUCTIONS_ddot.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 218725kB | 3434665907.00 | 3434672000.00 | 0.00% | 3485929577.00 | 3485936000.00 | 0.00% | 3475676843.00 | 3475683200.00 | 0.00% |
| 426801kB | 3401070167.00 | 3401075000.00 | 0.00% | 3401070167.00 | 3401075000.00 | 0.00% | 3401070167.00 | 3401075000.00 | 0.00% |
| 634877kB | 3422383802.00 | 3422389000.00 | 0.00% | 3422383802.00 | 3422389000.00 | 0.00% | 3422383802.00 | 3422389000.00 | 0.00% |
| 842953kB | 3358640717.00 | 3358645000.00 | 0.00% | 3358640717.00 | 3358645000.00 | 0.00% | 3358640717.00 | 3358645000.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test triad
Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_INSTRUCTIONS_triad](./images/accuracy/haswell/INSTRUCTIONS_triad.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 218725kB | 2110354431.00 | 2110360000.00 | 0.00% | 2077887440.00 | 2077893000.00 | 0.00% | 2090874236.40 | 2090879800.00 | 0.00% |
| 426801kB | 2090657530.00 | 2090663000.00 | 0.00% | 2090657530.00 | 2090663000.00 | 0.00% | 2065316226.80 | 2065321600.00 | 0.00% |
| 634877kB | 1979030440.00 | 1979035000.00 | 0.00% | 2073269984.00 | 2073275000.00 | 0.00% | 2035574166.40 | 2035579000.00 | 0.00% |
| 842953kB | 2127139126.00 | 2127144000.00 | 0.00% | 1876887466.00 | 1876892000.00 | 0.00% | 2077088794.00 | 2077093600.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test copy
Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_CLOCK_ddot](./images/accuracy/haswell/CLOCK_ddot.jpg)
![haswell_INSTRUCTIONS_copy](./images/accuracy/haswell/INSTRUCTIONS_copy.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) | | Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 1263kB | 4838875487.00 | 4839321000.00 | 0.01% | 4811346557.00 | 4811790000.00 | 0.01% | 4830824015.00 | 4831269000.00 | 0.01% | | 218725kB | 2218008138.00 | 2218014000.00 | 0.00% | 2218008138.00 | 2218014000.00 | 0.00% | 2202970794.80 | 2202976600.00 | 0.00% |
| 2485kB | 4835250857.00 | 4835479000.00 | 0.00% | 4761865937.00 | 4762091000.00 | 0.00% | 4807527665.00 | 4807754600.00 | 0.00% | | 426801kB | 2200692466.00 | 2200697000.00 | 0.00% | 2200692466.00 | 2200697000.00 | 0.00% | 2200692466.00 | 2200697000.00 | 0.00% |
| 3707kB | 4804546967.00 | 4804700000.00 | 0.00% | 4846250087.00 | 4846405000.00 | 0.00% | 4813930169.00 | 4814083800.00 | 0.00% | | 634877kB | 2182389676.00 | 2182394000.00 | 0.00% | 2182389676.00 | 2182394000.00 | 0.00% | 2182389676.00 | 2182394000.00 | 0.00% |
| 4929kB | 4840392767.00 | 4840510000.00 | 0.00% | 4732956842.00 | 4733072000.00 | 0.00% | 4772003447.00 | 4772119400.00 | 0.00% | | 842953kB | 2028355576.00 | 2028360000.00 | 0.00% | 2173238116.00 | 2173243000.00 | 0.00% | 2144261608.00 | 2144266400.00 | 0.00% |
#### Verification of Group INSTRUCTIONS with Test store
Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
![haswell_INSTRUCTIONS_store](./images/accuracy/haswell/INSTRUCTIONS_store.jpg)
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 218725kB | 2153074160.00 | 2153080000.00 | 0.00% | 2153074160.00 | 2153080000.00 | 0.00% | 2153074160.00 | 2153080000.00 | 0.00% |
| 426801kB | 2053979794.00 | 2053985000.00 | 0.00% | 2053979794.00 | 2053985000.00 | 0.00% | 2072652337.40 | 2072657400.00 | 0.00% |
| 634877kB | 1944310808.00 | 1944315000.00 | 0.00% | 2083190150.00 | 2083195000.00 | 0.00% | 2055414281.60 | 2055419000.00 | 0.00% |
| 842953kB | 2028355657.00 | 2028360000.00 | 0.00% | 1843959690.00 | 1843964000.00 | 0.00% | 1991476463.60 | 1991480800.00 | 0.00% |
### Verification of Group DATA ### Verification of Group DATA
...@@ -552,9 +652,9 @@ The table contains the values after scaling the original values up using the sca ...@@ -552,9 +652,9 @@ The table contains the values after scaling the original values up using the sca
#### Verification of Group UOPS with Test ddot_uops #### Verification of Group UOPS with Test ddot_uops
Benchmark performed with data sizes: 1263kB, 2485kB, 3707kB, 4929kB. Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 1263kB and so on. Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
...@@ -563,18 +663,18 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres ...@@ -563,18 +663,18 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) | | Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 1263kB | 8275018769.00 | 8275947000.00 | 0.01% | 8308369229.00 | 8309612000.00 | 0.01% | 8319964927.40 | 8321081600.00 | 0.01% | | 218725kB | 5775706837.00 | 5779137000.00 | 0.06% | 5775706837.00 | 5779540000.00 | 0.07% | 5704621214.60 | 5708047600.00 | 0.05% |
| 2485kB | 8191310209.00 | 8191922000.00 | 0.01% | 8203424545.00 | 8204329000.00 | 0.01% | 8197771188.20 | 8198600800.00 | 0.01% | | 426801kB | 5895188277.00 | 5897724000.00 | 0.04% | 5721800387.00 | 5725504000.00 | 0.06% | 5583090075.00 | 5586261400.00 | 0.04% |
| 3707kB | 8246560313.00 | 8247097000.00 | 0.01% | 8092953821.00 | 8094651000.00 | 0.02% | 8195960527.40 | 8196957400.00 | 0.01% | | 634877kB | 5932131911.00 | 5934641000.00 | 0.04% | 5932131911.00 | 5935153000.00 | 0.05% | 5932131911.00 | 5934848400.00 | 0.04% |
| 4929kB | 8201789457.00 | 8202400000.00 | 0.01% | 8107677127.00 | 8108486000.00 | 0.01% | 8194180375.00 | 8194878600.00 | 0.01% | | 842953kB | 6164093537.00 | 6166727000.00 | 0.04% | 5479194257.00 | 5481666000.00 | 0.05% | 5821643897.00 | 5824162600.00 | 0.03% |
#### Verification of Group UOPS with Test stream_uops #### Verification of Group UOPS with Test stream_uops
Benchmark performed with data sizes: 1263kB, 2485kB, 3707kB, 4929kB. Benchmark performed with data sizes: 218725kB, 426801kB, 634877kB, 842953kB.
Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 1263kB and so on. Each data size is tested 5 times, hence the first 5 entries on the x-axis correspond to the 5 runs for the first data size of 218725kB and so on.
...@@ -583,9 +683,9 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres ...@@ -583,9 +683,9 @@ Each data size is tested 5 times, hence the first 5 entries on the x-axis corres
| Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) | | Variant | BENCH (Min) | LIKWID (Min) | Error (Min) | BENCH (Max) | LIKWID (Max) | Error (Max) | BENCH (Avg) | LIKWID (Avg) | Error (Avg) |
| ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- | ------- |
| 1263kB | 13313082657.00 | 13314410000.00 | 0.01% | 13327580569.00 | 13329320000.00 | 0.01% | 13327780540.20 | 13329254000.00 | 0.01% | | 218725kB | 5541032337.00 | 5543598000.00 | 0.05% | 5541032337.00 | 5543753000.00 | 0.05% | 5523716611.00 | 5526332000.00 | 0.04% |
| 2485kB | 13450156637.00 | 13451060000.00 | 0.01% | 13486550947.00 | 13487500000.00 | 0.01% | 13311071355.00 | 13312100000.00 | 0.01% | | 426801kB | 5575087139.00 | 5577494000.00 | 0.04% | 5575087139.00 | 5577806000.00 | 0.05% | 5575087139.00 | 5577633800.00 | 0.04% |
| 3707kB | 13063656813.00 | 13064970000.00 | 0.01% | 13154631397.00 | 13156620000.00 | 0.02% | 13051918157.00 | 13053418000.00 | 0.01% | | 634877kB | 5528720489.00 | 5531259000.00 | 0.05% | 5277415013.00 | 5280510000.00 | 0.06% | 5428198298.60 | 5430898800.00 | 0.04% |
| 4929kB | 12533442433.00 | 12534570000.00 | 0.01% | 12033977729.00 | 12036040000.00 | 0.02% | 12448377350.60 | 12449824000.00 | 0.01% | | 842953kB | 5338702097.00 | 5340972000.00 | 0.04% | 5338702097.00 | 5341667000.00 | 0.06% | 5338702097.00 | 5341234400.00 | 0.04% |