From de016e282e4e056d43e833d132e383b2818fe361 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?David=20Test=C3=A9?= Date: Wed, 15 Oct 2025 13:44:27 +0200 Subject: [PATCH] chore(docs): update benchmark results for all backends This also removes tables in PBS benchmarks for failure probability of 2**-40. --- ...rk-fheuint64-tuniform-2m128-ciphertext.svg | 86 ++++----- ...k-tuniform-2m128-ciphertext-throughput.svg | 116 ++++++++++++ ...er-benchmark-tuniform-2m128-ciphertext.svg | 130 ++++++------- ...rk-tuniform-2m128-plaintext-throughput.svg | 95 ++++++++++ ...ger-benchmark-tuniform-2m128-plaintext.svg | 100 +++++----- .../cpu-pbs-benchmark-tuniform-2m128.svg | 44 ++--- .../cpu-pbs-benchmark-tuniform-2m64.svg | 40 ++-- ...t-tuniform-2m128-ciphertext-throughput.svg | 116 ++++++++++++ ...m5-multi-bit-tuniform-2m128-ciphertext.svg | 171 +++++++++--------- ...it-tuniform-2m128-plaintext-throughput.svg | 95 ++++++++++ ...xm5-multi-bit-tuniform-2m128-plaintext.svg | 100 +++++----- .../gpu-pbs-benchmark-tuniform-2m128.svg | 24 +-- .../gpu-pbs-benchmark-tuniform-2m40.svg | 46 ----- .../gpu-pbs-benchmark-tuniform-2m64.svg | 24 +-- ...1-tuniform-2m128-ciphertext-throughput.svg | 102 +++++++++++ ...chmark-hpux1-tuniform-2m128-ciphertext.svg | 171 +++++++++--------- ...1-tuniform-2m128-plaintext-throughput.svg} | 78 ++++---- ...nchmark-hpux1-tuniform-2m128-plaintext.svg | 64 +++---- .../benchmarks/cpu/cpu-integer-operations.md | 16 +- .../cpu/cpu-programmable-bootstrapping.md | 7 +- .../benchmarks/gpu/gpu-integer-operations.md | 16 +- .../gpu/gpu-programmable-bootstrapping.md | 4 - .../benchmarks/hpu/hpu-integer-operations.md | 17 +- 23 files changed, 1066 insertions(+), 596 deletions(-) create mode 100644 tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext-throughput.svg create mode 100644 tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext-throughput.svg create mode 100644 tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext-throughput.svg create mode 100644 tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext-throughput.svg delete mode 100644 tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m40.svg create mode 100644 tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext-throughput.svg rename tfhe/docs/.gitbook/assets/{cpu-pbs-benchmark-tuniform-2m40.svg => hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext-throughput.svg} (58%) diff --git a/tfhe/docs/.gitbook/assets/cpu-gpu-hpu-integer-benchmark-fheuint64-tuniform-2m128-ciphertext.svg b/tfhe/docs/.gitbook/assets/cpu-gpu-hpu-integer-benchmark-fheuint64-tuniform-2m128-ciphertext.svg index ac0189971b..9a0c5f1ce9 100644 --- a/tfhe/docs/.gitbook/assets/cpu-gpu-hpu-integer-benchmark-fheuint64-tuniform-2m128-ciphertext.svg +++ b/tfhe/docs/.gitbook/assets/cpu-gpu-hpu-integer-benchmark-fheuint64-tuniform-2m128-ciphertext.svg @@ -1,64 +1,64 @@ - Operation \ Backend - CPU - GPU - HPU + Operation \ Size + CPU + GPU + HPU Negation (-) - 91.7 ms - 17.0 ms - 15.9 ms + 83.5 ms + 8.97 ms + 8.62 ms Add / Sub (+,-) - 113 ms - 17.0 ms - 15.0 ms + 109 ms + 8.97 ms + 8.62 ms Mul (x) - 417 ms - 83.8 ms - 155 ms + 402 ms + 31.9 ms + 122 ms Equal / Not Equal (eq, ne) - 83.4 ms - 15.6 ms - 11.6 ms + 81.4 ms + 7.29 ms + 6.98 ms Comparisons (ge, gt, le, lt) - 106 ms - 21.6 ms - 12.2 ms + 105 ms + 10.6 ms + 6.94 ms Max / Min (max, min) - 152 ms - 29.7 ms - 18.9 ms + 150 ms + 14.9 ms + 11.8 ms Bitwise operations (&, |, ^) - 23.7 ms - 3.4 ms - 6.28 ms + 22.7 ms + 2.0 ms + 3.08 ms Div / Rem (/, %) - 6.13 s - 2.03 s - 1.27 s + 5.8 s + 502 ms + 925 ms Left / Right Shifts (<<, >>) - 145 ms - 31.6 ms - 121 ms + 142 ms + 17.9 ms + 82.0 ms Left / Right Rotations (left_rotate, right_rotate) - 146 ms - 33.4 ms - 131 ms + 133 ms + 17.8 ms + 88.9 ms Leading / Trailing zeros/ones - 266 ms - 43.7 ms - 22.8 ms + 261 ms + 20.0 ms + 15.0 ms Log2 - 288 ms - 50.3 ms - 22.7 ms + 277 ms + 21.9 ms + 15.0 ms Select - 37.0 ms - 8.52 ms - 10.6 ms + 47.8 ms + 4.63 ms + 5.69 ms diff --git a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext-throughput.svg b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext-throughput.svg new file mode 100644 index 0000000000..f65318de44 --- /dev/null +++ b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext-throughput.svg @@ -0,0 +1,116 @@ + + + + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Negation (-) + 706 ops/s + 319 ops/s + 151 ops/s + 74.2 ops/s + 36.2 ops/s + Add / Sub (+,-) + 658 ops/s + 324 ops/s + 149 ops/s + 72.5 ops/s + 34.8 ops/s + Mul (x) + 247 ops/s + 59 ops/s + 15.8 ops/s + 4.13 ops/s + 1.04 ops/s + Equal / Not Equal (eq, ne) + 1.4 k.ops/s + 640 ops/s + 335 ops/s + 163 ops/s + 85.8 ops/s + Comparisons (ge, gt, le, lt) + 1.4 k.ops/s + 635 ops/s + 302 ops/s + 145 ops/s + 52.1 ops/s + Max / Min (max, min) + 415 ops/s + 196 ops/s + 95.9 ops/s + 47.1 ops/s + 21.1 ops/s + Bitwise operations (&, |, ^) + 1.84 k.ops/s + 939 ops/s + 475 ops/s + 233 ops/s + 116 ops/s + Div / Rem (/, %) + 36.8 ops/s + 11.2 ops/s + 3.08 ops/s + 0.75 ops/s + 0.12 ops/s + Left / Right Shifts (<<, >>) + 397 ops/s + 153 ops/s + 63.6 ops/s + 27.6 ops/s + 12.2 ops/s + Left / Right Rotations (left_rotate, right_rotate) + 340 ops/s + 142 ops/s + 60.2 ops/s + 27.2 ops/s + 12.1 ops/s + Leading / Trailing zeros/ones + 528 ops/s + 202 ops/s + 88.5 ops/s + 35.5 ops/s + 15.3 ops/s + Log2 + 459 ops/s + 180 ops/s + 82.1 ops/s + 34.5 ops/s + 14.8 ops/s + Select + 909 ops/s + 457 ops/s + 228 ops/s + 111 ops/s + 57.1 ops/s + + + + + + + + + + + + + + + + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext.svg b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext.svg index dc29c5e2d4..68b7158e4f 100644 --- a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext.svg +++ b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext.svg @@ -15,83 +15,83 @@ Negation (-) - 54.8 ms - 64.5 ms - 66.2 ms - 91.7 ms - 117 ms + 53.6 ms + 58.7 ms + 62.7 ms + 83.5 ms + 113 ms Add / Sub (+,-) - 61.3 ms - 63.7 ms - 87.5 ms - 113 ms - 181 ms + 62.1 ms + 61.4 ms + 85.7 ms + 109 ms + 171 ms Mul (x) - 105 ms - 155 ms - 229 ms - 417 ms - 1.18 s + 101 ms + 147 ms + 218 ms + 402 ms + 1.16 s Equal / Not Equal (eq, ne) - 35.2 ms - 58.0 ms - 59.9 ms - 83.4 ms - 85.2 ms + 36.7 ms + 57.8 ms + 58.0 ms + 81.4 ms + 84.9 ms Comparisons (ge, gt, le, lt) - 41.0 ms - 58.2 ms - 82.0 ms - 106 ms - 152 ms + 37.8 ms + 60.9 ms + 82.1 ms + 105 ms + 150 ms Max / Min (max, min) - 84.2 ms - 101 ms - 126 ms - 152 ms - 203 ms + 80.2 ms + 103 ms + 128 ms + 150 ms + 198 ms Bitwise operations (&, |, ^) - 20.9 ms - 21.4 ms - 22.1 ms - 23.7 ms - 25.6 ms + 20.8 ms + 20.5 ms + 21.3 ms + 22.7 ms + 23.5 ms Div / Rem (/, %) - 529 ms - 1.19 s - 2.67 s - 6.13 s - 15.1 s + 505 ms + 1.14 s + 2.59 s + 5.8 s + 13.9 s Left / Right Shifts (<<, >>) - 64.3 ms - 87.4 ms - 113 ms - 145 ms - 190 ms + 60.7 ms + 83.1 ms + 111 ms + 142 ms + 189 ms Left / Right Rotations (left_rotate, right_rotate) - 63.5 ms - 87.5 ms - 114 ms - 146 ms - 194 ms + 61.5 ms + 85.4 ms + 110 ms + 133 ms + 195 ms Leading / Trailing zeros/ones - 105 ms - 173 ms - 193 ms - 266 ms - 325 ms + 102 ms + 168 ms + 188 ms + 261 ms + 315 ms Log2 - 121 ms - 185 ms - 214 ms - 288 ms - 344 ms + 125 ms + 182 ms + 208 ms + 277 ms + 321 ms Select - 32.4 ms - 32.9 ms - 33.8 ms - 37.0 ms - 39.7 ms + 41.9 ms + 40.0 ms + 42.9 ms + 47.8 ms + 50.4 ms diff --git a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext-throughput.svg b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext-throughput.svg new file mode 100644 index 0000000000..ff1a91997d --- /dev/null +++ b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext-throughput.svg @@ -0,0 +1,95 @@ + + + + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Add / Sub (+,-) + 716 ops/s + 329 ops/s + 152 ops/s + 72.6 ops/s + 36.1 ops/s + Mul (x) + 556 ops/s + 147 ops/s + 39.1 ops/s + 13.6 ops/s + 4.1 ops/s + Equal / Not Equal (eq, ne) + 2.36 k.ops/s + 1.42 k.ops/s + 642 ops/s + 337 ops/s + 164 ops/s + Comparisons (ge, gt, le, lt) + 2.33 k.ops/s + 1.39 k.ops/s + 631 ops/s + 295 ops/s + 140 ops/s + Max / Min (max, min) + 1.01 k.ops/s + 547 ops/s + 257 ops/s + 126 ops/s + 61.7 ops/s + Bitwise operations (&, |, ^) + 1.95 k.ops/s + 961 ops/s + 486 ops/s + 241 ops/s + 118 ops/s + Div (/) + 157 ops/s + 55 ops/s + 19.5 ops/s + 6.57 ops/s + 1.78 ops/s + Rem (%) + 96.1 ops/s + 35 ops/s + 12.7 ops/s + 4.72 ops/s + 1.36 ops/s + Left / Right Shifts (<<, >>) + 1.88 k.ops/s + 931 ops/s + 474 ops/s + 228 ops/s + 117 ops/s + Left / Right Rotations (left_rotate, right_rotate) + 1.83 k.ops/s + 921 ops/s + 473 ops/s + 233 ops/s + 116 ops/s + + + + + + + + + + + + + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext.svg b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext.svg index 4f95fb9681..1561917716 100644 --- a/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext.svg +++ b/tfhe/docs/.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext.svg @@ -15,65 +15,65 @@ Add / Sub (+,-) - 58.8 ms - 65.0 ms - 66.5 ms - 92.9 ms - 120 ms + 63.2 ms + 61.5 ms + 64.7 ms + 86.6 ms + 114 ms Mul (x) - 85.0 ms - 135 ms - 185 ms - 255 ms - 487 ms + 77.8 ms + 147 ms + 174 ms + 233 ms + 459 ms Equal / Not Equal (eq, ne) - 38.3 ms - 36.3 ms - 57.2 ms - 58.1 ms - 81.6 ms + 40.4 ms + 37.3 ms + 57.3 ms + 59.5 ms + 79.3 ms Comparisons (ge, gt, le, lt) - 36.0 ms - 38.0 ms - 58.2 ms - 81.9 ms - 105 ms + 36.2 ms + 36.7 ms + 62.4 ms + 77.7 ms + 101 ms Max / Min (max, min) - 61.9 ms - 61.2 ms - 81.5 ms - 104 ms - 126 ms + 57.5 ms + 61.9 ms + 83.0 ms + 102 ms + 130 ms Bitwise operations (&, |, ^) - 21.2 ms - 21.2 ms - 21.8 ms - 23.5 ms - 25.6 ms + 19.4 ms + 20.7 ms + 21.6 ms + 22.3 ms + 23.6 ms Div (/) - 147 ms - 211 ms - 306 ms - 500 ms - 857 ms + 245 ms + 188 ms + 220 ms + 342 ms + 723 ms Rem (%) - 308 ms - 406 ms - 554 ms - 807 ms - 1.36 s + 192 ms + 308 ms + 424 ms + 664 ms + 1.19 s Left / Right Shifts (<<, >>) - 22.0 ms - 21.5 ms - 22.0 ms - 23.3 ms - 25.3 ms + 20.7 ms + 20.6 ms + 21.3 ms + 23.2 ms + 24.2 ms Left / Right Rotations (left_rotate, right_rotate) - 21.4 ms - 20.9 ms - 22.2 ms - 23.4 ms - 25.5 ms + 19.8 ms + 21.0 ms + 21.7 ms + 22.6 ms + 23.4 ms diff --git a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m128.svg b/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m128.svg index 0640a7f453..12b87f63e7 100644 --- a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m128.svg +++ b/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m128.svg @@ -2,36 +2,32 @@ Operation \ Precision (bits) - FheUint - 2 - FheUint - 4 - FheUint - 6 - FheUint - 8 + 2 + 4 + 6 + 8 PBS - 10.1 ms - 13.1 ms - 113 ms - 1.44 s + 10.3 ms + 13.8 ms + 115 ms + 1.3 s MB-PBS - 4.25 ms - 7.96 ms - 77.8 ms - 555 ms + 3.53 ms + 4.16 ms + 33.6 ms + 232 ms KS - PBS - 12.0 ms - 15.3 ms - 127 ms - 1.45 s + 11.9 ms + 15.5 ms + 135 ms + 1.47 s KS - MB-PBS - 5.8 ms - 11.2 ms - 126 ms - 731 ms + 5.99 ms + 7.37 ms + 52.4 ms + 368 ms diff --git a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m64.svg b/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m64.svg index dadb76d8db..95945fc82a 100644 --- a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m64.svg +++ b/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m64.svg @@ -2,36 +2,32 @@ Operation \ Precision (bits) - FheUint - 2 - FheUint - 4 - FheUint - 6 - FheUint - 8 + 2 + 4 + 6 + 8 PBS - 9.61 ms - 12.6 ms + 9.85 ms + 12.8 ms 106 ms - 651 ms + 633 ms MB-PBS - 4.61 ms - 5.23 ms - 39.7 ms - 230 ms + 3.47 ms + 4.14 ms + 31.9 ms + 178 ms KS - PBS - 11.3 ms - 15.3 ms + 11.2 ms + 16.0 ms 121 ms - 863 ms + 855 ms KS - MB-PBS - 5.31 ms - 6.9 ms - 49.3 ms - 290 ms + 5.34 ms + 7.14 ms + 51.9 ms + 225 ms diff --git a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext-throughput.svg b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext-throughput.svg new file mode 100644 index 0000000000..1375eb32eb --- /dev/null +++ b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext-throughput.svg @@ -0,0 +1,116 @@ + + + + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Negation (-) + 713 ops/s + 703 ops/s + 685 ops/s + 648 ops/s + 419 ops/s + Add / Sub (+,-) + 679 ops/s + 693 ops/s + 655 ops/s + 635 ops/s + 415 ops/s + Mul (x) + 542 ops/s + 501 ops/s + 248 ops/s + 64.7 ops/s + 13.1 ops/s + Equal / Not Equal (eq, ne) + 564 ops/s + 538 ops/s + 546 ops/s + 525 ops/s + 376 ops/s + Comparisons (ge, gt, le, lt) + 392 ops/s + 382 ops/s + 379 ops/s + 347 ops/s + 236 ops/s + Max / Min (max, min) + 308 ops/s + 305 ops/s + 291 ops/s + 247 ops/s + 157 ops/s + Bitwise operations (&, |, ^) + 2.35 k.ops/s + 2.73 k.ops/s + 2.67 k.ops/s + 2.23 k.ops/s + 1.55 k.ops/s + Div / Rem (/, %) + 61.4 ops/s + 38.4 ops/s + 21.8 ops/s + 9.6 ops/s + 2.79 ops/s + Left / Right Shifts (<<, >>) + 623 ops/s + 581 ops/s + 418 ops/s + 213 ops/s + 97.3 ops/s + Left / Right Rotations (left_rotate, right_rotate) + 634 ops/s + 586 ops/s + 418 ops/s + 213 ops/s + 97.4 ops/s + Leading / Trailing zeros/ones + 368 ops/s + 355 ops/s + 347 ops/s + 308 ops/s + 198 ops/s + Log2 + 409 ops/s + 374 ops/s + 364 ops/s + 306 ops/s + 199 ops/s + Select + 863 ops/s + 1.15 k.ops/s + 1.06 k.ops/s + 819 ops/s + 392 ops/s + + + + + + + + + + + + + + + + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext.svg b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext.svg index ee853ab5ae..4fe47c8d97 100644 --- a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext.svg +++ b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext.svg @@ -1,5 +1,5 @@ - + Operation \ Size FheUint @@ -12,86 +12,80 @@ 64 FheUint 128 - - - Negation (-) - 9.01 ms - 10.6 ms - 13.2 ms - 17.0 ms - 25.2 ms - Add / Sub (+,-) - 9.05 ms - 10.6 ms - 13.3 ms - 17.0 ms - 25.3 ms - Mul (x) - 22.7 ms - 30.9 ms - 43.5 ms - 83.8 ms - 221 ms - Equal / Not Equal (eq, ne) - 6.62 ms - 10.7 ms - 11.5 ms - 15.6 ms - 17.4 ms - Comparisons (ge, gt, le, lt) - 9.93 ms - 14.4 ms - 18.8 ms - 21.6 ms - 26.7 ms - Max / Min (max, min) - 16.2 ms - 21.2 ms - 25.1 ms - 29.7 ms - 35.9 ms - Bitwise operations (&, |, ^) - 2.89 ms - 3.32 ms - 3.34 ms - 3.4 ms - 3.68 ms - Div / Rem (/, %) - 195 ms - 421 ms - 914 ms - 2.03 s - 4.83 s - Left / Right Shifts (<<, >>) - 18.1 ms - 21.6 ms - 26.1 ms - 31.6 ms - 42.0 ms - Left / Right Rotations (left_rotate, right_rotate) - 18.1 ms - 23.1 ms - 27.9 ms - 33.4 ms - 42.2 ms - Leading / Trailing zeros/ones - 22.0 ms - 31.1 ms - 34.8 ms - 43.7 ms - 54.4 ms - Log2 - 27.9 ms - 37.2 ms - 41.3 ms - 50.3 ms - 61.0 ms - Select - 6.24 ms - 6.75 ms - 6.97 ms - 8.52 ms - 9.5 ms + + + Add / Sub (+,-) + 4.74 ms + 5.27 ms + 6.91 ms + 8.97 ms + 13.4 ms + Mul (x) + 9.26 ms + 12.2 ms + 18.3 ms + 31.9 ms + 79.0 ms + Equal / Not Equal (eq, ne) + 3.6 ms + 5.04 ms + 5.42 ms + 7.29 ms + 8.3 ms + Comparisons (ge, gt, le, lt) + 5.17 ms + 6.63 ms + 8.5 ms + 10.6 ms + 13.3 ms + Max / Min (max, min) + 8.2 ms + 10.0 ms + 12.3 ms + 14.9 ms + 18.3 ms + Bitwise operations (&, |, ^) + 1.44 ms + 1.61 ms + 1.73 ms + 2.0 ms + 2.28 ms + Div / Rem (/, %) + 50.0 ms + 93.9 ms + 205 ms + 502 ms + 1.36 s + Left / Right Shifts (<<, >>) + 9.01 ms + 11.3 ms + 14.6 ms + 17.9 ms + 22.8 ms + Left / Right Rotations (left_rotate, right_rotate) + 9.0 ms + 11.3 ms + 14.6 ms + 17.8 ms + 22.8 ms + Leading / Trailing zeros/ones + 10.1 ms + 13.3 ms + 15.6 ms + 20.0 ms + 24.8 ms + Log2 + 9.63 ms + 14.0 ms + 16.4 ms + 21.9 ms + 26.6 ms + Select + 3.13 ms + 3.47 ms + 3.93 ms + 4.63 ms + 5.66 ms @@ -105,12 +99,11 @@ - - - - - - - - + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext-throughput.svg b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext-throughput.svg new file mode 100644 index 0000000000..6fabd10f2d --- /dev/null +++ b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext-throughput.svg @@ -0,0 +1,95 @@ + + + + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Add / Sub (+,-) + 538 ops/s + 580 ops/s + 546 ops/s + 530 ops/s + 371 ops/s + Mul (x) + 422 ops/s + 394 ops/s + 364 ops/s + 204 ops/s + 70.4 ops/s + Equal / Not Equal (eq, ne) + 490 ops/s + 481 ops/s + 475 ops/s + 470 ops/s + 356 ops/s + Comparisons (ge, gt, le, lt) + 338 ops/s + 336 ops/s + 334 ops/s + 302 ops/s + 230 ops/s + Max / Min (max, min) + 275 ops/s + 269 ops/s + 264 ops/s + 223 ops/s + 153 ops/s + Bitwise operations (&, |, ^) + 1.26 k.ops/s + 1.51 k.ops/s + 1.84 k.ops/s + 1.66 k.ops/s + 1.27 k.ops/s + Div (/) + 288 ops/s + 278 ops/s + 255 ops/s + 89.6 ops/s + 24.1 ops/s + Rem (%) + 137 ops/s + 130 ops/s + 121 ops/s + 72.5 ops/s + 17.5 ops/s + Left / Right Shifts (<<, >>) + 1.37 k.ops/s + 1.65 k.ops/s + 2.03 k.ops/s + 1.88 k.ops/s + 1.37 k.ops/s + Left / Right Rotations (left_rotate, right_rotate) + 1.36 k.ops/s + 1.67 k.ops/s + 2.03 k.ops/s + 1.87 k.ops/s + 1.36 k.ops/s + + + + + + + + + + + + + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext.svg b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext.svg index 06fcb36747..5289376d2d 100644 --- a/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext.svg +++ b/tfhe/docs/.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext.svg @@ -15,65 +15,65 @@ Add / Sub (+,-) - 9.19 ms - 10.8 ms - 13.4 ms - 17.1 ms - 25.5 ms + 4.77 ms + 5.32 ms + 6.98 ms + 9.03 ms + 13.5 ms Mul (x) - 17.1 ms - 25.9 ms - 36.1 ms - 51.4 ms - 106 ms + 7.54 ms + 10.5 ms + 15.0 ms + 21.4 ms + 35.9 ms Equal / Not Equal (eq, ne) - 7.09 ms - 8.74 ms - 12.2 ms - 13.3 ms - 17.6 ms + 3.65 ms + 3.72 ms + 5.44 ms + 5.85 ms + 8.24 ms Comparisons (ge, gt, le, lt) - 8.82 ms - 13.1 ms - 16.9 ms - 20.2 ms - 25.5 ms + 4.65 ms + 5.59 ms + 7.31 ms + 9.2 ms + 11.8 ms Max / Min (max, min) - 15.1 ms - 20.4 ms - 23.9 ms - 28.5 ms - 34.3 ms + 7.61 ms + 8.99 ms + 11.1 ms + 13.5 ms + 16.9 ms Bitwise operations (&, |, ^) - 3.08 ms - 3.81 ms - 3.82 ms - 3.9 ms - 4.25 ms + 1.47 ms + 1.65 ms + 1.84 ms + 2.16 ms + 2.59 ms Div (/) - 26.2 ms - 37.3 ms - 53.1 ms - 90.2 ms - 211 ms + 11.5 ms + 16.1 ms + 23.3 ms + 35.0 ms + 61.8 ms Rem (%) - 51.0 ms - 70.1 ms - 97.7 ms - 150 ms - 310 ms + 24.0 ms + 31.1 ms + 44.4 ms + 64.9 ms + 106 ms Left / Right Shifts (<<, >>) - 2.85 ms - 3.5 ms - 3.39 ms - 3.45 ms - 3.73 ms + 1.47 ms + 1.65 ms + 1.77 ms + 2.04 ms + 2.31 ms Left / Right Rotations (left_rotate, right_rotate) - 2.87 ms - 3.38 ms - 3.4 ms - 3.47 ms - 3.75 ms + 1.48 ms + 1.66 ms + 1.79 ms + 2.05 ms + 2.32 ms diff --git a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m128.svg b/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m128.svg index 53680ba134..dc2746c099 100644 --- a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m128.svg +++ b/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m128.svg @@ -13,24 +13,24 @@ PBS - 8.99 ms - 11.4 ms - 59.6 ms + 8.1 ms + 9.45 ms + 64.6 ms N/A MB-PBS - 1.98 ms - 2.32 ms - 12.2 ms + 818 us + 990 us + 11.5 ms N/A KS - PBS - 9.0 ms - 11.4 ms - 59.6 ms + 8.2 ms + 9.53 ms + 65.2 ms N/A KS - MB-PBS - 2.13 ms - 2.49 ms - 12.9 ms + 930 us + 1.13 ms + 12.2 ms N/A diff --git a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m40.svg b/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m40.svg deleted file mode 100644 index 5fe4ccac60..0000000000 --- a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m40.svg +++ /dev/null @@ -1,46 +0,0 @@ - - - - Operation \ Precision (bits) - FheUint - 2 - FheUint - 4 - FheUint - 6 - FheUint - 8 - - - PBS - 6.68 ms - 10.3 ms - 53.1 ms - N/A - MB-PBS - 1.76 ms - 1.95 ms - 5.89 ms - N/A - KS - PBS - 7.05 ms - 10.5 ms - 53.3 ms - N/A - KS - MB-PBS - 1.76 ms - 2.11 ms - 6.5 ms - N/A - - - - - - - - - - - - diff --git a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m64.svg b/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m64.svg index 9ee67e3eab..80c20e5b93 100644 --- a/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m64.svg +++ b/tfhe/docs/.gitbook/assets/gpu-pbs-benchmark-tuniform-2m64.svg @@ -13,24 +13,24 @@ PBS - 8.59 ms - 10.9 ms - 55.3 ms + 7.74 ms + 9.05 ms + 59.8 ms N/A MB-PBS - 1.89 ms - 2.11 ms - 11.2 ms + 1.63 ms + 912 us + 10.7 ms N/A KS - PBS - 8.6 ms - 11.0 ms - 55.5 ms + 7.84 ms + 9.16 ms + 60.3 ms N/A KS - MB-PBS - 2.02 ms - 2.29 ms - 11.9 ms + 1.74 ms + 1.05 ms + 11.3 ms N/A diff --git a/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext-throughput.svg b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext-throughput.svg new file mode 100644 index 0000000000..b4649a44d5 --- /dev/null +++ b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext-throughput.svg @@ -0,0 +1,102 @@ + + + + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Add / Sub (+,-) + 491 ops/s + 354 ops/s + 236 ops/s + 126 ops/s + 67.5 ops/s + Mul (x) + 234 ops/s + 103 ops/s + 27.4 ops/s + 8.29 ops/s + 2.06 ops/s + Equal / Not Equal (eq, ne) + 498 ops/s + 371 ops/s + 227 ops/s + 161 ops/s + 89.4 ops/s + Comparisons (ge, gt, le, lt) + 498 ops/s + 371 ops/s + 227 ops/s + 161 ops/s + 89.4 ops/s + Bitwise operations (&, |, ^) + 1.44 k.ops/s + 1.41 k.ops/s + 660 ops/s + 419 ops/s + 204 ops/s + Div / Rem (/, %) + 24.75 ops/s + 9.97 ops/s + 3.6 ops/s + 1.08 ops/s + 0.29 ops/s + Left / Right Shifts (<<, >>) + 542 ops/s + 217 ops/s + 35.1 ops/s + 12.6 ops/s + 3.48 ops/s + Left / Right Rotations (left_rotate, right_rotate) + 535 ops/s + 183 ops/s + 30.9 ops/s + 11.6 ops/s + 3.16 ops/s + Leading / Trailing zeros/ones + 209 ops/s + 216 ops/s + 120 ops/s + 70.1 ops/s + 42.8 ops/s + Log2 + 314 ops/s + 217 ops/s + 128 ops/s + 70.4 ops/s + 43.1 ops/s + Select + 1.37 k.ops/s + 660 ops/s + 420 ops/s + 204 ops/s + 109 ops/s + + + + + + + + + + + + + + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext.svg b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext.svg index cc873c5ff9..185e5903de 100644 --- a/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext.svg +++ b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext.svg @@ -1,5 +1,5 @@ - + Operation \ Size FheUint @@ -12,86 +12,80 @@ 64 FheUint 128 - - - Negation (-) - 6.28 ms - 8.61 ms - 8.31 ms - 15.9 ms - 22.6 ms - Add / Sub (+,-) - 5.56 ms - 8.18 ms - 8.24 ms - 15.0 ms - 22.9 ms - Mul (x) - 10.4 ms - 22.4 ms - 51.8 ms - 155 ms - 609 ms - Equal / Not Equal (eq, ne) - 6.18 ms - 8.2 ms - 10.9 ms - 11.6 ms - 17.6 ms - Comparisons (ge, gt, le, lt) - 6.32 ms - 7.82 ms - 11.6 ms - 12.2 ms - 18.6 ms - Max / Min (max, min) - 8.22 ms - 10.2 ms - 12.5 ms - 18.9 ms - 30.1 ms - Bitwise operations (&, |, ^) - 4.26 ms - 4.25 ms - 5.79 ms - 6.28 ms - 11.7 ms - Div / Rem (/, %) - 64.4 ms - 147 ms - 388 ms - 1.27 s - 4.7 s - Left / Right Shifts (<<, >>) - 8.96 ms - 8.2 ms - 43.9 ms - 121 ms - 425 ms - Left / Right Rotations (left_rotate, right_rotate) - 7.76 ms - 10.3 ms - 51.8 ms - 131 ms - 467 ms - Leading / Trailing zeros/ones - 7.98 ms - 9.79 ms - 14.2 ms - 22.8 ms - 36.1 ms - Log2 - 6.77 ms - 10.2 ms - 14.2 ms - 22.7 ms - 35.2 ms - Select - 4.22 ms - 6.0 ms - 6.14 ms - 10.6 ms - 14.5 ms + + + Add / Sub (+,-) + 2.58 ms + 3.36 ms + 4.9 ms + 8.62 ms + 15.6 ms + Mul (x) + 4.89 ms + 10.4 ms + 37.3 ms + 122 ms + 485 ms + Equal / Not Equal (eq, ne) + 2.54 ms + 3.29 ms + 4.96 ms + 6.98 ms + 12.0 ms + Comparisons (ge, gt, le, lt) + 2.55 ms + 3.31 ms + 5.06 ms + 6.94 ms + 12.0 ms + Max / Min (max, min) + 3.23 ms + 4.82 ms + 7.38 ms + 11.8 ms + 21.1 ms + Bitwise operations (&, |, ^) + 1.14 ms + 1.28 ms + 2.15 ms + 3.08 ms + 5.71 ms + Div / Rem (/, %) + 41.8 ms + 102 ms + 278 ms + 925 ms + 3.45 s + Left / Right Shifts (<<, >>) + 3.29 ms + 5.13 ms + 29.8 ms + 82.0 ms + 290 ms + Left / Right Rotations (left_rotate, right_rotate) + 3.36 ms + 6.22 ms + 34.4 ms + 88.9 ms + 318 ms + Leading / Trailing zeros/ones + 5.38 ms + 5.17 ms + 9.03 ms + 15.0 ms + 24.1 ms + Log2 + 3.74 ms + 5.17 ms + 8.97 ms + 15.0 ms + 24.1 ms + Select + 1.24 ms + 2.17 ms + 3.05 ms + 5.69 ms + 9.91 ms @@ -105,12 +99,11 @@ - - - - - - - - + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m40.svg b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext-throughput.svg similarity index 58% rename from tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m40.svg rename to tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext-throughput.svg index 54a3b9f7b7..6fc4ac8f2c 100644 --- a/tfhe/docs/.gitbook/assets/cpu-pbs-benchmark-tuniform-2m40.svg +++ b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext-throughput.svg @@ -1,46 +1,46 @@ - + - Operation \ Precision (bits) - FheUint - 2 - FheUint - 4 - FheUint - 6 - FheUint - 8 - - - PBS - 6.44 ms - 12.2 ms - 102 ms - 484 ms - MB-PBS - 3.55 ms - 5.07 ms - 37.5 ms - 238 ms - KS - PBS - 8.0 ms - 14.4 ms - 118 ms - 545 ms - KS - MB-PBS - 6.15 ms - 6.69 ms - 49.3 ms - 329 ms + Operation \ Size + FheUint + 8 + FheUint + 16 + FheUint + 32 + FheUint + 64 + FheUint + 128 + + + Add / Sub (+,-) + 491 ops/s + 351 ops/s + 233 ops/s + 126 ops/s + 67 ops/s + Mul (x) + 234 ops/s + 103 ops/s + 27.4 ops/s + 8.27 ops/s + 2.06 ops/s + Div / Rem (/, %) + 22.7 ops/s + 9.86 ops/s + 3.61 ops/s + 1.05 ops/s + 0.29 ops/s - - - - - - - + + + + + + + diff --git a/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext.svg b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext.svg index ae22e8238c..c0e55e1937 100644 --- a/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext.svg +++ b/tfhe/docs/.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext.svg @@ -1,5 +1,5 @@ - + Operation \ Size FheUint @@ -12,49 +12,35 @@ 64 FheUint 128 - - + + Add / Sub (+,-) - 5.99 ms - 8.03 ms - 8.38 ms - 14.3 ms - 23.1 ms + 2.66 ms + 3.43 ms + 5.04 ms + 8.79 ms + 15.7 ms Mul (x) - 10.9 ms - 23.6 ms - 53.4 ms - 155 ms - 613 ms + 4.87 ms + 10.4 ms + 37.3 ms + 123 ms + 484 ms Div / Rem (/, %) - 60.8 ms - 148 ms - 390 ms - 1.31 s - 4.77 s - Left / Right Shifts (<<, >>) - 4.29 ms - 4.19 ms - 4.17 ms - 4.03 ms - 4.11 ms - Left / Right Rotations (left_rotate, right_rotate) - 3.58 ms - 4.24 ms - 4.07 ms - 3.94 ms - 3.67 ms + 44.7 ms + 102 ms + 278 ms + 952 ms + 3.51 s - - - - - - - - - + + + + + + + diff --git a/tfhe/docs/getting-started/benchmarks/cpu/cpu-integer-operations.md b/tfhe/docs/getting-started/benchmarks/cpu/cpu-integer-operations.md index 68b71e053c..6eff2cec74 100644 --- a/tfhe/docs/getting-started/benchmarks/cpu/cpu-integer-operations.md +++ b/tfhe/docs/getting-started/benchmarks/cpu/cpu-integer-operations.md @@ -12,14 +12,26 @@ The following tables benchmark the execution time of some operation sets using ` ## Pfail: $$2^{-128}$$ -The next table shows the operation timings on CPU when all inputs are encrypted: +The next tables show the operation timings on CPU when all inputs are encrypted: + +### Latency ![](../../../.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext.svg) -The next table shows the operation timings on CPU when the left input is encrypted and the right is a clear scalar of the same size: +### Throughput + +![](../../../.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-ciphertext-throughput.svg) + +The next tables show the operation timings on CPU when the left input is encrypted and the right is a clear scalar of the same size: + +### Latency ![](../../../.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext.svg) +### Throughput + +![](../../../.gitbook/assets/cpu-integer-benchmark-tuniform-2m128-plaintext-throughput.svg) + All timings are based on parallelized Radix-based integer operations where each block is encrypted using the default parameters `PARAM_MESSAGE_2_CARRY_2_KS_PBS`. To ensure predictable timings, we perform operations in the `default` mode, which ensures that the input and output encoding are similar (i.e., the carries are always emptied). You can minimize operational costs by selecting from 'unchecked', 'checked', or 'smart' modes from [the fine-grained APIs](../../../references/fine-grained-apis/quick-start.md), each balancing performance and correctness differently. For more details about parameters, see [here](../../../references/fine-grained-apis/shortint/parameters.md). You can find the benchmark results on GPU for all these operations on GPU [here](../../../getting-started/benchmarks/gpu/README.md) and on HPU [here](../../../configuration/hpu-acceleration/benchmark.md). diff --git a/tfhe/docs/getting-started/benchmarks/cpu/cpu-programmable-bootstrapping.md b/tfhe/docs/getting-started/benchmarks/cpu/cpu-programmable-bootstrapping.md index 4d4dd412fc..46b67a0fbe 100644 --- a/tfhe/docs/getting-started/benchmarks/cpu/cpu-programmable-bootstrapping.md +++ b/tfhe/docs/getting-started/benchmarks/cpu/cpu-programmable-bootstrapping.md @@ -8,12 +8,7 @@ All CPU benchmarks were launched on an `AWS hpc7a.96xlarge` instance equipped wi The next tables show the execution time of a single programmable bootstrapping as well as keyswitch followed by a programmable bootstrapping depending on the precision of the input message. The associated parameters set are given. The configuration is tfhe-fft + AVX-512. -Note that these benchmarks use Gaussian parameters. `MB-PBS` stands for multi-bit programmable bootstrapping. - - -## P-fail: $$2^{-40}$$ - -![](../../../.gitbook/assets/cpu-pbs-benchmark-tuniform-2m40.svg) +Note that these benchmarks use Gaussian parameters. `MB-PBS` stands for multi-bit programmable bootstrapping with a grouping factor set to 4. ## P-fail: $$2^{-64}$$ diff --git a/tfhe/docs/getting-started/benchmarks/gpu/gpu-integer-operations.md b/tfhe/docs/getting-started/benchmarks/gpu/gpu-integer-operations.md index d4b607e0d9..6aed42ad57 100644 --- a/tfhe/docs/getting-started/benchmarks/gpu/gpu-integer-operations.md +++ b/tfhe/docs/getting-started/benchmarks/gpu/gpu-integer-operations.md @@ -11,14 +11,26 @@ The cryptographic parameters `PARAM_GPU_MULTI_BIT_GROUP_4_MESSAGE_2_CARRY_2_KS_P ## Pfail: $$2^{-128}$$ ### 8xH100-SXM5 Below come the results for the execution on eight H100 using SXM technology. -The following table shows the performance when the inputs of the benchmarked operation are encrypted: +The following tables show the performance when the inputs of the benchmarked operation are encrypted: + +### Latency ![](../../../.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext.svg) -The following table shows the performance when the left input of the benchmarked operation is encrypted and the other is a clear scalar of the same size: +### Throughput + +![](../../../.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-ciphertext-throughput.svg) + +The following tables show the performance when the left input of the benchmarked operation is encrypted and the other is a clear scalar of the same size: + +### Latency ![](../../../.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext.svg) +### Throughput + +![](../../../.gitbook/assets/gpu-integer-benchmark-h100x8-sxm5-multi-bit-tuniform-2m128-plaintext-throughput.svg) + ## Reproducing TFHE-rs benchmarks **TFHE-rs** benchmarks can be easily reproduced from the [source](https://github.com/zama-ai/tfhe-rs). diff --git a/tfhe/docs/getting-started/benchmarks/gpu/gpu-programmable-bootstrapping.md b/tfhe/docs/getting-started/benchmarks/gpu/gpu-programmable-bootstrapping.md index efd1452ba6..67f0b974aa 100644 --- a/tfhe/docs/getting-started/benchmarks/gpu/gpu-programmable-bootstrapping.md +++ b/tfhe/docs/getting-started/benchmarks/gpu/gpu-programmable-bootstrapping.md @@ -6,10 +6,6 @@ This document details the GPU performance benchmarks of programmable bootstrappi All GPU benchmarks were launched on H100 GPUs, and rely on the multithreaded PBS algorithm with a grouping factor set to 4. {% endhint %} -## P-fail: $$2^{-40}$$ - -![](../../../.gitbook/assets/gpu-pbs-benchmark-tuniform-2m40.svg) - ## P-fail: $$2^{-64}$$ ![](../../../.gitbook/assets/gpu-pbs-benchmark-tuniform-2m64.svg) diff --git a/tfhe/docs/getting-started/benchmarks/hpu/hpu-integer-operations.md b/tfhe/docs/getting-started/benchmarks/hpu/hpu-integer-operations.md index 474cb99c52..b6eae521d0 100644 --- a/tfhe/docs/getting-started/benchmarks/hpu/hpu-integer-operations.md +++ b/tfhe/docs/getting-started/benchmarks/hpu/hpu-integer-operations.md @@ -10,14 +10,27 @@ The cryptographic parameters `HPU_PARAM_MESSAGE_2_CARRY_2_KS32_PBS_TUNIFORM_2M12 ## 1xHPU Below are the results for the execution on a single Alveo v80 board. -The following table shows the performance when the inputs of the benchmarked operation are encrypted: + +The following tables show the performance when the inputs of the benchmarked operation are encrypted: + +### Latency ![](../../../.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext.svg) -The following table shows the performance when the left input of the benchmarked operation is encrypted and the other is a clear scalar of the same size: +### Throughput + +![](../../../.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-ciphertext-throughput.svg) + +The following tables show the performance when the left input of the benchmarked operation is encrypted and the other is a clear scalar of the same size: + +### Latency ![](../../../.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext.svg) +### Throughput + +![](../../../.gitbook/assets/hpu-integer-benchmark-hpux1-tuniform-2m128-plaintext-throughput.svg) + ## Reproducing TFHE-rs benchmarks **TFHE-rs** benchmarks can be easily reproduced from the [source](https://github.com/zama-ai/tfhe-rs).