benchmark

游雁

2023-03-16 5502dc2fbb52dda7cb39d364c2845d6933fb9267

 funasr/runtime/python/benchmark_onnx.md

@@ -4,20 +4,20 @@

 ### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz   16core-32processor    with avx512_vnni

| concurrent-tasks | processing time(s) |  RTF   | Speedup Rate |
|:----------------:|:------------------:|:------:|:------------:|
|  1 (onnx fp32)   |        2806        | 0.0777 |     12.9     |
|  1 (onnx int8)   |        1611        | 0.0446 |     22.4     |
|  8 (onnx fp32)   |        538         | 0.0149 |     67.1     |
|  8 (onnx int8)   |        210         | 0.0058 |    172.4     |
|  16 (onnx fp32)  |        288         | 0.0080 |    125.2     |
|  16 (onnx int8)  |        117         | 0.0032 |    309.9     |
|  32 (onnx fp32)  |        167         | 0.0046 |    216.5     |
|  32 (onnx int8)  |        107         | 0.0030 |    338.0     |
|  64 (onnx fp32)  |        158         | 0.0044 |    228.1     |
|  64 (onnx int8)  |         82         | 0.0023 |    442.8     |
|  96 (onnx fp32)  |        151         | 0.0042 |    238.0     |
|  96 (onnx int8)  |         80         | 0.0022 |    452.0     |
| concurrent-tasks | processing time(s) |   RTF   | Speedup Rate |
|:----------------:|:------------------:|:-------:|:------------:|
|  1 (onnx fp32)   |        2806        | 0.0777  |     12.9     |
|  1 (onnx int8)   |        1611        | 0.0446  |     22.4     |
|  8 (onnx fp32)   |        538         | 0.0149  |     67.1     |
|  8 (onnx int8)   |        210         | 0.0058  |    172.4     |
|  16 (onnx fp32)  |        288         | 0.0080  |    125.2     |
|  16 (onnx int8)  |        117         | 0.0032  |    309.9     |
|  32 (onnx fp32)  |        167         | 0.0046  |    216.5     |
|  32 (onnx int8)  |         86         | 0.0024  |    420.0     |
|  64 (onnx fp32)  |        158         | 0.0044  |    228.1     |
|  64 (onnx int8)  |         82         | 0.0023  |    442.8     |
|  96 (onnx fp32)  |        151         | 0.0042  |    238.0     |
|  96 (onnx int8)  |         80         | 0.0022  |    452.0     |


### Intel(R) Xeon(R) Platinum 8269CY CPU @ 2.50GHz   16core-32processor    with avx512_vnni