From 4827ea7f82b684aa5ba853193071b0ba713615a7 Mon Sep 17 00:00:00 2001 From: 游雁 <zhifu.gzf@alibaba-inc.com> Date: 星期四, 16 三月 2023 19:26:19 +0800 Subject: [PATCH] benchmark --- funasr/runtime/python/benchmark_onnx.md | 16 +++++++++++++++- 1 files changed, 15 insertions(+), 1 deletions(-) diff --git a/funasr/runtime/python/README.md b/funasr/runtime/python/benchmark_onnx.md similarity index 62% rename from funasr/runtime/python/README.md rename to funasr/runtime/python/benchmark_onnx.md index c47f8e7..b45f9ed 100644 --- a/funasr/runtime/python/README.md +++ b/funasr/runtime/python/benchmark_onnx.md @@ -2,7 +2,7 @@ (Note: The service has been fully warm up.) - Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni + ### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni | concurrent-tasks | processing time(s) | RTF | Speedup Rate | |:----------------:|:------------------:|:------:|:------------:| @@ -19,3 +19,17 @@ | 96 (onnx fp32) | 151 | 0.0042 | 238.0 | | 96 (onnx int8) | 80 | 0.0022 | 452.0 | + +### Intel(R) Xeon(R) Platinum 8269CY CPU @ 2.50GHz 16core-32processor with avx512_vnni + +| concurrent-tasks | processing time(s) | RTF | Speedup Rate | +|:----------------:|:------------------:|:------:|:------------:| +| 1 (onnx fp32) | 2613 | 0.0724 | 13.8 | +| 1 (onnx int8) | 1321 | 0.0366 | 22.4 | +| 32 (onnx fp32) | 170 | 0.0047 | 212.7 | +| 32 (onnx int8) | 89 | 0.0025 | 407.0 | +| 64 (onnx fp32) | 166 | 0.0046 | 217.1 | +| 64 (onnx int8) | 87 | 0.0024 | 414.7 | + + +### \ No newline at end of file -- Gitblit v1.9.1