From 5502dc2fbb52dda7cb39d364c2845d6933fb9267 Mon Sep 17 00:00:00 2001 From: 游雁 <zhifu.gzf@alibaba-inc.com> Date: 星期四, 16 三月 2023 21:47:19 +0800 Subject: [PATCH] benchmark --- funasr/runtime/python/benchmark_onnx.md | 28 ++++++++++++++-------------- 1 files changed, 14 insertions(+), 14 deletions(-) diff --git a/funasr/runtime/python/benchmark_onnx.md b/funasr/runtime/python/benchmark_onnx.md index b45f9ed..e0584a5 100644 --- a/funasr/runtime/python/benchmark_onnx.md +++ b/funasr/runtime/python/benchmark_onnx.md @@ -4,20 +4,20 @@ ### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni -| concurrent-tasks | processing time(s) | RTF | Speedup Rate | -|:----------------:|:------------------:|:------:|:------------:| -| 1 (onnx fp32) | 2806 | 0.0777 | 12.9 | -| 1 (onnx int8) | 1611 | 0.0446 | 22.4 | -| 8 (onnx fp32) | 538 | 0.0149 | 67.1 | -| 8 (onnx int8) | 210 | 0.0058 | 172.4 | -| 16 (onnx fp32) | 288 | 0.0080 | 125.2 | -| 16 (onnx int8) | 117 | 0.0032 | 309.9 | -| 32 (onnx fp32) | 167 | 0.0046 | 216.5 | -| 32 (onnx int8) | 107 | 0.0030 | 338.0 | -| 64 (onnx fp32) | 158 | 0.0044 | 228.1 | -| 64 (onnx int8) | 82 | 0.0023 | 442.8 | -| 96 (onnx fp32) | 151 | 0.0042 | 238.0 | -| 96 (onnx int8) | 80 | 0.0022 | 452.0 | +| concurrent-tasks | processing time(s) | RTF | Speedup Rate | +|:----------------:|:------------------:|:-------:|:------------:| +| 1 (onnx fp32) | 2806 | 0.0777 | 12.9 | +| 1 (onnx int8) | 1611 | 0.0446 | 22.4 | +| 8 (onnx fp32) | 538 | 0.0149 | 67.1 | +| 8 (onnx int8) | 210 | 0.0058 | 172.4 | +| 16 (onnx fp32) | 288 | 0.0080 | 125.2 | +| 16 (onnx int8) | 117 | 0.0032 | 309.9 | +| 32 (onnx fp32) | 167 | 0.0046 | 216.5 | +| 32 (onnx int8) | 86 | 0.0024 | 420.0 | +| 64 (onnx fp32) | 158 | 0.0044 | 228.1 | +| 64 (onnx int8) | 82 | 0.0023 | 442.8 | +| 96 (onnx fp32) | 151 | 0.0042 | 238.0 | +| 96 (onnx int8) | 80 | 0.0022 | 452.0 | ### Intel(R) Xeon(R) Platinum 8269CY CPU @ 2.50GHz 16core-32processor with avx512_vnni -- Gitblit v1.9.1