From bc723ea200144bd6fa8a5dff4b9a780feda144fc Mon Sep 17 00:00:00 2001 From: 游雁 <zhifu.gzf@alibaba-inc.com> Date: 星期四, 29 六月 2023 18:55:01 +0800 Subject: [PATCH] dcos --- funasr/runtime/python/benchmark_libtorch.md | 53 +++++++++++++++++++++++++---------------------------- 1 files changed, 25 insertions(+), 28 deletions(-) diff --git a/funasr/runtime/python/benchmark_libtorch.md b/funasr/runtime/python/benchmark_libtorch.md index 7dbc2c7..2aafe25 100644 --- a/funasr/runtime/python/benchmark_libtorch.md +++ b/funasr/runtime/python/benchmark_libtorch.md @@ -1,56 +1,53 @@ -# Benchmark +# CPU Benchmark (Libtorch) +## Configuration ### Data set: Aishell1 [test set](https://www.openslr.org/33/) , the total audio duration is 36108.919 seconds. ### Tools -- Install +#### Install Requirements +Install ModelScope and FunASR +```shell +pip install -U modelscope funasr +# For the users in China, you could install with the command: +#pip install -U funasr -i https://mirror.sjtu.edu.cn/pypi/web/simple +``` + +Install requirements ```shell git clone https://github.com/alibaba-damo-academy/FunASR.git && cd FunASR -pip install --editable ./ cd funasr/runtime/python/utils pip install -r requirements.txt ``` -- recipe -set the model, data path and output_dir +#### Recipe +##### test_rtf +set the model, data path and output_dir ```shell nohup bash test_rtf.sh &> log.txt & ``` +##### test_cer +set the model, data path and output_dir +```shell +nohup bash test_cer.sh &> log.txt & +``` + ## [Paraformer-large](https://www.modelscope.cn/models/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/summary) - -### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni - -[//]: # (| concurrent-tasks | processing time(s) | RTF | Speedup Rate |) - -[//]: # (|:----------------:|:------------------:|:------:|:------------:|) - -[//]: # (| 1 (torch fp32) | 3522 | 0.0976 | 10.3 |) - -[//]: # (| 1 (torch int8) | 1746 | 0.0484 | 20.7 |) - -[//]: # (| 32 (torch fp32) | 236 | 0.0066 | 152.7 |) - -[//]: # (| 32 (torch int8) | 114 | 0.0032 | 317.4 |) - -[//]: # (| 64 (torch fp32) | 235 | 0.0065 | 153.7 |) - -[//]: # (| 64 (torch int8) | 113 | 0.0031 | 319.2 |) ### Intel(R) Xeon(R) Platinum 8269CY CPU @ 2.50GHz 16core-32processor with avx512_vnni | concurrent-tasks | processing time(s) | RTF | Speedup Rate | |:----------------:|:------------------:|:------:|:------------:| -| 1 (torch fp32) | 3522 | 0.0976 | 10.3 | +| 1 (torch fp32) | 3522 | 0.0976 | 10.3 | | 1 (torch int8) | 1746 | 0.0484 | 20.7 | -| 32 (torch fp32) | 236 | 0.0066 | 152.7 | -| 32 (torch int8) | 114 | 0.0032 | 317.4 | -| 64 (torch fp32) | 235 | 0.0065 | 153.7 | -| 64 (torch int8) | 113 | 0.0031 | 319.2 | +| 32 (torch fp32) | 236 | 0.0066 | 152.7 | +| 32 (torch int8) | 114 | 0.0032 | 317.4 | +| 64 (torch fp32) | 235 | 0.0065 | 153.7 | +| 64 (torch int8) | 113 | 0.0031 | 319.2 | [//]: # (### Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz 32core-64processor without avx512_vnni) -- Gitblit v1.9.1