From 8dab6d184a034ca86eafa644ea0d2100aadfe27d Mon Sep 17 00:00:00 2001 From: jmwang66 <wangjiaming.wjm@alibaba-inc.com> Date: 星期二, 09 五月 2023 10:58:33 +0800 Subject: [PATCH] Merge pull request #473 from alibaba-damo-academy/dev_smohan --- funasr/runtime/python/benchmark_onnx.md | 60 ++++++++++++++++++++++++++++++++++++++++++++++-------------- 1 files changed, 46 insertions(+), 14 deletions(-) diff --git a/funasr/runtime/python/benchmark_onnx.md b/funasr/runtime/python/benchmark_onnx.md index ca7556b..2863ff8 100644 --- a/funasr/runtime/python/benchmark_onnx.md +++ b/funasr/runtime/python/benchmark_onnx.md @@ -1,29 +1,51 @@ -# Benchmark +# CPU Benchmark (ONNX-python) +## Configuration ### Data set: Aishell1 [test set](https://www.openslr.org/33/) , the total audio duration is 36108.919 seconds. ### Tools -- Install ModelScope and FunASR +#### Install Requirements +Install ModelScope and FunASR +```shell +pip install -U modelscope funasr +# For the users in China, you could install with the command: +#pip install -U funasr -i https://mirror.sjtu.edu.cn/pypi/web/simple +``` - ```shell - pip install "modelscope[audio_asr]" --upgrade -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html - git clone https://github.com/alibaba-damo-academy/FunASR.git && cd FunASR - pip install --editable ./ - cd funasr/runtime/python/utils - pip install -r requirements.txt - ``` +Install requirements +```shell +git clone https://github.com/alibaba-damo-academy/FunASR.git && cd FunASR +cd funasr/runtime/python/utils +pip install -r requirements.txt +``` -- recipe +#### Recipe - set the model, data path and output_dir - ```shell - nohup bash test_rtf.sh &> log.txt & - ``` +##### test_rtf +set the model, data path and output_dir +```shell +nohup bash test_rtf.sh &> log.txt & +``` +##### test_cer +set the model, data path and output_dir +```shell +nohup bash test_cer.sh &> log.txt & +``` ## [Paraformer-large](https://www.modelscope.cn/models/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/summary) + +Number of Parameter: 220M + +Storage size: 880MB + +Storage size after int8-quant: 237MB + +CER: 1.95% + +CER after int8-quant: 1.95% ### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni @@ -73,6 +95,16 @@ ## [Paraformer](https://modelscope.cn/models/damo/speech_paraformer_asr_nat-zh-cn-16k-common-vocab8358-tensorflow1/summary) +Number of Parameter: 68M + +Storage size: 275MB + +Storage size after int8-quant: 81MB + +CER: 3.73% + +CER after int8-quant: 3.78% + ### Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni | concurrent-tasks | processing time(s) | RTF | Speedup Rate | -- Gitblit v1.9.1