From 8f26a9acc2461ce0c77eacc3d36d3cef3457f520 Mon Sep 17 00:00:00 2001 From: speech_asr <wangjiaming.wjm@alibaba-inc.com> Date: 星期三, 29 三月 2023 15:49:46 +0800 Subject: [PATCH] Merge branch 'dev_wjm' of https://github.com/alibaba/FunASR into dev_wjm --- funasr/runtime/grpc/Readme.md | 17 +++++++++-------- 1 files changed, 9 insertions(+), 8 deletions(-) diff --git a/funasr/runtime/grpc/Readme.md b/funasr/runtime/grpc/Readme.md index 80e55aa..6e3516a 100644 --- a/funasr/runtime/grpc/Readme.md +++ b/funasr/runtime/grpc/Readme.md @@ -1,14 +1,13 @@ ## paraformer grpc onnx server in c++ - #### Step 1. Build ../onnxruntime as it's document ``` -#put onnx-lib & onnx-asr-model & vocab.txt into /path/to/asrmodel(eg: /data/asrmodel) +#put onnx-lib & onnx-asr-model into /path/to/asrmodel(eg: /data/asrmodel) ls /data/asrmodel/ onnxruntime-linux-x64-1.14.0 speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch -file /data/asrmodel/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/vocab.txt -UTF-8 Unicode text +#make sure you have config.yaml, am.mvn, model.onnx(or model_quant.onnx) under speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch + ``` #### Step 2. Compile and install grpc v1.52.0 in case of grpc bugs @@ -44,14 +43,16 @@ #### Step 4. Start grpc paraformer server ``` -Usage: ./cmake/build/paraformer_server port thread_num /path/to/model_file -./cmake/build/paraformer_server 10108 4 /data/asrmodel/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch +Usage: ./cmake/build/paraformer_server port thread_num /path/to/model_file quantize(true or false) +./cmake/build/paraformer_server 10108 4 /data/asrmodel/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch false ``` - - #### Step 5. Start grpc python paraformer client on PC with MIC ``` cd ../python/grpc python grpc_main_client_mic.py --host $server_ip --port 10108 ``` + +## Acknowledge +1. This project is maintained by [FunASR community](https://github.com/alibaba-damo-academy/FunASR). +2. We acknowledge [DeepScience](https://www.deepscience.cn) for contributing the grpc service. -- Gitblit v1.9.1