From c2dee5e3c29eba79e591d9e9caebaef15ea4e56b Mon Sep 17 00:00:00 2001 From: hnluo <haoneng.lhn@alibaba-inc.com> Date: 星期四, 29 六月 2023 11:09:28 +0800 Subject: [PATCH] Merge pull request #687 from alibaba-damo-academy/dev_lhn --- funasr/runtime/python/grpc/Readme.md | 40 ++++++++-------------------------------- 1 files changed, 8 insertions(+), 32 deletions(-) diff --git a/funasr/runtime/python/grpc/Readme.md b/funasr/runtime/python/grpc/Readme.md index 996dcdd..832b87e 100644 --- a/funasr/runtime/python/grpc/Readme.md +++ b/funasr/runtime/python/grpc/Readme.md @@ -1,19 +1,17 @@ -# Using paraformer with grpc +# Service with grpc-python We can send streaming audio data to server in real-time with grpc client every 10 ms e.g., and get transcribed text when stop speaking. The audio data is in streaming, the asr inference process is in offline. - - ## For the Server ### Prepare server environment -#### Backend is modelscope pipeline (default) Install the modelscope and funasr ```shell -pip install "modelscope[audio_asr]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html +pip install -U modelscope funasr +# For the users in China, you could install with the command: +# pip install -U modelscope funasr -i https://mirror.sjtu.edu.cn/pypi/web/simple git clone https://github.com/alibaba/FunASR.git && cd FunASR -pip install --editable ./ ``` Install the requirements @@ -23,20 +21,6 @@ pip install -r requirements_server.txt ``` -#### Backend is funasr_onnx (optional) - -Install [`funasr_onnx`](https://github.com/alibaba-damo-academy/FunASR/tree/main/funasr/runtime/python/onnxruntime). - -``` -cd funasr/runtime/python/onnxruntime -python setup.py build -python setup.py install -``` - -Export the model, more details ref to [export docs](https://github.com/alibaba-damo-academy/FunASR/tree/main/funasr/runtime/python/onnxruntime). -```shell -python -m funasr.export.export_model --model-name damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type onnx --quantize True -``` ### Generate protobuf file Run on server, the two generated pb files are both used for server and client @@ -54,17 +38,13 @@ python grpc_main_server.py --port 10095 --backend pipeline ``` -If you want run server with onnxruntime, please set `backend` and `onnx_dir`. -``` -# Start server. -python grpc_main_server.py --port 10095 --backend onnxruntime --onnx_dir /models/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch -``` ## For the client ### Install the requirements ```shell +git clone https://github.com/alibaba/FunASR.git && cd FunASR cd funasr/runtime/python/grpc pip install -r requirements_client.txt ``` @@ -86,12 +66,8 @@ ## Workflow in desgin - +<div align="left"><img src="proto/workflow.png" width="400"/> -## Reference -We borrow from or refer to some code as: - -1)https://github.com/wenet-e2e/wenet/tree/main/runtime/core/grpc - -2)https://github.com/Open-Speech-EkStep/inference_service/blob/main/realtime_inference_service.py \ No newline at end of file +## Acknowledge +1. This project is maintained by [FunASR community](https://github.com/alibaba-damo-academy/FunASR). \ No newline at end of file -- Gitblit v1.9.1