From ddce9cc8775fad1b2944843f4cd575bac4f4825c Mon Sep 17 00:00:00 2001 From: huangmingming <dyyzhmm@163.com> Date: 星期二, 31 一月 2023 10:07:50 +0800 Subject: [PATCH] update server env --- funasr/runtime/python/grpc/Readme.md | 39 +++++++++++++++++++++++++++++++++------ 1 files changed, 33 insertions(+), 6 deletions(-) diff --git a/funasr/runtime/python/grpc/Readme.md b/funasr/runtime/python/grpc/Readme.md index a27ff5f..46e3f17 100644 --- a/funasr/runtime/python/grpc/Readme.md +++ b/funasr/runtime/python/grpc/Readme.md @@ -1,21 +1,48 @@ -## using paraformer with grpc - +# Using paraformer with grpc We can send streaming audio data to server in real-time with grpc client every 10 ms e.g., and get transcribed text when stop speaking. The audio data is in streaming, the asr inference process is in offline. +## Steps -Step 1) Generate protobuf file for grpc +Step 1) Prepare server environment (on server). ``` +# Install modelscope and funasr, or install with modelscope cuda-docker image. + +# Get into grpc directory. +cd /opt/conda/lib/python3.7/site-packages/funasr/runtime/python/grpc +``` + + +Step 2) Generate protobuf file (for server and client). +``` +# Optional, paraformer_pb2.py and paraformer_pb2_grpc.py are already generated. python -m grpc_tools.protoc --proto_path=./proto -I ./proto --python_out=. --grpc_python_out=./ ./proto/paraformer.proto ``` -Step 2) start grpc server +Step 3) Start grpc server (on server). ``` python grpc_main_server.py --port 10095 ``` -Step 3) start grpc client +Step 4) Start grpc client (on client with microphone). ``` +# Install dependency. Optional. +python -m pip install pyaudio webrtcvad +``` +``` +# Start client. python grpc_main_client_mic.py --host 127.0.0.1 --port 10095 -``` \ No newline at end of file +``` + + +## Workflow in desgin + + + +## Reference +We borrow from or refer to some code as: + +1)https://github.com/wenet-e2e/wenet/tree/main/runtime/core/grpc + +2)https://github.com/Open-Speech-EkStep/inference_service/blob/main/realtime_inference_service.py \ No newline at end of file -- Gitblit v1.9.1