From 296ec00997d4ad4715286c8dad9cc2226d064b71 Mon Sep 17 00:00:00 2001 From: 游雁 <zhifu.gzf@alibaba-inc.com> Date: 星期日, 07 五月 2023 23:02:56 +0800 Subject: [PATCH] websocket offline --- funasr/runtime/python/websocket/README.md | 44 ++++++++++++++++++++++++++++++-------------- 1 files changed, 30 insertions(+), 14 deletions(-) diff --git a/funasr/runtime/python/websocket/README.md b/funasr/runtime/python/websocket/README.md index 723782f..76405ea 100644 --- a/funasr/runtime/python/websocket/README.md +++ b/funasr/runtime/python/websocket/README.md @@ -1,7 +1,6 @@ -# Using funasr with websocket -We can send streaming audio data to server in real-time with grpc client every 300 ms e.g., and get transcribed text when stop speaking. -The audio data is in streaming, the asr inference process is in offline. +# Service with websocket-python +This is a demo using funasr pipeline with websocket python-api. ## For the Server @@ -23,17 +22,14 @@ ### Start server #### ASR offline server +```shell +python ws_server_offline.py --port 10095 --asr_model "damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch" +``` -[//]: # (```shell) - -[//]: # (python ws_server_online.py --host "0.0.0.0" --port 10095 --asr_model "damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch") - -[//]: # (```) #### ASR streaming server ```shell -python ws_server_online.py --host "0.0.0.0" --port 10095 +python ws_server_online.py --port 10095 --asr_model_online "damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-online" ``` -#### #### ASR offline/online 2pass server @@ -52,13 +48,33 @@ pip install -r requirements_client.txt ``` -Start client - +### Start client +#### ASR offline client +##### Recording from mircrophone +```shell +# --chunk_interval, "10": 600/10=60ms, "5"=600/5=120ms, "20": 600/12=30ms +python ws_client.py --host "0.0.0.0" --port 10095 --chunk_interval 10 --words_max_print 100 +``` +##### Loadding from wav.scp(kaldi style) +```shell +# --chunk_interval, "10": 600/10=60ms, "5"=600/5=120ms, "20": 600/12=30ms +python ws_client.py --host "0.0.0.0" --port 10095 --chunk_interval 10 --words_max_print 100 --audio_in "./data/wav.scp" --send_without_sleep +``` +#### ASR streaming client +##### Recording from mircrophone ```shell # --chunk_size, "5,10,5"=600ms, "8,8,4"=480ms -python ws_client.py --host "127.0.0.1" --port 10096 --chunk_size "5,10,5" +python ws_client.py --host "0.0.0.0" --port 10095 --chunk_size "5,10,5" --words_max_print 100 ``` +##### Loadding from wav.scp(kaldi style) +```shell +# --chunk_size, "5,10,5"=600ms, "8,8,4"=480ms +python ws_client.py --host "0.0.0.0" --port 10095 --chunk_size "5,10,5" --audio_in "./data/wav.scp" --words_max_print 100 +``` + +#### ASR offline/online 2pass client ## Acknowledge 1. This project is maintained by [FunASR community](https://github.com/alibaba-damo-academy/FunASR). -2. We acknowledge [cgisky1980](https://github.com/cgisky1980/FunASR) for contributing the websocket service. +2. We acknowledge [zhaoming](https://github.com/zhaomingwork/FunASR/tree/fix_bug_for_python_websocket) for contributing the websocket service. +3. We acknowledge [cgisky1980](https://github.com/cgisky1980/FunASR) for contributing the websocket service of offline model. -- Gitblit v1.9.1