| | |
|---|
| | | ## paraformer grpc onnx server |
|---|
| | | ## paraformer grpc onnx server in c++ |
|---|
| | | |
|---|
| | | |
|---|
| | | #### build ../onnxruntime as it's document |
|---|
| | | #### Step 1. Build ../onnxruntime as it's document |
|---|
| | | ``` |
|---|
| | | #put onnx lib and model into /data/asrmodel |
|---|
| | | #put onnx-lib & onnx-asr-model & vocab.txt into /data/asrmodel |
|---|
| | | ls /data/asrmodel/ |
|---|
| | | onnxruntime-linux-x64-1.14.0 speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch |
|---|
| | | |
|---|
| | | file /data/asrmodel/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/vocab.txt |
|---|
| | | UTF-8 Unicode text |
|---|
| | | ``` |
|---|
| | | |
|---|
| | | #### compile and install grpc v1.52.0 in case of grpc bugs |
|---|
| | | #### Step 2. Compile and install grpc v1.52.0 in case of grpc bugs |
|---|
| | | ``` |
|---|
| | | export GRPC_INSTALL_DIR=/data/soft/grpc |
|---|
| | | export PKG_CONFIG_PATH=$GRPC_INSTALL_DIR/lib/pkgconfig |
|---|
| | |
|---|
| | | source ~/.bashrc |
|---|
| | | ``` |
|---|
| | | |
|---|
| | | #### compile grpc onnx paraformer server |
|---|
| | | #### Step 3. Compile and start grpc onnx paraformer server |
|---|
| | | ``` |
|---|
| | | #depends on ../onnxruntime |
|---|
| | | #file vocab.txt : UTF-8 Unicode text |
|---|
| | | |
|---|
| | | ./rebuild.sh |
|---|
| | | ``` |
|---|
| | | |
|---|
| | | |
|---|
| | | |
|---|
| | | #### start grpc python paraformer client on PC with MIC |
|---|
| | | #### Step 4. Start grpc python paraformer client on PC with MIC |
|---|
| | | ``` |
|---|
| | | cd ../python/grpc |
|---|
| | | python grpc_main_client_mic.py --host $server_ip --port 10108 |
|---|
