| | |
| | | - pcm_path, `e.g.`: asr_example.pcm, |
| | | - audio bytes stream, `e.g.`: bytes data from a microphone |
| | | - audio sample point,`e.g.`: `audio, rate = soundfile.read("asr_example_zh.wav")`, the dtype is numpy.ndarray or torch.Tensor |
| | | - wav.scp, kaldi style wav list (`wav_id \t wav_path``), `e.g.`: |
| | | - wav.scp, kaldi style wav list (`wav_id \t wav_path`), `e.g.`: |
| | | ```text |
| | | asr_example1 ./audios/asr_example1.wav |
| | | asr_example2 ./audios/asr_example2.wav |
| | |
| | | - `output_dir`: None (Default), the output path of results if set |
| | | |
| | | ### Inference with multi-thread CPUs or multi GPUs |
| | | FunASR also offer recipes [infer.sh](https://github.com/alibaba-damo-academy/FunASR/blob/main/egs_modelscope/asr/TEMPLATE/infer.sh) to decode with multi-thread CPUs, or multi GPUs. |
| | | FunASR also offer recipes [egs_modelscope/asr/TEMPLATE/infer.sh](https://github.com/alibaba-damo-academy/FunASR/blob/main/egs_modelscope/asr/TEMPLATE/infer.sh) to decode with multi-thread CPUs, or multi GPUs. |
| | | |
| | | - Setting parameters in `infer.sh` |
| | | - `model`: model name in [model zoo](https://alibaba-damo-academy.github.io/FunASR/en/modelscope_models.html#pretrained-models-on-modelscope), or model path in local disk |
| | |
| | | - `njob`: only used for CPU inference (`gpu_inference`=`false`), `64` (Default), the number of jobs for CPU decoding |
| | | - `checkpoint_dir`: only used for infer finetuned models, the path dir of finetuned models |
| | | - `checkpoint_name`: only used for infer finetuned models, `valid.cer_ctc.ave.pb` (Default), which checkpoint is used to infer |
| | | - `decoding_mode`: `normal` (Default), decoding mode for UniASR model(fast、normal、offline) |
| | | - `hotword_txt`: `None` (Default), hotword file for contextual paraformer model(the hotword file name ends with .txt") |
| | | |
| | | - Decode with multi GPUs: |
| | | ```shell |
| | |
| | | - `max_epoch`: number of training epoch |
| | | - `lr`: learning rate |
| | | |
| | | - Training data formats: |
| | | ```sh |
| | | cat ./example_data/text |
| | | BAC009S0002W0122 而 对 楼 市 成 交 抑 制 作 用 最 大 的 限 购 |
| | | BAC009S0002W0123 也 成 为 地 方 政 府 的 眼 中 钉 |
| | | english_example_1 hello world |
| | | english_example_2 go swim 去 游 泳 |
| | | |
| | | cat ./example_data/wav.scp |
| | | BAC009S0002W0122 /mnt/data/wav/train/S0002/BAC009S0002W0122.wav |
| | | BAC009S0002W0123 /mnt/data/wav/train/S0002/BAC009S0002W0123.wav |
| | | english_example_1 /mnt/data/wav/train/S0002/english_example_1.wav |
| | | english_example_2 /mnt/data/wav/train/S0002/english_example_2.wav |
| | | ``` |
| | | |
| | | - Then you can run the pipeline to finetune with: |
| | | ```shell |
| | | python finetune.py |
| | |
| | | ``` |
| | | ## Inference with your finetuned model |
| | | |
| | | - Setting parameters in [infer.sh](https://github.com/alibaba-damo-academy/FunASR/blob/main/egs_modelscope/asr/TEMPLATE/infer.sh) is the same with [docs](https://github.com/alibaba-damo-academy/FunASR/tree/main/egs_modelscope/asr/TEMPLATE#inference-with-multi-thread-cpus-or-multi-gpus), `model` is the model name from modelscope, which you finetuned. |
| | | - Setting parameters in [egs_modelscope/asr/TEMPLATE/infer.sh](https://github.com/alibaba-damo-academy/FunASR/blob/main/egs_modelscope/asr/TEMPLATE/infer.sh) is the same with [docs](https://github.com/alibaba-damo-academy/FunASR/tree/main/egs_modelscope/asr/TEMPLATE#inference-with-multi-thread-cpus-or-multi-gpus), `model` is the model name from modelscope, which you finetuned. |
| | | |
| | | - Decode with multi GPUs: |
| | | ```shell |