Skip to content

zixiiu/Digital_Life_Server

Repository files navigation

Digital Life Server

这是「数字生命」服务部分代码。包括与前端通信,语音识别,chatGPT接入和语音合成。
For other part of the project, please refer to:
Launcher 启动此服务器的图形界面。
UE Client 用于渲染人物动画,录音,和播放声音的前端部分。
详细的配置流程可参见readme_detail.md

Getting stuffs ready to roll:

Clone this repo

git clone https://github.com/zixiiu/Digital_Life_Server.git --recursive

Install prerequisites

  1. install pytorch

    pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
  2. install other requirements

    pip install -r requirements.txt
  3. Build monotonic_align
    This may not work that well but you know what that suppose to mean.

    cd "TTS/vits/monotonic_align"
    mkdir monotonic_align
    python setup.py build_ext --inplace
    cp monotonic_align/*.pyd .
  4. Download models
    百度网盘
    ASR Model:
    to /ASR/resources/models
    Sentiment Model:
    to /SentimentEngine/models
    TTS Model:
    to /TTS/models

  5. (对于没有Nvidia显卡的电脑,采用cpu来跑的话)需要额外做一步:

    ​ 将 Digital_Life_Server\TTS\TTService.py 文件下 36行

    self.net_g = SynthesizerTrn(...).cuda()
    修改为
    self.net_g = SynthesizerTrn(...).cpu()
    

    到这里,项目构建完毕🥰

Start the server

run-gpt3.5-api.bat