ChatGLM & LangChain
参考: https://www.luckzym.com/posts/e95da08c/#more
环境准备
Win11
linux 子系统 wsl2
Ubuntu22.04子系统
Docker for windows
ChatGLM 项目模型下载
显卡 4070 12G
内存 16G*2
cpu 13600kf
nvidia-docker安装
https://juejin.cn/s/windows%20nvidia-docker%E5%AE%89%E8%A3%85
# Add the package repositories
curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | \
sudo apt-key add -
distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | \
sudo tee /etc/apt/sources.list.d/nvidia-docker.list
sudo apt-get update
# Install nvidia-docker2 and reload the Docker daemon configuration
sudo apt-get install -y nvidia-docker2
需要修改文件 /etc/docker/daemon.json runtimes
$ cat /etc/docker/daemon.json
{
"runtimes": {
"nvidia": {
"path": "nvidia-container-runtime",
"runtimeArgs": []
}
}
}
我虽然用的是Docker for window,但是是docker运行在ubuntu子系统中。可以在子系统中修改,也可以在Docker for window 中的设置 Docker Engine中修改上述内容。
……