启用长路径支持(需要管理员权限)

Set-ItemProperty -Path “HKLM:\SYSTEM\CurrentControlSet\Control\FileSystem” -Name “LongPathsEnabled” -Value 1 -Type DWord

创建不包含非法字符的临时目录

KaTeX parse error: Expected group after '_' at position 56: …) + "vllm_build_̲(Get-Date -Format ‘yyyyMMddHHmmss’)"
New-Item -ItemType Directory -Path $tempDir -Force | Out-Null

设置环境变量指向临时目录

$env:TEMP = $tempDir
$env:TMP = $tempDir

安装必要的编译依赖

python -m pip install -U setuptools wheel ninja

从源代码安装vllm(需要预先安装CUDA工具链)

git clone https://github.com/vllm-project/vllm.git
cd vllm
pip install -e . --config-settings build-dir=$tempDir

Logo

电影级数字人,免显卡端渲染SDK,十行代码即可调用,工业级demo免费开源下载!

更多推荐