Skip to content

dlinfer release v0.1.3.post1

Latest
Latest
Compare
Choose a tag to compare
@jinminxi104 jinminxi104 released this 11 Dec 06:33
· 10 commits to main since this release
v0.1.3.post1
df4f81b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

  • 华为

    • 支持int8的kv cache
    • 修复w4a16方面的bug

  • 沐曦

    • 支持w4a16
    • 支持多种数据排布的Linear计算
    • 支持最新沐曦软件栈
    • 修复多轮对话
Assets 2
Loading