Skip to content

Issues: microsoft/T-MAC

T-MAC 1.0.0 Release Plan
#45 opened Sep 14, 2024 by kaleid-liner
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 34 Closed
27 Open 34 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

how to convert bitnet model? looks like the script is broken
#81 opened Dec 27, 2024 by nigelzzzzz
4
Support Mixtral .etc MoE models
#80 opened Dec 27, 2024 by BodhiHu
Using T-MAC is slower than original llama.cpp
#79 opened Dec 18, 2024 by xdd130
3
T-MAC reports an error when using the qwen2.5 3-bit model
#76 opened Dec 4, 2024 by xdd130
4
running Qwen2-7B-Instruct-GPTQ-Int4 reported an error
#75 opened Nov 28, 2024 by sunj0104
5
没看懂论文Alogrithm1 逻辑
#73 opened Nov 24, 2024 by dujifeng
8
论文描述和Algorithm1表述不一致
#72 opened Nov 24, 2024 by dujifeng
1
The perplexity tool returns abnormal values
#70 opened Nov 11, 2024 by ppp-max
4
Request for Documentation on LUT Quantization Theory and Generation Methods for LUT_Biases and LUT_Scales question Further information is requested
#67 opened Oct 29, 2024 by zhouexellent
1
The perplexity tool returns unexpected ppl results
#65 opened Oct 18, 2024 by fefang
1
Why is there no difference in the E2E performance of T-MAC and llama.cpp on arm machine?
#61 opened Oct 11, 2024 by ppp-max
3
about gptq quantization tricks
#59 opened Oct 11, 2024 by sinoaidi
The log is stuck on the "running build_py" line for 2 hours， is this normal? question Further information is requested
#56 opened Oct 9, 2024 by sunj0104
10
Andorid tune kernel question question Further information is requested
#53 opened Sep 26, 2024 by qw1319
8
Does the speed performance have anything to do with the shape of the multiplication matrix? Why is the matrix multiplication of [34,2048]*[2048,5632] much faster than the matrix multiplication of [34,5632]*[5632,2048]? They have the same FLOPs. question Further information is requested
#48 opened Sep 23, 2024 by lijianxing123
1
T-MAC 1.0.0 Release Plan enhancement New feature or request
#45 opened Sep 14, 2024 by kaleid-liner
@kaleid-liner @QingtaoLi1
Whether the T-MAC supports the RISC-V CPU？ enhancement New feature or request
#41 opened Sep 8, 2024 by velonica0
1
Slow performance compared to llama.cpp origin question Further information is requested
#40 opened Sep 6, 2024 by idreamerhx
7
performance on mobile phone such as MTK D9000/D8300 or Qualcomm 8Gen3 duplicate This issue or pull request already exists
#39 opened Sep 4, 2024 by yuimo
2
[Question]Whether T-MAC supports mixed-precision LLM?
#38 opened Sep 3, 2024 by AndreaChiChengdu
2
8gen3 T-MAC cpu performance issue enhancement New feature or request good first issue Good for newcomers
#32 opened Aug 29, 2024 by AndreaChiChengdu
9
How to Fully Utilize the Optimized Performance of T-MAC ? question Further information is requested
#30 opened Aug 28, 2024 by ma-hang
2
OpenAI compatible chat completions endpoint
#28 opened Aug 24, 2024 by maxim-saplin
9
ubuntu installation problem on Google colab bug Something isn't working
#26 opened Aug 20, 2024 by amirhosein-darmani
26
Any plans to merge the latest code of llama.cpp?
#24 opened Aug 20, 2024 by peytoncai
21
ProTip! Updated in the last three days: updated:>2025-01-01.