Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

您好,我想知道对于输入prompt的预处理代码在哪个位置 #121

Open
DnkNju opened this issue Aug 7, 2024 · 1 comment
Open

Comments

@DnkNju
Copy link

DnkNju commented Aug 7, 2024

我通过调试发现模型会首先将 prompt 中双引号部分改为星号。我想知道这部分处理的代码具体在哪里?
另外,这个星号(*)是先和 prompt 其他部分一起做 tokenizer 转为 embeddings,然后双引号内原本的内容单独处理,最后在 embeddings 中作替换吗?

@tyxsspa
Copy link
Owner

tyxsspa commented Aug 9, 2024

在你所下载目录的ms_wrapper.py中;是这样的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants