Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unify GPTQ dataloader with fixed/unfixed length data #1212

Merged
merged 5 commits into from
Sep 7, 2023
Merged

Conversation

YIYANGCAI
Copy link
Contributor

@YIYANGCAI YIYANGCAI commented Sep 4, 2023

Type of Change

enhance

Description

  • move seqlen attribute to config. (Done)
  • unified the dataloader's form with unfixed/fixed sequence length. (Done)

Expected Behavior & Potential Risk

Normal functions in modified uts

How has this PR been tested?

PreCI

Dependency Change?

None

@chensuyue chensuyue added the enhancement New feature or request label Sep 5, 2023
@chensuyue
Copy link
Contributor

@YIYANGCAI target v2.3 or not?

Signed-off-by: YIYANGCAI <[email protected]>
Signed-off-by: YIYANGCAI <[email protected]>
Signed-off-by: YIYANGCAI <[email protected]>
@xin3he xin3he added this to the v2.3 milestone Sep 7, 2023
@xin3he
Copy link
Contributor

xin3he commented Sep 7, 2023

better in 2.3

@chensuyue chensuyue merged commit 6733681 into master Sep 7, 2023
@chensuyue chensuyue deleted the gptq-datasets branch September 7, 2023 13:48
chensuyue pushed a commit to chensuyue/lpot that referenced this pull request Feb 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants