Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llama3 and phi3 validation result update. #79

Merged
merged 2 commits into from
May 30, 2024

Conversation

yao531441
Copy link
Collaborator

Description

Validate new LLM model(LLaMA3 8B, Phi 3, LLaMA3 70B) run on TGI-Gaudi

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Document refine.

Dependencies

No newly introduced 3rd party dependency.

Tests

LLaMA3 8B
image
Phi 3
image
LLaMA3 70B
image

comps/llms/README.md Outdated Show resolved Hide resolved
@yao531441 yao531441 marked this pull request as draft May 23, 2024 01:43
@yao531441
Copy link
Collaborator Author

Change the PR status to Draft, next step I will validate vllm-cpu and ray

@yao531441 yao531441 changed the title Llama3 and phi3 tgi-gaudi validation result update. Llama3 and phi3 validation result update. May 28, 2024
@yao531441
Copy link
Collaborator Author

Finished the validation on Ray and vllm-CPU.
The issue found in the verification: #98

@yao531441 yao531441 marked this pull request as ready for review May 28, 2024 06:00
@lvliang-intel lvliang-intel merged commit 3986c4f into opea-project:main May 30, 2024
2 checks passed
ganesanintel pushed a commit to ganesanintel/GenAIComps that referenced this pull request Jun 3, 2024
* Llama3 and Phi3 validation results update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <[email protected]>
lkk12014402 pushed a commit that referenced this pull request Aug 8, 2024
Signed-off-by: Yue, Wenjiao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants