Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document performance benchmarks #498

Merged
merged 6 commits into from
Nov 15, 2023
Merged

Conversation

sherenem
Copy link
Collaborator

@sherenem sherenem commented Nov 14, 2023

This PR documents performance of H2O LLM Studio based on different hardware setups.
Partially resolves: #448

Copy link
Collaborator

@pascal-pfeiffer pascal-pfeiffer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, lgtm!

just one suggestion to add the units for the time measurements. I missed that in the table in the issue.

documentation/docs/get-started/llm-studio-performance.md Outdated Show resolved Hide resolved
@pascal-pfeiffer pascal-pfeiffer merged commit 0ee6392 into main Nov 15, 2023
5 checks passed
@pascal-pfeiffer pascal-pfeiffer deleted the sm/llm-benchmarks-doc branch November 15, 2023 15:52
@sherenem sherenem self-assigned this Nov 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Benchmark LLM Studio on a10g GPUs
2 participants