Skip to content

Commit

Permalink
Update numbers for Habana Gaudi in documentation (open-mmlab#2734)
Browse files Browse the repository at this point in the history
Update numbers for Habana Gaudi in doc
  • Loading branch information
regisss authored Mar 21, 2023
1 parent 73bdad0 commit c10d685
Showing 1 changed file with 7 additions and 7 deletions.
14 changes: 7 additions & 7 deletions docs/source/en/optimization/habana.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ specific language governing permissions and limitations under the License.

## Requirements

- Optimum Habana 1.3 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
- SynapseAI 1.7.
- Optimum Habana 1.4 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
- SynapseAI 1.8.


## Inference Pipeline
Expand Down Expand Up @@ -62,9 +62,9 @@ For more information, check out Optimum Habana's [documentation](https://hugging

## Benchmark

Here are the latencies for Habana Gaudi 1 and Gaudi 2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32):
Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32):

| | Latency | Batch size |
| ------- |:-------:|:----------:|
| Gaudi 1 | 4.37s | 4/8 |
| Gaudi 2 | 1.19s | 4/8 |
| | Latency (batch size = 1) | Throughput (batch size = 8) |
| ---------------------- |:------------------------:|:---------------------------:|
| first-generation Gaudi | 4.29s | 0.283 images/s |
| Gaudi2 | 1.54s | 0.904 images/s |

0 comments on commit c10d685

Please sign in to comment.