pt: support dpa2 model parallel inference #7322
Job | Run time |
---|---|
23s | |
1s | |
5m 27s | |
5m 37s | |
5m 39s | |
3m 8s | |
4m 51s | |
6m 2s | |
8s | |
2m 27s | |
2m 27s | |
0s | |
0s | |
1s | |
36m 11s |
Job | Run time |
---|---|
23s | |
1s | |
5m 27s | |
5m 37s | |
5m 39s | |
3m 8s | |
4m 51s | |
6m 2s | |
8s | |
2m 27s | |
2m 27s | |
0s | |
0s | |
1s | |
36m 11s |