Skip to content

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) #412

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses)

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) #412

Annotations

5 warnings

bench-server-baseline (phi-2, q4_0)

succeeded Apr 11, 2024 in 13m 38s