Skip to content

Commit

Permalink
Fixing black.
Browse files Browse the repository at this point in the history
  • Loading branch information
Narsil committed Aug 12, 2024
1 parent 53f0787 commit 8af42e5
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions server/text_generation_server/models/flash_causal_lm.py
Original file line number Diff line number Diff line change
Expand Up @@ -995,6 +995,7 @@ def __init__(
create_decode_state,
create_prefill_with_paged_kv_state,
)

self.prefill_state = create_prefill_state(device=device)
self.prefill_with_paged_kv_state = create_prefill_with_paged_kv_state(
device=device
Expand Down

0 comments on commit 8af42e5

Please sign in to comment.