fixed: The choices may be empty. (#876)

### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue)
infiniflow · May 22, 2024 · 21453ff · 21453ff
1 parent be13429
commit 21453ff
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/rag/llm/chat_model.py b/rag/llm/chat_model.py
@@ -56,6 +56,7 @@ def chat_streamly(self, system, history, gen_conf):
                 stream=True,
                 **gen_conf)
             for resp in response:
+                if len(resp.choices) == 0:continue
                 if not resp.choices[0].delta.content:continue
                 ans += resp.choices[0].delta.content
                 total_tokens += 1