fix: Gemini not reaching end state

[willheryanto]

Fixes #1024

How to test?

Reference: https://github.com/google/generative-ai-docs/blob/main/site/en/gemini-api/docs/get-started/rest.ipynb

Running the following curl:

curl "https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:streamGenerateContent?alt=sse&key=$GEMINI_API_KEY" \
     -H 'Content-Type: application/json' \
     --no-buffer \
     -d '{ "contents":[{"parts":[{"text": "Write long a story about a magic backpack."}]}]}'

Response:

data: {"candidates": [{"content": {"parts": [{"text": "Hidden amidst a world of ordinary backpacks, there existed an extraordinary one, imbued with"}],"role": "model"},"index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 16,"totalTokenCount": 25},"modelVersion": "gemini-pro"}

data: {"candidates": [{"content": {"parts": [{"text": " a power that would forever alter the life of its young owner, Emily. Crafted from an ancient tapestry that shimmered under the moonlight, it held secrets that only"}],"role": "model"},"index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 48,"totalTokenCount": 57},"modelVersion": "gemini-pro"}

data: {"candidates": [{"content": {"parts": [{"text": " the deserving could unlock.\n\nAs fate would have it, Emily stumbled upon this enigmatic backpack at a dusty old thrift store. Its weathered exterior concealed an aura of mystery that drew her in like a moth to a flame. Little did she know that this seemingly innocuous object would become the catalyst for an extraordinary journey beyond her"}],"role": "model"},"index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "LOW"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 112,"totalTokenCount": 121},"modelVersion": "gemini-pro"}

data: {"candidates": [{"content": {"parts": [{"text": " wildest dreams.\n\nWith each step she took, the backpack hummed with anticipation, its leather straps whispering secrets only Emily could hear. Its compartments, once empty, began to fill with an assortment of curious items—an ancient compass that always pointed towards adventure, a journal that recorded her thoughts and dreams, and a kaleidoscope that transformed the ordinary into the extraordinary.\n\nSoon, Emily realized that her ordinary life had been transformed into a grand tapestry woven with threads of magic and wonder. The backpack became her trusted companion, guiding her through hidden forests and forgotten ruins, opening doors to realms where imagination soared.\n\nOne fateful evening, as the"}],"role": "model"},"index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 241,"totalTokenCount": 250},"modelVersion": "gemini-pro"}

data: {"candidates": [{"content": {"parts": [{"text": " stars twinkled above, Emily found herself in a forgotten library, its shelves filled with dusty tomes and ancient scrolls. As she reached out to touch one of the books, the backpack sprang to life, its compartments opening to reveal a vast library of knowledge and forbidden spells.\n\nOverwhelmed by the revelation, Emily delved into the backpack's secrets, studying ancient languages and unlocking hidden powers. With each page she turned, her mind expanded with wisdom and her spirit grew stronger. The backpack became her oracle, guiding her choices and shaping her destiny.\n\nAs time went on, Emily's adventures became legendary. She traveled to distant lands, met extraordinary creatures, and faced challenges that tested her courage and resilience. The backpack was always by her side, a constant reminder of the endless possibilities that lay ahead.\n\nBut with great power came great responsibility. Emily understood that the backpack's secrets were not meant for selfish gain, but to be used for the greater good. She became a guardian of knowledge, sharing her wisdom with those who sought it and using her newfound abilities to protect the innocent.\n\nAnd so, Emily's journey continued, her magic backpack guiding her every step. Together, they became a symbol of hope and wonder, inspiring countless others to unlock their own"}],"role": "model"},"index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 497,"totalTokenCount": 506},"modelVersion": "gemini-pro"}

data: {"candidates": [{"content": {"parts": [{"text": " hidden potential and embark on extraordinary adventures of their own.\n\nAnd as the years turned into decades, the magic backpack became a cherished heirloom, passed down from generation to generation, a testament to the transformative power of imagination and the enduring bond between a girl and her extraordinary companion."}],"role": "model"},"finishReason": "STOP","index": 0,"safetyRatings": [{"category": "HARM_CATEGORY_SEXUALLY_EXPLICIT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HATE_SPEECH","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_HARASSMENT","probability": "NEGLIGIBLE"},{"category": "HARM_CATEGORY_DANGEROUS_CONTENT","probability": "NEGLIGIBLE"}]}],"usageMetadata": {"promptTokenCount": 9,"candidatesTokenCount": 552,"totalTokenCount": 561},"modelVersion": "gemini-pro"}

[willheryanto]

Hi @yetone, please kindly help to review this when you have time. This fixes the issue that I raised.

Thanks!