fix(doc/examples): set defaults to mirostat

[mudler]

The default sampler on some models don't return enough candidates which leads to a false sense of randomness. Tracing back the code it looks that with the temperature sampler there might not be enough candidates to pick from, and since the seed and "randomness" take effect while picking a good candidate this yields to the same results over and over.

Fixes #1723 by updating the examples and documentation to use mirostat instead.

The documentation was also wrong: there was a level of indentation that was breaking the configuration read.

Tested locally:

mudler@zz0t ~/_git/LocalAI mirostat_default*
base ❯ curl http://10.8.0.5:32457/v1/chat/completions -H "Content-Type: application/json" -d '{                                                                    
    "model": "phi-2", "messages": [{"role": "user", "content": "Tell me a story about", "temperature": 1}]                                                                                       
}'
{"created":1710182300,"object":"chat.completion","id":"dca52beb-6d9a-4f7b-8f8c-2c0ec4d48943","model":"phi-2","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"Once upon a time, there was a brave knight named Sir William. He was known throughout the kingdom for his courage and skill with a sword.\n\nOne day, the king called Sir William to the castle and told him about a great threat to the kingdom. A fearsome dragon had been terrorizing the nearby villages, breathing fire and destruction wherever it went.\n\nSir William accepted the king's challenge and set off on a quest to find the dragon and put an end to its reign of terror. He traveled through treacherous forests and climbed steep mountains, determined to save the kingdom from the dragon's wrath.\n\nAfter days of searching, Sir William finally came face to face with the dragon. It was a magnificent creature, with scales as black as night and eyes that glowed with a fiery intensity. The dragon breathed a cloud of smoke, engulfing Sir William and the kingdom in darkness.\n\nWith his sword raised high, Sir William confronted the dragon head-on. They engaged in a fierce battle, each strike and parry filled with power and determination. Sir William dodged the dragon's fiery breath and landed a decisive blow, sending the beast crashing to the ground.\n\nWith the dragon defeated, the kingdom erupted in cheers and celebrations. Sir William was hailed as a hero, and the king rewarded him with riches and lands beyond his wildest dreams.\n\nAnd so, Sir William lived happily ever after, his name forever etched in the annals of the kingdom's history.\n\nEnd of story."}}],"usage":{"prompt_tokens":0,"completion_tokens":0,"total_tokens":0}}
mudler@zz0t ~/_git/LocalAI mirostat_default* 9s
base ❯ curl http://10.8.0.5:32457/v1/chat/completions -H "Content-Type: application/json" -d '{                                                                    
    "model": "phi-2", "messages": [{"role": "user", "content": "Tell me a story about", "temperature": 1}]                                                                                       
}'
{"created":1710182300,"object":"chat.completion","id":"dca52beb-6d9a-4f7b-8f8c-2c0ec4d48943","model":"phi-2","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"Once upon a time, there was a brave knight who lived in a kingdom far away. He was renowned throughout the kingdom for his courage, kind heart, and clever mind. He spent his days wandering through the lush fields and tall trees, singing to himself and admiring the beauty of nature. One day, while he was traversing the forest, he encountered a magical unicorn. The unicorn was magnificent - with a gleaming white coat, a flowing mane, and a graceful presence. The knight was amazed, and begged the unicorn to grant him a wish. The unicorn smiled and said, \"Your wish is my command. Choose wisely, for once granted, it cannot be taken away.\" The knight thought for a moment, then said, \"I wish for peace and justice to prevail throughout the kingdom, so that all may live in harmony.\" The unicorn nodded, and in an instant, the kingdom was transformed. The people were kinder to one another, the rulers were fair in their judgement, and the land was more prosperous than ever. The knight thanked the unicorn, and rode off into the sunset, knowing that his wish had been granted."}}],"usage":{"prompt_tokens":0,"completion_tokens":0,"total_tokens":0}}

name: phi-2
context_size: 2048
f16: false
mmap: false
gpu_layers: 90
trimsuffix: 
- "\n"
parameters:
  model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
  temperature: 1.0
  top_k: 40
  top_p: 0.95
  seed: -1
mirostat: 2
mirostat_eta: 1.0
mirostat_tau: 1.0
template:
  chat: &template |-
    Instruct: {{.Input}}
    Output:
  completion: *template

usage: |
      To use this model, interact with the API (in another terminal) with curl for instance:
      curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
          "model": "phi-2",
          "messages": [{"role": "user", "content": "How are you doing?", "temperature": 0.1}]
      }'

[netlify]

✅ Deploy Preview for localai ready!

Name	Link
🔨 Latest commit	fa4c582
🔍 Latest deploy log	https://app.netlify.com/sites/localai/deploys/65ef520947b7d70008a58cae
😎 Deploy Preview	https://deploy-preview-1820--localai.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.