A chat bot made with phi 3 - (work in progress)

[elephantpanda]

Here is a little chatbot I made which I upgraded to use the Phi-3 mini int4 (previously it had used Cerebras). It uses the genai API.

It can tell stories too, but because it was trained on so much scientific stuff it tends to be a bit serious. But it probably needs a bit more prompt engineering.

Here it is telling a fishy story:

[natke]

This is so cool @elephantpanda!

[elephantpanda]

This is so cool @elephantpanda!

Thanks! It's made in Unity with C# genai and DirectML. The phi3 int4 model was just the right size and speed to make this viable offline.
Phi 3 is a little serious - I think it must have not been trained on enough natural conversations like social media etc. But it's OK.
Only things in terms of genai that's holding me back is this bug which can make it randomly stop working. But hopefully that will be fixed.
And in the meantime I can add new features like having two characters talk to each other.
Also, I got to think of a way to test it on different GPUs.