Conversation mode instead completion on Android

[febryituery]

I tried an example for Android and just realized that the generated text is in completion mode. Is there a way for me to switch it to conversation mode?

[febryituery]

up

[zhouwg]

I think this forked llama.cpp project might suit your needs:

https://github.com/kantv-ai/llama.cpp

how to build source code for Android and verify on Qualcomm Snapdragon mobile SoC based Android smartphone:

  git clone https://github.com/kantv-ai/llama.cpp
  cd llama.cpp
  git checkout kantvai-ggmlqnn
  ./scripts/build-run-android.sh build          (it'll setup local build envs automatically and build the entire project)
  ./scripts/build-run-android.sh updateqnnlib   (upload Qualcomm's QNN binary runtime libs to Android phone)
  ./scripts/build-run-android.sh run_llamacli   (running llama-cli in conversation mode on Android pohone )
  ./scripts/build-run-android.sh run_testop     (running test-backend-ops on Android phone)