Siri-GPT is an Apple shortcut that provides access to locally running Large Language Models (LLMs) through Siri or the shortcut UI on any Apple device connected to the same network as your host machine. It utilizes Langchain and Ollama.
- Install Ollama for your machine. You need to run
ollama servein the terminal to start the server. - Install Langchain and Flask, then run the app:
Run the Flask app on your machine:
pip install --upgrade --quiet langchain langchain-openai pip install flask
python3 app.py
- On your Apple device, download the shortcut from here.
- Run the shortcut through Siri or the Shortcuts app. The first time you run the shortcut, you will be asked to enter your ip address and the port number.