Release notes for 0.4

[simonw]

No description provided.

[simonw]

Make sure to mention this as the upgrade path:

cp ~/.llm/log.db "$(llm logs path)"
rm -rf ~/.llm

[simonw]

0.3...392f865

[simonw]

Changelog now lives here: https://llm.datasette.io/en/latest/changelog.html

[simonw]

• Improved display of error messages from OpenAI. #15

Continue previous chat

You can now use llm to continue a previous conversation with the OpenAI chat models (gpt-3.5-turbo and gpt-4). This will include your previous prompts and responses in the prompt sent to the API, allowing the model to continue within the same context.

Use the new -c/--continue option to continue from the previous message thread:

llm "Pretend to be a witty gerbil, say hi briefly"

Greetings, dear human! I am a clever gerbil, ready to entertain you with my quick wit and endless energy.

llm "What do you think of snacks?" -c

Oh, how I adore snacks, dear human! Crunchy carrot sticks, sweet apple slices, and chewy yogurt drops are some of my favorite treats. I could nibble on them all day long!

The -c option will continue from the most recent logged message.

To continue a different chat, pass an integer ID to the --chat option. This should be the ID of a previously logged message. You can find these IDs using the llm logs command.

Thanks Amjith Ramanujam for contributing to this feature. #6

[simonw]

Need to talk about the new location of log.db and how to upgrade to it, and mention the schema changes - and the llm logs --truncate option.

[simonw]

New llm logs --truncate option (shortcut -t) which truncates the displayed prompts to make the log output easier to read. #16

[simonw]

Documentation now spans multiple pages and lives at https://llm.datasette.io/ #21

[simonw]

New mechanism for storing API keys

API keys for language models such as those by OpenAI can now be saved using the new llm keys family of commands.

To set the default key to be used for the OpenAI APIs, run this:

llm keys set openai

Then paste in your API key.

Keys can also be passed using the new --key command line option - this can be a full key or the alias of a key that has been previously stored.

See link-to-docs for more. #13

[simonw]

• Default llm chatgpt command has been renamed to llm prompt. #17
• Removed --code option in favour of new prompt templates mechanism. #24
• Responses are now streamed by default, if the model supports streaming. The -s/--stream option has been removed. A new --no-stream option can be used to opt-out of streaming. #25
• The -4/--gpt4 option has been removed in favour of -m 4 or -m gpt4, using a new mechanism that allows models to have additional short names.

[simonw]

New location for the log.db database

The log.db database that stores a history of executed prompts no longer lives at ~/.llm/log.db - it can now be found in a location that better fits the host operating system, which can be seen using:

llm logs path

On macOS this is ~/Library/Application Support/io.datasette.llm/log.db.

To open that database using Datasette, run this:

datasette "$(llm logs path)"

You can upgrade your existing installation by copying your database to the new location like this:

cp ~/.llm/log.db "$(llm logs path)"
rm -rf ~/.llm # To tidy up the now obsolete directory

The database schema has changed, and will be updated automatically the first time you run the command.

That schema is included in the documentation. #35