Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Context control commands #31

Open
RossBencina opened this issue Sep 1, 2023 · 0 comments
Open

Context control commands #31

RossBencina opened this issue Sep 1, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@RossBencina
Copy link
Member

RossBencina commented Sep 1, 2023

Context control refers to the ability for the user to control which parts of the input file gets sent to the LLM as part of the input prompt (the context).

Current Status

In Prapti, the default behavior is that text prior to the first message heading belongs to the hidden @_head message which, like all hidden messages, is not sent to the LLM. All other non-hidden, non-disabled messages are sent to the LLM. (Recall, hidden messages have roles starting with an underscore, e.g. ### @_user and disabled messages have the form ### //@user see the docs for more info.)

Ideas

Some combination of the following context control commands are desirable (i.e. our users, or users of other systems have requested them or found them useful).

  • %reset / %clear / %restart / %discard:
    discard all previous prompts (not sure of good name)

  • %isolate:
    only submit the current message

  • %isolate-push isolate-pop
    conduct a nested isolated conversation that begins with isolate-push and ends with isolate-pop. while isolate-push is active only messages in that conversation are sent to the LLM. after isolate-pop, those messages are no longer sent to the LLM

  • %always-isolate
    a persistent mode where every input message is isolated (submitted by itself)

Typically the above would only control ### @user messages you'd want to retain the system prompt. But maybe there are cases where you'd want to control the system prompt too?

@RossBencina RossBencina added the enhancement New feature or request label Sep 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant