If custom tasks utilizing an LLM are desired, this is where they can be accomplished. For example, let’s say we want the document re-written in a different style. We can utilize custom prompts to accomplish this task. To begin, let’s look at Prompt Management. Navigate to the Settings page.

1. Search the prompts by name or content
2. View the list of available prompts
3. View the details on a prompt
4. Delete the prompt – Prompts with the delete button disabled are provided by default and cannot be removed
5. Edit the prompt
6. Create a new prompt

If we click on “Details” for a prompt, the below information is given.

1. Prompt name
2. The content of the prompt. This is where we can view what task this prompt is going to perform. For the above prompt, we are creating 5 Q&A’s for a given document.
3. Dynamic input allows for project variables to be added to a prompt. For this example, we are taking into account the language settings for the project as well as content from the document this prompt will be generating content from. Prompts have a limit on the length of tokens. And there are two options available Clip Tokens (ON/OFF). You may use clip tokens to determine whether you want to adjust the token length for variables with dynamic input. (When this option is turned on, adjust the length when the prompt exceeds the token limit).
4. Edit or Delete the prompt.

Now, let’s click on “Add Prompt”

To create a custom prompt to make a claims message for example, let’s fill out the information needed.

1. Name your prompt.
2. Give a description of what the prompt will be tasked with completing.
3. Add content for the prompt. Always be as concise and clear with the actions you would like to have performed.
   1. System prompts help you define the behavior of the LLM. For example, you can give your LLM model a persona or provide specific instructions on how your LLM model should behave throughout the conversation.
   2. User prompts provide the instructions for a request or question for the LLM to respond to.
4. Add dynamic inputs if needed. We are leaving it blank because the content of the document will be added automatically if there is no input so it is not needed in this case.
5. View the list of variables for the project as well as create a new one.
6. Cancel or Submit the new prompt at the bottom.

Adding Dynamic Inputs #

If you must add variables to a prompt, dynamic inputs allow the addition of these variables. They can be custom or system variables available to a specific project. To begin, click “Add” for Dynamic Input.

Within this window, we can name our input and assign a variable from the project to it as shown below.

Clip Tokens (ON/OFF). You may use clip tokens to determine whether you want to adjust the token length for variables with dynamic input. (When this option is turned on, adjust the length when the prompt exceeds the token limit). Once we are happy with the input, we can add it to the prompt.

In order to add it to the prompt, we must include the input within brackets {}. For example { test_item }.

Group Prompt Settings #

1. Duplicate the prompt group
2. Delete the prompt group
3. Edit the prompt group

Default groups cannot be deleted, however they can be duplicated or edited.

A group can be viewed by clicking on the group prompt to see a breakdown of the prompts within it.

1. Prompt group name
2. Add a description of what the group does
3. The individual prompts within the group
4. Edit a prompt

Editing the prompt follows the same concepts as discussed above.