Prompt management

Single prompt / Answer generation / Q&A auto-generation

To create the desired output and execute actions using an LLM, prompt management is required. To get started, go to the Settings page and click the Prompt Management tab.

Prompts are classified into three tabs: ① Single Prompt, ② Answer Generation Prompt, and ③ Q&A Auto-generation.

First, let's look at the Single Prompt management tab. Single operates with one prompt.

1. You can view the list of prompts currently available for use.

2. You can delete prompts. 2-1. Prompts for which the delete button is disabled are items provided by default and can only be edited.

3. You can directly modify and edit prompts you created.

4. Click the prompt name or the edit button to view the prompt's detailed contents.

Single prompt details

1. The specified prompt name is displayed.

2. You can enter a description of what role the prompt performs.

3. This is the field for writing the system prompt. The system prompt helps configure the LLM's behavior. For example, you can assign a persona to the LLM model or provide specific instructions on how the LLM should behave throughout the conversation via this prompt.

4. This is the field for writing the user prompt. In the user prompt, you can provide the request or question the LLM should respond to. It is recommended to write queries and questions in the user prompt.

5. You can check how values used for dynamic inputs are specified. Select 'Assign value from variable' to freely specify the value to be substituted, and for pre-entered prompts, they can be automatically assigned by integration with the Alli system. To use dynamic inputs you must use curly braces ({}), but when composing prompts they appear as chips at the bottom, so you can also add them easily by clicking.

Variables registered as dynamic inputs are shown in 'purple' on the screen, while other variables are shown in 'gray'. Add dynamic input A dynamic input is an item whose value can change dynamically. For dynamic inputs, Systemand Skill Two options are provided. – System: An input that is automatically assigned via integration with the Alli system. System dynamic inputs are assigned even for the default prompts provided. – Skill: A dynamic input where you can specify a 'variable' within a skill to input the value to be substituted. Users can assign values to variables that change dynamically using skills, allowing various values to be assigned according to the user's situation and needs.

1. Specify the dynamic input name in the item.

2. Assign the variable value to use

3. You can choose the token truncation ON/OFF option. For variables with long tokens, it is recommended to set the token truncation option to ON.

Now Answer generation prompt tab let’s learn about it.

Answer generation prompts are primarily used in the Answer Generation node and refer to prompts that chain together several prompts needed to generate an answer so they work together.

Default-provided answer generation group prompts cannot be deleted or edited and can only be copied and then edited.

Answer generation prompt details

1. The specified answer generation group prompt name is displayed.

2. You can enter a description of the overall role the answer generation group prompt performs.

3. You can view the list of prompts that are linked together. Clicking the expand button displays the prompt details similarly to a single prompt.

Completed answer generation group prompts can be used in the Answer Generation node and can be configured and applied differently depending on the skill and model.

Finally, let's look at the Q&A auto-generation prompts. These prompts are mainly used when generating Q&A within Knowledge Base > Documents > Q&A generation.

Default-provided Q&A auto-generation group prompts cannot be deleted or edited and can only be copied and then edited.

Q&A auto-generation prompt details

1. The specified Q&A auto-generation group prompt name is displayed.

2. You can enter a description of the overall role the Q&A auto-generation group prompt performs.

3. You can view the list of prompts that are linked together. Clicking the expand button displays the prompt details similarly to a single prompt.

Completed QA GEN group prompts can be used in Knowledge Base > Documents > Q&A Generation tab and can be configured and applied differently depending on the document.

App prompt

Add and manage prompts on the app edit screen

You can write prompts in real time on the app edit screen and apply them to the app immediately. Prompts are divided into the following two scopes.

• App prompt: A prompt that is tied to and used only by a specific app. This is explained in detail in the guide.

• Project prompt: A prompt that can be shared across multiple apps within a single project. For more details, Project prompt please refer to the guide.

1. Adding an app prompt from the app edit screen

1. Select the prompt scope. Choose App prompt.

2. Select the LLM model that will execute the prompt.

3. To use an existing prompt, select the prompt you want from the 'Prompt' dropdown.

1. To create a new prompt, click the + Add button.

1. Add and write the prompt 5-1. Enter the prompt name. 5-2. Enter the prompt description (a description to help distinguish the purpose of the prompt; it does not affect actual execution). 5-3. Enter the system prompt. The system prompt is used to configure the LLM's behavior. For example, you can assign a specific persona to the model or define behavioral guidelines the model should follow throughout the conversation.

   ⚠ When using dynamic inputs in prompts, use curly braces {}without fail.

   5-4. Enter the user prompt In the user prompt, write the request or question the LLM should respond to. Writing queries and questions is recommended. It is optional.

   ⚠ When using dynamic inputs in prompts, use curly braces {}without fail.

   5-5. Add dynamic inputs You can assign variables whose values change dynamically within the prompt.

Add dynamic input

1. Enter the name of the dynamic input item to use within the prompt.

2. Specify the variable value to be assigned to that item. There are two types of variable values that can be assigned to dynamic inputs: system and app.

a. System variable An input that is integrated with the Alli system and automatically receives values.

• EMAIL, LANGUAGE are variables automatically provided by the system.

b. App variable

An option that allows you to specify variables directly within the app and enter their values.

• Input values can be freely assigned according to the situation and needs, and values may change depending on the app's conversation flow.

Add an app variable

1. Enter the variable name.

2. Select the variable type.

• Conversation: The value is stored and applied only within the conversation.

• User: The user's value is stored and applied even after the conversation ends.

1. Select the variable kind. (Total 11 types)

• For more details, Variable value guide can be found.

1. Click the Save button.

2. If necessary, choose the token trimming ON/OFF option. It is recommended to set to ON for variables with long tokens.

2. Managing app prompts

1. Go to Dashboard > Settings > Prompt Management > App page.

At this time, the permissions of members who can access the app page Follow app market or app management access permissionsfollow.

1. All public apps for which the member has viewer or editor permissions and all interactive apps currently being authored will be displayed in the list.

3. App prompt management actions by permission

The app prompt management features behave differently depending on whether the user has viewer or editor permissions for the app.

Members without permissions for the app will not see that app on the prompt management screen.

Conversely, members who have view or edit permissions for the app will see the app listed on the prompt management screen.

When clicking the shortcut button

Clicking the shortcut button allows you to see on the app edit screen which prompts are actually used in which nodes of that app.

If you do not have edit permission for the app, you can only view it.

If you have edit permission for the app, you can switch the app to 'Draft' status and edit it immediately.

When clicking an app's detailed prompt

If you click an app to enter the app prompt screen, a list of prompts created for that app will be shown.

• If you do not have edit permission for the app (only view permission), you cannot directly delete or modify prompts, but you can copy them to another app or copy them so they can be shared in the project.

• If you have edit permission for the app, you can create new prompts, delete, or modify them. However, prompts that are actually in use within the app cannot be changed directly. In that case, you must copy the prompt and then modify it.

Copy to project prompt

Let's copy a prompt that was used in an app to a project prompt that can be shared across all apps in the project and then modify it.

1. Click the Copy to Project Prompt button.

1. You can further edit the copied prompt as needed. You may leave it unchanged; when finished, click the Save button.

1. You can confirm that the prompt that was dependent on the app has been copied into the project as a single project prompt. A prompt copied this way can be used commonly by multiple apps rather than a single app, and it can be selected from the prompt dropdown list in the LLM execution node.

Copy to app prompt

To share a prompt that was used in one app with another app, let's use the app prompt copy feature to copy it to a different app.

1. Click the Copy to App Prompt button.

1. Select the target app to which you want to copy the prompt. For example, TestApp2in Test1 prompt toNEWApp

1. Click the Copy button.

1. You can see that the selected tohas Test1 the prompt copied into it

• At this time, copying is only possible if you have edit permission for the selected app; if you do not have edit permission, a message will be displayed informing you that copying is not possible.

Project prompt

Add and manage prompts on the app edit screen

You can write prompts in real time on the app edit screen and apply them to the app immediately. Prompts are divided into the following two scopes.

• Project prompt: A prompt that can be shared across multiple apps within a single project.

• App prompt: A prompt that is dependent on and used only by a specific app. For details, App prompt please refer to the guide.

1. Add a project prompt from the app edit screen

1. Select the prompt scope. Choose Project Prompt.

2. Select the LLM model that will execute the prompt.

3. To use an existing prompt, select the prompt you want from the 'Prompt' dropdown.

1. To create a new prompt, click the + Add button.

1. Add and write the prompt 5-1. Enter the prompt name. 5-2. Enter the prompt description (a description to help distinguish the purpose of the prompt; it does not affect actual execution). 5-3. Enter the system prompt. The system prompt is used to configure the LLM's behavior. For example, you can assign a specific persona to the model or define behavioral guidelines the model should follow throughout the conversation.

   ⚠ When using dynamic inputs in prompts, use curly braces {}without fail.

   5-4. Enter the user prompt In the user prompt, write the request or question the LLM should respond to. Writing queries and questions is recommended. It is optional.

   ⚠ When using dynamic inputs in prompts, use curly braces {}without fail.

   5-5. Add dynamic inputs You can assign variables whose values change dynamically within the prompt.

Add dynamic input

1. Enter the name of the dynamic input item to use within the prompt.

2. Specify the variable value to be assigned to that item. There are two types of variable values that can be assigned to dynamic inputs: system and app.

a. System variable An input that is integrated with the Alli system and automatically receives values.

• EMAIL, LANGUAGE are variables automatically provided by the system.

b. App variable

An option that allows you to specify variables directly within the app and enter their values.

• Input values can be freely assigned according to the situation and needs, and values may change depending on the app's conversation flow.

Add an app variable

1. Enter the variable name.

2. Select the variable type.

• Conversation: The value is stored and applied only within the conversation.

• User: The user's value is stored and applied even after the conversation ends.

1. Select the variable kind. (Total 11 types)

• For more details, Variable value guide can be found.

1. Click the Save button.

2. If necessary, choose the token trimming ON/OFF option. It is recommended to set to ON for variables with long tokens.

2. Manage project prompts

2-1. Single prompt

The basic type that operates as a single prompt. It can be selected and used in the LLM execution node.

Project prompts can be edited, deleted, and copied by any member with permission on the prompt management page. Also, prompts modified in the management screen are applied immediately to the nodes in use and can be shared across multiple apps. You can also copy a project prompt and use it as an app prompt. For details, App prompt guideplease refer to it.

Add a single prompt and use it in the LLM execution node

Follow the steps below to create a new single prompt and use it in an actual node.

1. Click the Add Prompt button.

1. After writing the necessary content for the prompt, click the Save button.

2. In the app edit screen, select the LLM execution node.

1. Select the prompt scope. Choose Project Prompt.

2. Select the LLM model that will execute the prompt.

3. When you click the prompt dropdown, the prompt you just wrote appears in the list. Select that prompt from the list and click the Apply button.

2-2. Group prompt

A group prompt is a form in which multiple prompts are linked step by step and operate organically.

Group prompts are prompt bundles provided by Alli by default; they cannot be newly created and can only be used by copying and modifying. They are used in answer generation nodes; the prompt settings page does not allow new creation and only supports copying, editing, and deleting.

Edit a group prompt and use it in the answer generation node

Follow the steps below to edit a group prompt and use it in an actual node.

1. Click the Copy Prompt button.

1. Navigate to the step you want to edit in the prompt, then select that step to proceed with editing. Eight steps are chained in total, and clicking each step lets you view details.

*The main step that actually generates the answer is step 5-1; if edits are needed, it is recommended to edit the content of this step.

1. After editing, click the Save button.

2. In the app edit screen, select the answer generation node.

• Select the group prompt.

• Select the LLM model that will execute the prompt.

• When you click the prompt dropdown, the group prompt you just edited appears in the list. Select that prompt from the list and click the Apply button.