Natural Language Processing (NLP) enables your Bot to understand user messages and derive meaning from user text inputs. It helps provide context and meaning to user inputs so that the bot can respond appropriately. With NLP, you can “train” your bot on the various possible questions end-users may ask, and suitable responses.
Luma Virtual Agent uses NLP to understand the user's intent and match it to the most relevant skill. It calculates the matching probability or confidence score of each Skill and executes the best match. The Virtual Agent can also parse the user input to extract information and store it in attributes, using synonyms.
Following NLP configurations in Luma Virtual Agent govern how your bot responds to the end-users requests. These settings are out-of-the-box and can be fine-tuned based on your Organization’s need.
Confirmation Threshold
This is the minimum confidence score required to execute a skill without prompting the end-user for confirmation.
Navigate to Bot → Settings → NLP Settings.
Set Confirmation Threshold
On the Disambiguation tab, scroll to Confirmation Settings.
Set Confirmation Threshold between 0.0 to 1.0.
If one or more skills are identified with a confidence score above the configured threshold, the highest matching skill is automatically executed by the bot.
Fallback
The Fallback process occurs when the bot is not able to identify any high confidence matching skills based on the user's phrase. If the confidence score for all the skills falls below this threshold then the Fallback is triggered and the user is encouraged to rephrase their request. Refer to Customize System Skills behavior for more information on the Fallback process.
On Fallback section:
Set Skill Fallback Threshold between 0.0 to 1.0. The threshold should be less than the Confirmation Threshold in the above step.
Set Small Talk Fallback Threshold between 0.0 to 1.0. The threshold is used in matching user phrases with Small Talk and aids Virtual agent to avoid matching the custom-defined service requests with Small Talk in the bot. It is recommended to set the Small Talk threshold value high.
Add Bot response to be shown to the end-user after repeated fallback attempts
Click on Save.
Disambiguation
The Virtual Agent uses Disambiguation settings to resolve ambiguity in case the bot matches the user's phrase to one or more skills above the Skill Fallback Threshold, but is not highly confident to directly execute it. In such a case Bot prompts the user to select the most viable skill to execute.
Follow the below steps to configure the settings:
Navigate to Bot → Settings → NLP Settings → Disambiguation section.
Set Proximity Range. It is used to calculate the confidence range for the skills that are viable for disambiguation. In case of ambiguity, the bot prompts the end-user to choose from the skills falling within this range. For more information, refer to Disambiguation.
Under Suggestion Settings, set the Number of skills to show. It is the maximum number of skills to be presented to the user as an option, during the disambiguation process.
Add Message to be displayed to the user in case of ambiguity.
Verify the Confirmation Threshold.
Set Automate Training With User Responses to Active to enable Automated training for your bot.
Click Save to apply the configuration settings.
Automated Training enables Luma Virtual Agent to train itself when your bot identifies only one skill within the proximity range and the end-user confirms the skill for execution. If Automate Training With User Responses is enabled, the bot automatically associates the user phrase to the selected Skill. This improves the accuracy in matching user phrases to skills in your Tenant.
Refer to Training Luma for more details.