The Advanced AI Settings page is where Super Admins can fine-tune some of the AI behaviors in their community site without the need for code changes.
There are response behaviors settings that are configured in:
- Response Instructions
- Response Confidence
The content relevance settings are configured in:
- Content Relevance by Time
- Content Relevance by Source
Current AI behavior
The current behavior of Higher Logic's AI is based on a default fixed combination of:
- what it pays attention to and prioritizes,
- how it values old content vs. new content, and
- how it "sounds" in its responses.
Limitations of the default behaviors
This default combination of behaviors does not allow for more granular customizations for customers based on their unique content profiles and governance needs. For example, customers cannot:
- Prioritize recent content over legacy posts in a controlled way.
- Tune how aggressively older content decays in relevance.
- Adjust how much the Agent or Assistant values different content sources (e.g., discussions vs knowledge base vs external documents).
- Provide additional structured prompting to align behavior with brand, audience, or use case.
- Decide whether these settings apply globally to the Core AI Assistant or are scoped to a specific Agent.
Benefits of the advanced settings
The set of advanced AI settings are intended to:
- increase your trust in our AI functionality,
- boost the relevance of your own community content, and
- give Super Admins more control over the use of their community content.
Access the AI advanced settings
To access the settings:
- In the Admin Toolbar, click Admin.
- Navigate to AI Features > Advanced AI Settings.
The Advanced AI Settings page opens.
The sections that follow describe the advanced settings and how to configure them.
AI Agent and Assistants
You can manage the advanced settings for your custom AI Search Agents (created on the AI Features > AI Search Agents page) and for AI Assistants.
- Click the dropdown and select an AI Search Agent or an AI Assistant to manage its settings.
NOTE: As the "fail-safe" Search Agent that cannot be edited, Standard Search Agent is not available to be configured on this page.
Response Instructions
Use this section to guide the Agent or Assistant on how to respond to users' interactions.
EXAMPLE: You could instruct the Agent or Assistant to provide brief answers in an informal tone and to favor product documentation over the content of community discussions.
- Click into the field and specify your response instructions.
NOTE: The Additional Prompt Instructions field aligns with the Additional Instructions field when creating and editing AI Search Agents on the AI Features > AI Search Agents page. Whatever instructions are set for one of these fields is automatically applied to the other field.
Configure additional settings on the page or scroll to the bottom of the page and click Save changes.
Response Confidence
Use this section to set a minimum confidence score and to specify a custom "no answer" message for the Agent or Assistant to display to users when it is unable to provide an answer.
Refer to Understand Minimum Confidence Score in this section for configuration notes.
- Accept the default setting of 1 (minimal confidence required to use the content) or click on the confidence bar (or click-&-drag the slider) to set the minimum score.
TIP: Click the refresh icon to automatically restore the default.
- Accept the system-configured default "no answer" text or click into the field and specify your preferred message for "no answer" situations.
Configure additional settings on the page or scroll to the bottom of the page and click Save changes.
TIP: Return to this page to adjust this setting as necessary for your community site.
Understand Minimum Confidence Score
NOTE: Higher Logic Thrive Core customers should note that this setting does not apply to answers provided by Support Assistant.
The "minimum confidence score" refers to how confident the Agent or Assistant is that the sources it found match the user's query.
NOTE: This setting can be configured for AI Search Agents and the Thrive Core AI Assistant. If both are used, AI Search Agents settings override Thrive Core AI Assistant settings.
Use this setting to establish the required minimum amount of confidence for the Agent or Assistant to use the content as an answer.
- The lower the confidence score, the more likely the Agent or Assistant will use the content for the answer (AI will answer more often).
- The higher the confidence score, the less likely the Agent or Assistant will use the content for the answer (because it is not confident in the information) and is more likely to return the specified No answer response is shown instead.
EXAMPLE: You set the "minimum confidence score" at 83. The Agent or Assistant has to be quite confident that the sources match the user's query in order to serve it as an answer.
Details
- The default is 1, which is the most permissive; that is, the Agent or Assistant is more likely to use the information in its response.
- A high-value setting means more conservative use of information; the Agent or Assistant is more likely to return the specified No answer response (100 effectively disables answers and always returns the No answer response).
TIP: Accept the default of 1 unless you want to reduce the number of low-confidence answers. Setting this value too high could significantly impact the efficacy of the Agent or Assistant.
Content Relevance by Time
Use this section to set an age threshold for the relevance of content and the speed at which content reaches that threshold.
When configuring these settings, carefully consider your site's content. For example, you might think about:
- the breadth of content on your community site; if it's fairly limited in scope, you might want it be relevant for longer.
- the amount of content on your community site; if there is a lot of content, you might want it to age out, but not too quickly.
- the amount of user engagement; if new and/or updated information is posted somewhat regularly, you might want older (possibly outdated) information to age out more quickly.
Configure content age-out
- Accept the default setting of 365 days or click into the field and specify the numbers of days after which all content "of that age" will start to become less relevant for the Agent or Assistant.
Valid values for this field are: 1 (minimum) and 3650 (maximum). - Accept the default setting of Moderate or click on the speed bar (or click-&-drag the slider) to set the aging speed.
- Accept the default setting of Slightly prefers newer or click on the preference bar (or click-&-drag the slider) to set the recency preference.
TIP: Click a refresh icon to automatically restore the default for that setting.
Configure additional settings on the page or scroll to the bottom of the page and click Save changes.
TIP: Return to this page to adjust this setting as necessary for your community site.
Content Relevance by Source
Use this section to configure the relevancy of your various content types, as considered by the Agent or Assistant.
When configuring these settings, carefully consider your site's content. For example:
- if your community site doesn't use the Glossary or have many Announcements, you might want to exclude them to ensure that the Agent or Assistant's search remains focused.
- if you have subject-matter experts who are very engaged with other users' thread posts, you might consider favoring "replies" and "answers" more heavily than the original posts.
Configure content relevancy
- Accept the default settings for the content types or click on the relevancy bar (or click-&-drag the slider) to set how strongly it is favored for the Agent or Assistant answers.
TIP: Click a refresh icon to automatically restore the default setting for that source.
Click Save changes at the bottom of the page.
TIP: Return to this page to adjust this setting as necessary for your community site.