Adding Sources
How to add web pages, Discord channels, text files, and GitHub repositories as Knowledge Base sources, and keep them fresh
Sources are the content your bot answers from. This page walks through each source type, the fields you fill in, what the status labels mean, how refreshing works, and what to do when indexing fails. It is written for the admin who maintains the documentation.
Pro allows 2 sources per server and Enterprise 15. GitHub repository sources need Enterprise. Text file sources can only be added or removed by the server owner; dashboard staff can manage the other types.
Adding a source
Open the Sources tab
Go to Dashboard → Bots, pick your bot, open Servers, pick the server, then open AI & Knowledge → Knowledge Base → Sources.
Click Add Knowledge Source
The button is disabled with Source limit reached when you are at your plan's limit. Remove a source or upgrade to add more.
Choose the Source Type
Pick Web Page, Discord Channel, GitHub Repository, or Text File and fill in the fields listed below.
Save
The source appears in the list as Pending and the first index is queued automatically. A source is ready to use when its status reads Ready.
Source types
Web Page
For a single page, or a page and the pages it links to.
| Field | Values | Default |
|---|---|---|
| Source URL | A complete https:// URL. Private addresses, localhost, and URLs with a username or password are rejected | Required |
| Source Title | Any name, for example Product Documentation | Required |
| Description (Optional) | Notes for your team | Empty |
| Pages to Read | 1 page (URL only), up to 5, 10, 15, 20, 25, 50, 75, or 100 pages; Up to 500 pages (Enterprise) | 1 page |
| Auto-refresh | Manual (no automatic refresh), Daily refresh, Weekly refresh, Monthly refresh | Manual |
With more than one page, the bot starts at your URL, follows the links it finds, and reads pages until it reaches the limit. The list shows Discovering pages..., then Reading 12/40, then Ready: 40 pages.
Point the bot at a pricing page, an FAQ, or a guide rather than your home page. Start with a small page count and raise it if answers are missing.
Discord Channel
For content that already lives in your server, such as an FAQ or announcements channel.
| Field | Values | Default |
|---|---|---|
| Discord Channel | A text channel the bot can see | Required |
| Source Title | Any name; the placeholder suggests #channel-name | Required |
| Include Bot Messages | On, Off | Off |
Only the newest 20 messages are used on Pro and the newest 100 on Enterprise, and very short messages are skipped. A curated FAQ channel works far better than a busy chat channel. The list shows Ready: 18 messages when done, and Last refresh shows the last time a channel message was saved.
The bot only reads channels it has permission to view. Do not add channels that contain private information; anything indexed can be quoted in answers.
Text File
For policies, internal notes, or a knowledge file you maintain by hand.
| Field | Values |
|---|---|
| Text file | A .txt or .md file under 256 KB and 50,000 characters. Only its plain text is sent; the file itself is never stored or executed, and binary or executable files are rejected |
| Source Title | Any name |
The bot splits the file into sections at headings and uses at most 3,000 characters of each section, so:
- Put a Markdown heading before every topic (
# Title,## Topic,### Sub-topic). Underlined titles are also recognised. - Keep each section under 3,000 characters and split long ones with sub-headings.
- Use plain bullet lists rather than tables or HTML.
The upload dialog shows how many sections it found and the longest section. A file longer than 3,000 characters with no headings is rejected with Add headings before uploading. If you have no time to reformat, use Copy AI prompt in the dialog, paste it into an AI chat together with your file, and upload the result.
Text sources cannot be edited. To change the content, remove the source and add the new file.
GitHub Repository (Enterprise)
For documentation kept as Markdown in a repository.
Connect GitHub
On the Sources tab, find GitHub Integration and click Connect GitHub. Only the bot owner can connect or disconnect GitHub. Grant the GitHub App access to the repositories you want to use.
Add a repository
Under GitHub Repositories, select a repository and click Add. Then set Source Title, Branch, and an optional Path Filter such as docs/ to use only the Markdown files in that folder. Leave the filter empty to use every Markdown file. Click Save All to start the first index.
Let it sync
The source updates automatically on every push to the chosen branch. The list shows Ready: 24 files and the indexed file paths.
Use Edit branch and path settings on the source to change the branch or folder. Changing either clears the prepared content, so click Refresh afterwards. Each repository and branch pair can be added once.
Disconnect under GitHub Integration removes every GitHub repository source on the server. If GitHub shows GitHub App Suspended, reinstall the app from your GitHub settings.
Source statuses
| Status in the list | Meaning |
|---|---|
| Pending | Added but not yet read |
| Discovering pages... / Reading 12/40 / Preparing 30/40 pages... | Indexing in progress |
| Ready: N pages / messages / files / text chunks | Ready to answer from |
| Failed | Indexing did not finish; the error is shown on the source |
Each source also has an on/off switch. A switched-off source keeps its content but is not used for answers until you switch it on again.
Refreshing a source
- Refresh this source (the refresh icon on a source) re-reads it now. You see Refresh queued and the source returns to the reading states. A source can be refreshed by hand once every 24 hours.
- Auto-refresh on web sources re-reads them Daily, Weekly, or Monthly.
- GitHub sources refresh on every push, and Discord channel sources save new messages as they arrive.
- If you turn on Smarter Source Memory on the Answering tab, refresh every source afterwards so the improvement applies to existing content.
Removing a source
Click Remove this source (the trash icon) and confirm. The source and all of its saved answer content are deleted and cannot be restored. Answers already posted in tickets stay in Discord.
Limits and gotchas
- Sources cost nothing to keep, but every answer costs tokens from the bot owner's allowance.
- A web page that needs a login, or that only shows content after running scripts, may index with little or no text. Check the Ready count after the first index.
Troubleshooting
| Symptom | Cause | Fix |
|---|---|---|
| Invalid URL when saving | The URL is missing https://, uses http://, points at a private address, or contains a username or password | Use the full public HTTPS address |
| Source limit reached | Your plan's source limit is used up | Remove a source you no longer need, or upgrade |
| The source shows Failed | The page requires a login, blocks automated readers, or was temporarily unavailable | Open the URL in a private browser window to confirm it loads without signing in, then click Refresh this source |
| Ready: 0 pages or a very small count | The page has little visible text, or Pages to Read is set to 1 page for a site with many pages | Choose a page with real text content, or raise Pages to Read |
| Refresh failed | You refreshed the source within the last 24 hours | Wait for the cooldown to end |
| Add headings before uploading | The text file has no headings and is longer than 3,000 characters | Add a heading before each topic or use the Copy AI prompt helper |
| Text file is too large | The file is over 256 KB or 50,000 characters | Split it into several files, one per topic area |
| Owner action required on a text or GitHub source | You are a dashboard staff member | Ask the bot owner to add or change it |
| Repository already added | That repository and branch already exist as a source | Edit the existing source instead |
| No repositories found | The GitHub App was not given access to the repository | Update the app's repository access in GitHub, then reload the page |
Common questions
How many sources can I add? 2 on Pro and 15 on Enterprise, per server.
How do I index a whole documentation site? Add it as a Web Page and set Pages to Read to the number of pages you need. Pro reads up to 100 pages per source and Enterprise up to 500.
Does the bot read my whole Discord channel? No. It uses the newest 20 messages on Pro and 100 on Enterprise, and skips very short ones. Keep the channel curated.
How often is a source updated? Whenever you click Refresh this source (once per 24 hours), on the Auto-refresh schedule for web pages, on every push for GitHub repositories, and as new messages arrive for Discord channels.
Can I edit a text file source? No. Remove it and upload the corrected file.
Why can't I add a GitHub repository? GitHub sources need an Enterprise plan, and only the bot owner can connect GitHub.
Will removing a source delete answers the bot already posted? No. Messages in Discord stay; only the saved content is deleted, so the bot stops using it for new answers.
Join our Discord server for support
Was this page helpful?
Last updated on