TeamAI's datastore feature allows you to store and organize various types of documents, including webpages, to enhance your workflow and streamline your processes. In this article, we'll focus specifically on adding webpage documents to your datastore. If you're on one of our paid plans (Starter, Best-of-Breed, Professional, or Enterprise), understanding how to effectively manage your webpage documents is crucial.
Adding Webpage Documents
TeamAI provides a simple and intuitive interface for adding webpage documents to your datastore. You can add multiple webpage URLs at once by entering them in the input box, separated by commas. Additionally, you have the option to group the webpages together in a datastore, as shown in the image below:
Tips for Adding Webpages
When adding webpage documents to your datastore, keep the following tips in mind:
Ensure that the webpages you add are publicly available. TeamAI cannot access or store webpages that require authentication or are behind paywalls.
Due to the high volume of requests, it may take a couple of minutes for your webpages to sync with your datastore. Please be patient during this process. As soon as the status of the webpages changes to active on the documents list, you're good to go and use them in your chats.
Currently, our models work best with left-to-right (LTR) language documents, such as English. Avoid adding webpages that are primarily in right-to-left (RTL) languages or contain mostly images (or images of text), as the current embedding process relies on the textual content.
Watch out for invalid URLs. We've also added a validator that warns you of invalid URLs as soon as you enter them in the input box as shown below:
Webpage Document Count
In TeamAI, each webpage added to your datastore is counted as one document, regardless of its length. There is no hard limit on the length of the webpage, allowing you to store and organize content of varying sizes. However, it's essential to keep in mind that the total number of documents you can store depends on your plan's limits.
Understanding Datastore Limits
Each paid TeamAI plan comes with different limits for the number of documents you can store, including webpage documents. It's crucial to familiarize yourself with these limits to avoid any disruptions in your workflow. For more information on datastore limits and how they affect your billing, please refer to the following articles:
Conclusion
Adding webpage documents to your TeamAI datastore is a powerful way to organize and utilize online content for your projects and workflows. By understanding the process of adding webpages, the document count system, and the best practices for optimal results, you can make the most of this feature. Remember to keep an eye on your datastore usage and plan limits to ensure a smooth and uninterrupted experience. If you have any questions or concerns, our support team is always here to help.