This guide will help you understand how the token usage system works within the application. Understanding this system will help you make the most of the application’s features while efficiently managing your tokens.
Overview of Token System
Tokens in Await Cortex are a form of digital currency used to access various features.
Each action within the application - whether sending a message via the chatbot, crawling web pages or uploading files - consumes a certain number of tokens.
AI Chatbot Token Usage
Each message sent to the AI chatbot consumes 1 token.
This also relevant for any query or command input into the chatbot interface, including the “Regenerate“, “Continue“ or “Suggestions“ features.
The same system applies to the chatbot agents, located on the external websites.
...
Crawler Token Usage
Standard “Comply” Mode:
1 token is consumed for each URL link crawled.
The final amount of spent tokens will depend on amount of successfully crawled URL links after the end of the crawling process. If you set the “Links limit“ value as 50, but only 20 links were scraped successfully, only 20 tokens will be consumed.
The same logic will be applied if you started the process of crawling and then canceled it (deleted the knowledge base while it’s in progress status). Tokens will be consumed for the amount of already crawled links before canceling.
Advanced “Bypass“ Mode:
50 tokens are consumed for each URL link crawled.
This mode bypasses certain web restrictions, requiring more resources and thus more tokens.
...
Files Token Usage
1 token is used for every 1 MB of file data uploaded and successfully converted into the knowledge base.
If a file is less than 1 MB, the token cost is proportional to the file size. For example, a 0.5 MB file will cost 0.5 tokens.
The storage is limited by your subscription plan.
...
Managing Your Tokens
Your current token balance is displayed in the “Settings“ page.
If you need more tokens, you can purchase them through the “Get extra credits“ option in your account settings.
Tokens have an expiry date, so be sure to use them before they expire. Unused tokens do not carry over to the next billing cycle unless specified in your subscription plan.
Best Practices for Token Usage
Plan Your Actions:
Estimate and plan your usage of the features to optimize token consumption.
Monitor Usage Regularly:
Regularly check your token usage to avoid unexpected depletion of tokens.
Optimize File Sizes:
When using the “Files” feature, consider compressing files to lower sizes to save tokens and storage.