Action router selects all actions in each agent cycle (top_k > 50). This caused large token usage and slow down inference speed.
The reason top_k is set to cover all actions now is that the query passed to chromadb is incorrect (using the trigger description, which does not have any semantic meaning to the action required).
Query/keyword rewrite to search for action can be a good solution to query for the correct actions, without having to retrieve all actions. Also, this way we can have more actions in our database.
Action router selects all actions in each agent cycle (top_k > 50). This caused large token usage and slow down inference speed.
The reason top_k is set to cover all actions now is that the query passed to chromadb is incorrect (using the trigger description, which does not have any semantic meaning to the action required).
Query/keyword rewrite to search for action can be a good solution to query for the correct actions, without having to retrieve all actions. Also, this way we can have more actions in our database.