In response to these challenges, we implemented a unified tool that allows company employees to work with all the necessary AI models. The solution is based on open-source developments, offers rich functionality, and can be integrated quickly.
We deployed and configured the infrastructure, connected it to the API, and grouped users to grant them access based on business roles. For example, specific models are provided for system and business analysts that are best suited for solving their tasks.
In addition, we implemented a usage statistics collection system. Analytics generated monthly show how frequently and to what extent employees use the AI models. The collected data influences budget forecasting: payment for AI usage depends on the number of tokens (words) that users request from the model and receive in response. There is also the possibility to track that LLMs are used for work-related matters, not for personal needs.
We are now continuing to update the product and keep the AI models (ChatGPT, Gemini, Deepseek, Mistral, Claude) current, following the latest trends and technology updates.