Once AI Actions are integrated it is important to follow up with feedbacks and metrics. Capabilities implemented to help fulfilling this need are:

  • AI Action Feedback view
  • Configurable AI Usage dashboard

AI Action Feedback view

The ‘AI Action Feedback’ view can be found as dedicated navigation item in ‘Administration - Configurable AI’.

Feedback of interactive Actions shows up here and in the ‘Configurable AI Usage’ dashboard as soon provided. Users do have the option to provide feedback using the AI Action panel once an action has been executed.

Configurable AI Usage dashboard

The Configurable AI Usage dashboard is included in the Matrix42 Intelligence Navigation Item (Administration) as a dedicated view.

The default widgets provided are

  1. AI Action Execution Overall: Total sum of executions per AI Action
  2. Action Types: Amount of interactive and integrated actions
  3. Prompt Token Usage per Action: Total sum of tokens sent per Action 
  4. Completion Token Usage per Action: Total sum of tokens received per Action
  5. Liked Actions: Interactive Actions with positive feedback (thumbs up)
  6. Disliked Actions: Interactive Actions with negative feedback (thumbs down)
  7. Executions by Provider: Overall amount of actions executed by AI Service Provider