The Prompt History and Audit Logs provide organizations with visibility into user activities within CalypsoAI. This enhanced visibility enables better compliance with regulatory standards, more informed decision-making, and improved system customization to meet specific organizational needs. By providing a clear audit trail of all interactions and decisions within the system, these enhanced data management capabilities contribute to maintaining a secure, transparent, and accountable environment.

CalypsoAI monitors all user prompts and LLM responses, and this comprehensive interaction history is available to Admins on the Logs screen.

Admins can download user prompts, LLM responses, and audit tables directly from CalypsoAI in a .CSV format. The Prompt History compiles both accepted and blocked responses, identifying the users, models, prompt, and outcomes. This feature enables in-depth offline data analysis and facilitates record-keeping for audit and compliance purposes. This feature can be turned on/off.

This table can be filtered by date and downloaded to reflect the desired timeframe. To download the Prompt History to a .CSV file, click the Download button above the Prompt History table.

Admin have the ability to view a prompt in its original context of the entire chat. This can be accessed by clicking View next to the listed prompt from the Prompt History table.
​

Admin can schedule a recurring Prompt History data purge that occurs on a user-defined cadence measured in weeks. To set the number of weeks that comprise a purge cycle, click the down arrow to the left of the Purge Data window and type in the desired number of weeks.

To turn off Auto Purge, click the On/Off toggle on the right side of the Purge Data window.

The Prompt History is automatically stored to CalypsoAI. To disable Prompt History storage, click the On/Off toggle shown above the Prompt History table.

Audit Logs keep track of all admin actions, maintaining a comprehensive log for accountability and traceability of system configurations and changes. Audit Logs can be downloaded to a .CSV file by clicking the Download button shown above the Audit Log table.