The Prompt History enables review of all prompt and response activity that has taken place on the CalypsoAI platform, including details about which scanners passed, blocked, or flagged individual prompts and responses. It captures data from both inline and offline deployments.
The Prompt History feature can be used to:
Monitor user activity in the CalypsoAI Chat and connected applications
Monitor and fine-tune scanner behavior
Gather documentary evidence for regulatory compliance
View and Use Prompt History
Click Logs in the navigation panel.
The Logs screen displays two tabs: Prompt History (the default view) and Audit Logs.
The Prompt History screen allows Super Admins to create detailed views of prompt activity with filters that establish the time and date range, identify one or more model providers to review, and/or select one or more groups to review.
 | 
| 
|
Click Filter by date and time and use the scroll bars to identify the start and end dates and times of the time span to be searched. Click the Up arrow in the time From and To drop-down lists, then click Select to review a time-bounded set of logs. Prompts can be sorted to show oldest first or most recent first.
By default, the Prompt History table shows prompts that were blocked, with the most recent activity first. The results can be customized by using the Type and Outcome filters.
The Type filter has options to display prompts, scans, or both.
The Prompts filter identifies messages initiated by the user that the scanners blocked or passed through to a model.
The Scans filter identifies messages that the scanners either passed or flagged without a model in the loop.
The Outcome filters present the action taken on the prompt or scan input.
Prompts can be blocked, passed, or flagged (Note: They are flagged when the scanner is in Audit mode).
Scans can be flagged or passed.
The Search feature allows Super Admins to search by user or prompt
Enter an email in the Search by email or prompt text box to review a specific user’s prompt history.
.CSV Download
The Prompt History can be exported as a .CSV file. Filters and date ranges applied to the page are reflected in the .CSV download. For example, to download the last month of prompt histories, set the date/time filter to the last 30 days, then click Download.
View Prompt & Scan Details
View details for any prompt or scan by clicking anywhere in the row, to open the details panel.
If viewing a prompt detail, the panel shows three tabs: Scanners, Prompt, and Response.
If viewing a scan detail, the panel shows the Scanners and Prompts tabs, but not the Response tab since the prompt is not sent to a model so no response is generated.
Scanners Tab
The Scanners tab displays all scanners that evaluated the prompt or scan, and the individual outcomes of each of those scanners. If one or more individual scanners block the prompt, then the outcome for that prompt is Blocked. All individual scanners must pass the prompt to achieve an outcome of Passed.
This level of detail is important for fine-tuning since it allows app developers to see why a prompt passed or was blocked, and which individual scanners may need to be tuned to produce the expected outcome.
Prompt Tab
The Prompt tab shows the complete prompt text with the outcome and timestamp.
Click View chat history to see the complete prompt and response session.
Response Tab
The Response tab shows the complete text response for that prompt. The Response tab is only available for prompts, not scans.
