Reports — AI Quality
URL:
/ou/{orgId}/reports/audit
1. Specific Filters
| Filter | Options |
|---|---|
| Auditor Type | All (or a specific type) |
Note: This report does not have a Channel/Source filter — it focuses only on period and auditor type.
2. KPIs (Key Metrics)
| Metric | Description |
|---|---|
| Audited Conversations | Total conversations reviewed |
| Audit Completion Rate | Percentage of completed audits |
| Non-Audited Conversations | Conversations pending review |
3. Section: Conversation Audit
3.1 Performance by Variable
Bar/radar chart showing performance by audit criterion.
3.2 Table: Audited Conversations
| Column | Description |
|---|---|
| Customer | Customer name/ID |
| Auditor | Who performed the audit |
| Audit Date | When it was audited |
| Correct Information | Factual accuracy of the response |
| User Journey | Alignment with the expected flow |
| AI Tone and Style | Quality of the tone of voice |
| Comments | Auditor's observations |
Pagination: Rows per page (default: 25)
4. Section: Messages Corrected with "Grounding"
4.1 KPIs
| Metric | Description |
|---|---|
| Corrected messages | Total corrections applied |
| Total AI messages | Total volume of AI messages |
| Correction rate | Percentage of corrected messages |
| Target | "< 10%" — correction rate goal |
4.2 Table: Corrected Messages
Toggles: Table view | Detailed view
| Column | Description |
|---|---|
| Conversation | Conversation identifier |
| Incorrect response | What the AI answered incorrectly |
| Correct response | The corrected response (ground truth) |
| Mission Score | Task completeness score |
| Verification Score | Factual accuracy score |
| Date | Correction date |
Pagination: Rows per page (default: 25)
5. Empty State
All sections show: "No data for the selected period and filters".