Real-time Insights
Monitor your AI application’s performance with live-updating widgets and configurable refresh intervals.
Flexible Visualization
Choose from 6 chart types to display your data in the most meaningful way for your use case.
Dimensional Analysis
Segment data by environment, user, session, or tenant to uncover patterns and anomalies.
Reusable Widgets
Create widgets once and add them to multiple dashboards for consistent reporting across teams.
Accessing Custom Dashboards
Navigate to Organization Analytics
Click the profile icon in the top-right corner and select Organization Analytics
Dashboard Management
The Custom Dashboards tab displays all your dashboards with key information:| Column | Description |
|---|---|
| Name | Dashboard identifier |
| Description | Purpose and contents |
| Created | Creation timestamp |
| Last Modified | Most recent update |
| Actions | Edit, clone, or delete |
Creating a New Dashboard
Dashboard Actions
| Action | Description |
|---|---|
| Edit | Modify dashboard name, description, and widgets |
| Clone | Create a copy of the dashboard with all its widgets |
| Delete | Permanently remove the dashboard |
Widget Management
Widgets are the building blocks of your dashboards. Create them once and reuse them across multiple dashboards.
Creating a New Widget
Click Create Widget to open the configuration page with two sections:- Left panel - Configuration options
- Right panel - Live preview
Basic Information
| Field | Description |
|---|---|
| Name | Unique identifier (no duplicates allowed) |
| Description | Brief explanation of what the widget displays |
Data Configuration
Widget Scope - Choose your data source:
Metric - Select what to measure (options vary by scope)
| Scope | Description |
|---|---|
| Traces | Aggregated trace-level data |
| Spans | Individual span-level data |
Select Metric & Aggregation
Available Metrics
Available Metrics
| Metric | Aggregation Methods |
|---|---|
| Error Rate | Percentage, Total Count |
| Latency | Average, P50, P90, P95, P99, Median |
| Request Count | Total Count |
| Total Cost | Sum |
| Total Tokens | Sum |
| Time to First Token | Average, P50, P90, P95, P99 |
Choose Chart Type
| Chart Type | Best For |
|---|---|
| Line Time Series | Trends over time |
| Bar Time Series | Periodic comparisons |
| Horizontal Bar | Ranking/comparing categories |
| Vertical Bar | Category comparisons |
| Pie Chart | Proportional distribution |
| Big Number | Single KPI display |
Configure Dimensions (Optional)
Segment your data by:
| Dimension | Use Case |
|---|---|
| Environment | Compare prod vs staging vs dev |
| User ID | Per-user analysis |
| Session ID | Session-level breakdown |
| Tenant ID | Multi-tenant comparisons |
Add Filters (Optional)
Narrow down your data with filters:
Boolean Filters
Boolean Filters
| Filter | Options |
|---|---|
| Violation | True / False |
| PII | True / False |
| Error | True / False |
Selection Filters
Selection Filters
| Filter | Operators |
|---|---|
| Models | Any of / None of |
Text Filters
Text Filters
| Filter | Operators |
|---|---|
| Session ID | Equals / Not equals / Contains |
| User ID | Equals / Not equals / Contains |
| Metadata | Equals / Not equals / Contains / Not contains / Starts with / Ends with |
Numeric Filters
Numeric Filters
| Filter | Operators |
|---|---|
| Latency | Greater than / Less than / Greater or equal / Less or equal |
| Total Cost | Greater than / Less than / Greater or equal / Less or equal |
The Widget Preview section shows a real-time visualization with a date range filter, allowing you to verify your configuration before saving.
Best Practices
Name Widgets Descriptively
Use clear names like “Daily Cost by Model” instead of “Cost Widget 1” for easier discovery.
Start with Key Metrics
Begin with 3-5 essential widgets, then expand based on team feedback.
Use Consistent Time Ranges
Keep related widgets on the same time range for accurate comparisons.
Group Related Dashboards
Create separate dashboards for different concerns (cost, performance, quality).
Common Use Cases
Cost Monitoring Dashboard
Cost Monitoring Dashboard
Track spending across your AI infrastructure:
- Total Cost by Model - Pie chart showing cost distribution across different models
- Daily Cost Trend - Line time series tracking cost over time
- Cost by Tenant - Horizontal bar comparing costs across customers
- High-Cost Sessions - Filter for sessions exceeding cost thresholds
Performance Monitoring Dashboard
Performance Monitoring Dashboard
Monitor latency and throughput metrics:
- P95 Latency Trend - Line chart tracking latency percentiles over time
- Request Count by Environment - Bar chart comparing prod vs staging traffic
- Time to First Token - Track streaming response performance
- Latency by Model - Compare response times across different models
Quality & Compliance Dashboard
Quality & Compliance Dashboard
Track errors, violations, and PII detection:
- Error Rate Trend - Line chart showing error percentage over time
- Violation Count - Big number widget for policy violations
- PII Detection by Service - Bar chart showing PII occurrences
- Error Rate by Environment - Compare error rates across deployments
Tenant Analytics Dashboard
Tenant Analytics Dashboard
Multi-tenant usage analysis:
- Usage by Tenant - Horizontal bar showing request distribution
- Cost per Tenant - Track spending by customer
- Token Usage Trend - Monitor token consumption over time
- Active Sessions by Tenant - Compare engagement across customers
Next Steps
- Dashboard Query API - Query dashboard data programmatically
- Usage, Traces & Spans - Query usage data
- Sessions - Understand session management
- Tenants - Multi-tenant analytics