Skip to main content
Custom Dashboards enable you to create tailored analytics views that surface the metrics most important to your team. Whether you’re tracking costs across tenants, monitoring latency for specific models, or analyzing error rates by environment, custom dashboards give you the flexibility to visualize your data exactly how you need it.

Real-time Insights

Monitor your AI application’s performance with live-updating widgets and configurable refresh intervals.

Flexible Visualization

Choose from 6 chart types to display your data in the most meaningful way for your use case.

Dimensional Analysis

Segment data by environment, user, session, or tenant to uncover patterns and anomalies.

Reusable Widgets

Create widgets once and add them to multiple dashboards for consistent reporting across teams.

​
Accessing Custom Dashboards

1

Navigate to Organization Analytics

Click the profile icon in the top-right corner and select Organization Analytics
2

Open Custom Section

In the left navigation panel, click on Custom
3

Choose Your View

Select either Custom Dashboards to view dashboards or Widgets to manage individual widgets

​
Dashboard Management

The Custom Dashboards tab displays all your dashboards with key information:
Dashboard list view

​
Creating a New Dashboard

1

Initiate Creation

Click Create Dashboard in the top-right corner of the Custom Dashboards tab
2

Configure Details

Enter a descriptive name and description for your dashboard
3

Create Dashboard

Click Create Dashboard to confirm, or Cancel to abort
4

Add Widgets

Click Add Widget to open the widget selector
5

Select Widgets

Check the boxes next to the widgets you want to include
6

Confirm Selection

Click Add Selected Widget to add them to your dashboard
Use the Create New Widget button in the widget selector to quickly create a new widget without leaving the dashboard editor.

​
Dashboard Actions

​
Widget Management

Widgets are the building blocks of your dashboards. Create them once and reuse them across multiple dashboards.
Widget list view

​
Creating a New Widget

Click Create Widget to open the configuration page with two sections:
  • Left panel - Configuration options
  • Right panel - Live preview
1

Basic Information

2

Data Configuration

Widget Scope - Choose your data source:Metric - Select what to measure (options vary by scope)
3

Select Metric & Aggregation

4

Choose Chart Type

5

Configure Dimensions (Optional)

Segment your data by:
6

Add Filters (Optional)

Narrow down your data with filters:
7

Preview and Save

Review the live preview on the right, then click Add Widget to save
The Widget Preview section shows a real-time visualization with a date range filter, allowing you to verify your configuration before saving.

​
Best Practices

Name Widgets Descriptively

Use clear names like “Daily Cost by Model” instead of “Cost Widget 1” for easier discovery.

Start with Key Metrics

Begin with 3-5 essential widgets, then expand based on team feedback.

Use Consistent Time Ranges

Keep related widgets on the same time range for accurate comparisons.

Group Related Dashboards

Create separate dashboards for different concerns (cost, performance, quality).

​
Common Use Cases

Track spending across your AI infrastructure:
  • Total Cost by Model - Pie chart showing cost distribution across different models
  • Daily Cost Trend - Line time series tracking cost over time
  • Cost by Tenant - Horizontal bar comparing costs across customers
  • High-Cost Sessions - Filter for sessions exceeding cost thresholds
Recommended filters: Total Cost > threshold, grouped by Model or Tenant ID
Monitor latency and throughput metrics:
  • P95 Latency Trend - Line chart tracking latency percentiles over time
  • Request Count by Environment - Bar chart comparing prod vs staging traffic
  • Time to First Token - Track streaming response performance
  • Latency by Model - Compare response times across different models
Recommended filters: Environment = production, grouped by Model Name
Track errors, violations, and PII detection:
  • Error Rate Trend - Line chart showing error percentage over time
  • Violation Count - Big number widget for policy violations
  • PII Detection by Service - Bar chart showing PII occurrences
  • Error Rate by Environment - Compare error rates across deployments
Recommended filters: Error = true, Violation = true, grouped by Environment
Multi-tenant usage analysis:
  • Usage by Tenant - Horizontal bar showing request distribution
  • Cost per Tenant - Track spending by customer
  • Token Usage Trend - Monitor token consumption over time
  • Active Sessions by Tenant - Compare engagement across customers
Recommended filters: Grouped by Tenant ID, sorted by Total Cost

​
Next Steps

Last modified on March 27, 2026