Monitors
Overview
The monitors command group manages Arize monitors — automated checks that track performance, drift, and data-quality metrics and alert when thresholds are breached.
| Command | Description | Client Method |
|---|---|---|
monitors list |
List monitors for a model | get_all_monitors |
monitors get |
Get a monitor by name | get_monitor |
monitors create-performance |
Create a performance monitor | create_performance_monitor |
monitors create-drift |
Create a drift monitor | create_drift_monitor |
monitors create-data-quality |
Create a data quality monitor | create_data_quality_monitor |
monitors delete |
Delete a monitor | delete_monitor |
monitors copy |
Copy a monitor to another model | copy_monitor |
monitors values |
Get metric values over time | get_monitor_metric_values |
monitors latest-value |
Get the latest metric value | get_latest_monitor_value |
monitors list
arize_toolkit monitors list [--model-name NAME] [--model-id ID] [--category CATEGORY]
Lists all monitors for a model. Optionally filter by category.
Options
--model-name(optional) — Model name.--model-id(optional) — Model ID.--category(optional) — Filter:drift,dataQuality, orperformance.
Example
arize_toolkit monitors list --model-name "fraud-detection-v3"
arize_toolkit monitors list --model-name "fraud-detection-v3" --category performance
monitors get
arize_toolkit monitors get NAME --model MODEL
Retrieves detailed information for a single monitor.
Arguments
NAME— The monitor name.
Options
--model(required) — The model name.
Example
arize_toolkit --json monitors get "accuracy-check" --model "fraud-detection-v3"
monitors create-performance
arize_toolkit monitors create-performance NAME --model MODEL --environment ENV [OPTIONS]
Creates a new performance monitor.
Arguments
NAME— Name for the monitor.
Required Options
--model— Model name.--environment— Environment:tracing,production,validation, ortraining.
Key Options
--performance-metric— Metric name (e.g.accuracy,auc). Either this or--custom-metric-idis required.--custom-metric-id— Custom metric ID to monitor.--operator— Comparison operator:greaterThan,lessThan,greaterThanOrEqual,lessThanOrEqual. Defaults togreaterThan.--threshold— Alert threshold value.--std-dev-multiplier— Standard deviation multiplier. Defaults to2.0.--evaluation-window— Evaluation window in seconds. Defaults to259200(3 days).--delay— Delay in seconds before evaluation. Defaults to0.--threshold-mode—singleordouble. Defaults tosingle.--threshold2/--operator2— Second threshold settings (fordoublemode).--email— Email addresses for notifications (repeatable).--integration-key-id— Integration key IDs (repeatable).--notes— Notes for the monitor.
Example
arize_toolkit monitors create-performance "accuracy-alert" \
--model "fraud-detection-v3" \
--environment production \
--performance-metric accuracy \
--operator lessThan \
--threshold 0.95 \
--email "alerts@example.com"
monitors create-drift
arize_toolkit monitors create-drift NAME --model MODEL [OPTIONS]
Creates a new drift monitor.
Arguments
NAME— Name for the monitor.
Required Options
--model— Model name.
Key Options
--drift-metric— Drift metric:psi,js,kl,ks,euclideanDistance, orcosineSimilarity. Defaults topsi.--dimension-category— Category to monitor (e.g.prediction,featureLabel). Defaults toprediction.--dimension-name— Specific dimension name.--operator,--threshold,--std-dev-multiplier,--evaluation-window,--delay,--threshold-mode,--threshold2,--operator2— Same as performance monitors.--email,--integration-key-id,--notes— Notification and documentation options.
Example
arize_toolkit monitors create-drift "prediction-drift" \
--model "fraud-detection-v3" \
--drift-metric psi \
--threshold 0.2
monitors create-data-quality
arize_toolkit monitors create-data-quality NAME --model MODEL --data-quality-metric METRIC --environment ENV [OPTIONS]
Creates a new data quality monitor.
Arguments
NAME— Name for the monitor.
Required Options
--model— Model name.--data-quality-metric— Metric name (e.g.percentEmpty,cardinality,avg).--environment— Environment:tracing,production,validation, ortraining.
Key Options
--dimension-category— Category to monitor. Defaults toprediction.--dimension-name— Specific dimension name.--operator,--threshold,--std-dev-multiplier,--evaluation-window,--delay,--threshold-mode,--threshold2,--operator2— Threshold settings.--email,--integration-key-id,--notes— Notification and documentation options.
Example
arize_toolkit monitors create-data-quality "null-check" \
--model "fraud-detection-v3" \
--data-quality-metric percentEmpty \
--environment production \
--operator greaterThan \
--threshold 0.05
monitors delete
arize_toolkit monitors delete NAME --model MODEL [--yes]
Deletes a monitor. Prompts for confirmation unless --yes is passed.
Arguments
NAME— The monitor name.
Options
--model(required) — The model name.--yes— Skip confirmation.
Example
arize_toolkit monitors delete "old-monitor" --model "fraud-detection-v3" --yes
monitors copy
arize_toolkit monitors copy MONITOR_NAME --model MODEL [--new-name NAME] [--new-model MODEL] [--new-space-id ID]
Copies a monitor to the same or a different model/space.
Arguments
MONITOR_NAME— The source monitor name.
Options
--model(required) — Source model name.--new-name(optional) — Name for the copied monitor.--new-model(optional) — Target model name.--new-space-id(optional) — Target space ID.
Example
arize_toolkit monitors copy "accuracy-alert" \
--model "fraud-detection-v3" \
--new-model "fraud-detection-v4" \
--new-name "accuracy-alert-v4"
monitors values
arize_toolkit monitors values MONITOR_NAME --model MODEL [--granularity GRANULARITY] [--start-time TIME] [--end-time TIME]
Fetches the monitor's metric values over time.
Arguments
MONITOR_NAME— The monitor name.
Options
--model(required) — Model name.--granularity— Time series granularity:hour,day,week,month. Defaults tohour.--start-time/--end-time(optional) — Time range in ISO format.
Example
arize_toolkit --json monitors values "accuracy-alert" \
--model "fraud-detection-v3" \
--granularity day \
--start-time 2025-01-01
monitors latest-value
arize_toolkit monitors latest-value MONITOR_NAME --model MODEL [--granularity GRANULARITY]
Returns the most recent metric value, threshold, and timestamp for a monitor.
Arguments
MONITOR_NAME— The monitor name.
Options
--model(required) — Model name.--granularity— Granularity:hour,day,week,month. Defaults tohour.
Example
$ arize_toolkit --json monitors latest-value "accuracy-alert" --model "fraud-detection-v3"
{
"timestamp": "2025-02-24T12:00:00Z",
"metric_value": 0.97,
"threshold_value": 0.95
}