Hanzo AI

Experiment

The `hanzo experiment` commands.

Also for this capability: API · CLI · MCP · SDKs

A/B testing anything: a flag, an ad, a subject line, a model.

API reference →

hanzo experiment list

Every command takes --json for the raw response and --help for its own flags. Sign in once with hanzo auth login; the commands below use that session, and the org they act in is the one it carries.

CommandWhat it does
hanzo experiment healthIs whether the experiments subsystem is mounted and serving in this process.
hanzo experiment listIs every experiment in the caller's org, with its variants, status and decision, ordered by project then id.

analyze

CommandWhat it does
hanzo experiment analyze <id>Is per-variant conversion, lift and statistical significance against the control arm.

assign

CommandWhat it does
hanzo experiment assign <id> --subject <subject>Is the variant one subject is bucketed into, and the payload that variant carries.

create

CommandWhat it does
hanzo experiment create --id <id> --metric-event <metricEvent> --variants '[{"control":false,"key":"<key>","payload":"<payload>","weight":0}]'Registers a controlled experiment AND puts its assignment flag live, in that order, so the arms start bucketing…

decide

CommandWhat it does
hanzo experiment decide <id> --winner <winner>Promotes one variant to the whole rollout and records who decided.

get

CommandWhat it does
hanzo experiment get <id>Is one experiment's definition and lifecycle: variants, weights, control arm, status and winner.

How is this guide?

On this page