OpenapiO11y
Attaches an eval score or human-feedback signal to a trace or a single…
Attaches an eval score or human-feedback signal to a trace or a single observation.
POST /v1/o11y/llm/scores
| Address | https://api.hanzo.ai/v1/o11y/llm/scores |
| Method | POST |
| Operation | CreateLLMScore |
| Auth | Authorization: Bearer $HANZO_API_KEY |
Attaches an eval score or human-feedback signal to a trace or a single observation.
Callers need the editor role; the runtime's own gate enforces it, and it validates the payload and stamps the score's author and org.
Request
8 fields, body application/json (required).
| Field | In | Type | Required | Description |
|---|---|---|---|---|
comment | body | string | — | Comment is a free-text note. |
dataType | body | string | — | DataType is the score's kind — NUMERIC or CATEGORICAL. |
name | body | string | — | Name is the score's name, e.g. |
observationId | body | string | — | ObservationID is the single observation the score attaches to, when narrowed to one. |
source | body | string | — | Source is where the score came from, e.g. |
stringValue | body | string | — | StringValue is the categorical score, when the score is categorical. |
traceId | body | string | — | TraceID is the trace the score attaches to. |
value | body | number | — | Value is the numeric score. |
Response
| Status | Body | Meaning |
|---|---|---|
201 | o11y.O11yLLMScoreOut | created |
201 body — 15 fields.
| Field | In | Type | Always | Description |
|---|---|---|---|---|
data | body | o11y.O11yLLMScore | — | |
data.comment | body | string | — | Comment is a free-text note. |
data.createdAt | body | string (date-time) | — | CreatedAt is when the score was stored. |
data.createdBy | body | string | — | CreatedBy is who created the score. |
data.dataType | body | string | — | DataType is the score's kind — NUMERIC or CATEGORICAL. |
data.id | body | string | — | ID is the score's id. |
data.name | body | string | — | Name is the score's name. |
data.observationId | body | string | — | ObservationID is the observation the score attaches to, when narrowed. |
data.source | body | string | — | Source is where the score came from, e.g. |
data.stringValue | body | string | — | StringValue is the categorical score, when the score is categorical. |
data.timestamp | body | string (date-time) | — | Timestamp is the score's own event time. |
data.traceId | body | string | — | TraceID is the trace the score attaches to. |
data.updatedAt | body | string (date-time) | — | UpdatedAt is when the score last changed. |
data.value | body | number | — | Value is the numeric score. |
status | body | string | — | Status is "success". |
Failure carries the platform error shape — see Errors.
Examples
hanzo o11y llm scores createimport { Configuration, O11yApi } from 'hanzoai';
const api = new O11yApi(new Configuration({ accessToken: process.env.HANZO_API_KEY }));
const { data } = await api.createLLMScore({ comment: "<comment>", dataType: "<dataType>" });from hanzoai.cloud import ApiClient, Configuration
from hanzoai.cloud.api import O11yApi
client = ApiClient(Configuration(access_token=os.environ["HANZO_API_KEY"]))
result = O11yApi(client).create_llm_score(comment="<comment>", data_type="<dataType>")cfg := cloud.NewConfiguration()
cfg.AddDefaultHeader("Authorization", "Bearer "+os.Getenv("HANZO_API_KEY"))
client := cloud.NewAPIClient(cfg)
resp, _, err := client.O11yAPI.CreateLLMScore(context.Background()).Execute()
if err != nil {
return err
}use hanzo_cloud::apis::{configuration::Configuration, o11y_api};
let mut cfg = Configuration::new();
cfg.bearer_access_token = std::env::var("HANZO_API_KEY").ok();
let result = o11y_api::create_llm_score(&cfg, Default::default()).await?;import ai.hanzo.cloud.ApiClient;
import ai.hanzo.cloud.api.O11yApi;
ApiClient client = new ApiClient();
client.setRequestInterceptor(b -> b.header("Authorization", "Bearer " + System.getenv("HANZO_API_KEY")));
var result = new O11yApi(client).createLLMScore();curl -X POST https://api.hanzo.ai/v1/o11y/llm/scores \
-H "Authorization: Bearer $HANZO_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"comment": "<comment>",
"dataType": "<dataType>"
}'Tool o11y, op CreateLLMScore — POST the JSON-RPC envelope to https://api.hanzo.ai/v1/mcp.
curl -X POST https://api.hanzo.ai/v1/mcp \
-H "Authorization: Bearer $HANZO_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "o11y",
"arguments": {
"op": "CreateLLMScore",
"input": {
"comment": "<comment>",
"dataType": "<dataType>"
}
}
}
}'How is this guide?