Scores
Evaluation scores from feedback, graders, and review — attached to traces, observations, and sessions.
Scores
A score is a judgment attached to a trace, observation, or session: a thumbs-up from a user, a grade from an automated evaluator, or a rating from a human reviewer. Scores are the measurable output of evaluation. Served by Hanzo O11y, tenant-scoped by org.
Anatomy of a score
Every score has a data type and a source, and points at what it grades. Its shape is governed by a score config referenced through configId.
| Field | Description |
|---|---|
name | The metric, e.g. helpfulness, hallucination |
value | Numeric value (also used for boolean 0/1 and category codes) |
stringValue | The category label or free-text value |
dataType | NUMERIC, CATEGORICAL, BOOLEAN, or TEXT |
source | API (feedback), EVAL (graders), ANNOTATION (review) |
traceId / observationId / sessionId | What the score is attached to |
comment | Optional reviewer note |
Where scores come from
API— end-user feedback (thumbs up/down, star ratings) sent from your app.EVAL— automated graders, including LLM-as-judge, produced by experiment runs.ANNOTATION— human review through annotation queues.
Related
- Score Configs — the definitions scores conform to
- Annotation Queues — human review that emits scores
- Experiments — graded dataset runs that emit scores
How is this guide?