List catalog

The canonical public benchmarks this arena runs — the id, title, axis, item count and upstream source of each, with native marking the ones the standardized harness runs today; the rest are registered and adapter-pending.

GET /v1/benchmark/catalog

Addresshttps://api.hanzo.ai/v1/benchmark/catalog
MethodGET
Operationget_benchmark_catalog
AuthAuthorization: Bearer $HANZO_API_KEY

The canonical public benchmarks this arena runs — the id, title, axis, item count and upstream source of each, with native marking the ones the standardized harness runs today; the rest are registered and adapter-pending.

These ids are the vocabulary the rest of the surface takes: a run names them, and the leaderboard and compare read them from ?benchmark=. The catalog is deployment-wide and identical for every caller — there is no tenant in it.

Request

GET /v1/benchmark/catalog takes no parameters and no body — the credential is the whole request.

Response

StatusBodyMeaning
200benchmark.benchmarkCatalogok
defaultproblem-detailsrefused

200 body — 8 fields.

FieldInTypeAlwaysDescription
databodybenchmark.Benchmark[]—Data is one row per benchmark, in the catalog's own order.
data[].axisbodystring—what capability it measures
data[].idbodystring—the id every other op on this surface takes
data[].itemsbodyinteger (int64)—how many items it holds, when the set is fixed
data[].nativebodyboolean—whether the standardized harness runs it today
data[].sourcebodystring—where the items come from
data[].titlebodystring—the benchmark's published name
totalbodyinteger (int64)—Total is how many rows Data holds.

Failure carries the platform error shape — see Errors.

Examples

hanzo benchmark catalog
import { Configuration, BenchmarkApi } from 'hanzoai';

const api = new BenchmarkApi(new Configuration({ accessToken: process.env.HANZO_API_KEY }));
const { data } = await api.getBenchmarkCatalog();
from hanzoai.cloud import ApiClient, Configuration
from hanzoai.cloud.api import BenchmarkApi

client = ApiClient(Configuration(access_token=os.environ["HANZO_API_KEY"]))
result = BenchmarkApi(client).get_benchmark_catalog()
cfg := hanzoai.NewConfiguration()
cfg.AddDefaultHeader("Authorization", "Bearer "+os.Getenv("HANZO_API_KEY"))
client := hanzoai.NewAPIClient(cfg)

resp, _, err := client.BenchmarkAPI.GetBenchmarkCatalog(context.Background()).Execute()
if err != nil {
	return err
}
use hanzo_client::apis::{configuration::Configuration, benchmark_api};

let mut cfg = Configuration::new();
cfg.bearer_access_token = std::env::var("HANZO_API_KEY").ok();

let result = benchmark_api::get_benchmark_catalog(&cfg, Default::default()).await?;
import ai.hanzo.cloud.ApiClient;
import ai.hanzo.cloud.api.BenchmarkApi;

ApiClient client = new ApiClient();
client.setBearerToken(System.getenv("HANZO_API_KEY"));

var result = new BenchmarkApi(client).getBenchmarkCatalog();
curl https://api.hanzo.ai/v1/benchmark/catalog \
  -H "Authorization: Bearer $HANZO_API_KEY"

Tool benchmark, op get_benchmark_catalog — POST the JSON-RPC envelope to https://api.hanzo.ai/v1/mcp.

curl -X POST https://api.hanzo.ai/v1/mcp \
  -H "Authorization: Bearer $HANZO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
       "jsonrpc": "2.0",
       "id": 1,
       "method": "tools/call",
       "params": {
         "name": "benchmark",
         "arguments": {
           "op": "get_benchmark_catalog",
           "input": {}
         }
       }
     }'

Benchmark API · All Hanzo APIs · Interactive reference

Was this page useful?