0.958
nDCG@10
A small search benchmark you can inspect.
Ten independently written intents were judged against a frozen 24-resource slice of public GoPlausible x402 discovery metadata. The dependency-free lexical baseline reports every ranking and metric.
0.950
recall@10
1.000
MRR@10
0%
zero-result rate
What this does—and does not—prove
The sample demonstrates a reproducible evaluation workflow over public, multi-network HTTP metadata. It is not Stellar-specific, does not cover MCP, does not independently test endpoint liveness, and does not endorse any listed service. The observed mean ranking time (2.992 ms) is local and environment-dependent, not network latency. The proposed commercial 40-query holdout would be newly built after written scope and funding agreement.
Snapshot captured 2026-08-23T13:53:24.080Z from a source catalog reporting 1545 entries; 24 were selected for capability diversity after excluding security, trading and gambling.
Per-query result
| ID | Intent | nDCG@10 | Recall@10 | Hits |
|---|---|---|---|---|
| q01 | play one legal move in a shared chess game | 1.000 | 1.000 | 1 / 1 |
| q02 | search Pacific data endpoints by country and category | 1.000 | 1.000 | 2 / 2 |
| q03 | Pacific tuna stock findings summary | 0.945 | 1.000 | 2 / 2 |
| q04 | commercial license and production mesh for a lamp model | 0.699 | 0.500 | 2 / 4 |
| q05 | agricultural weather risk forecast for farmers | 0.965 | 1.000 | 3 / 3 |
| q06 | summarize a long document article or transcript | 0.973 | 1.000 | 3 / 3 |
| q07 | verify a signed Algorand document on chain | 1.000 | 1.000 | 2 / 2 |
| q08 | compute a cryptographic sha256 hash of text | 1.000 | 1.000 | 1 / 1 |
| q09 | check whether a claim survives independent web research | 1.000 | 1.000 | 2 / 2 |
| q10 | explain an Algorand transaction in plain language | 1.000 | 1.000 | 3 / 3 |
report sha256:82050FD5F3F8D07A945EC4EBF72C983359E9AB6CC2E6E5889E9BF90F8F740A26
snapshot file sha256:A40C842A98C6A9B19A9EA7FE6B58DEA208AEA80D8DB124EC62DB30472C2B9685
judgments sha256:817C3D97BB457FC595D720B59E9F43CE2802D493BC039FB020BFC000E794903E