Skip to content

Create a query set

About this walkthrough

Estimated time: 2 minutes Tags: query-sets, setup, benchmark

Define the benchmark queries you want to tune for — the stable list every study scores against.

Trouble playing? Download the walkthrough video.

Step 1 — Open the Query Sets page. A 'query set'…

Open the Query Sets page. A 'query set' is a named collection of queries scoped to one cluster — your stable evaluation benchmark. Click 'Create query set' to begin.

Step 2 — The modal expects three things: a name, a…

The modal expects three things: a name, a cluster, and an optional description. Pick the cluster from the dropdown — it lists every registered cluster with its live health status.

Step 3 — Enter the name and choose a cluster from…

Enter the name and choose a cluster from the dropdown. The selected cluster scopes this query set — every study built on it scores against this cluster.

Step 4 — After submit, the new query set lands in…

After submit, the new query set lands in the list and you can drill into its detail page. The set starts empty — you load queries next.

Step 5 — Click 'Add queries' to open the upload dialog.…

Click 'Add queries' to open the upload dialog. RelyLoop accepts JSON (an array of {query_text, reference_answer?, query_metadata?} objects) OR CSV with query_text[,reference_answer,metadata] columns. Queries are validated, bulk-inserted, and assigned UUIDv7 IDs.

← Back to walkthroughs