# Availability and limits

Run a maintained benchmark from the catalog. Where private imports are enabled, you can also make a benchmark from a file or Hugging Face dataset. Private imports use EvalRouter's built-in graders. Maintained benchmarks use their version's recorded grader.

## Benchmarks and models

A ready benchmark may still reject your model. Some tasks need continuation likelihoods that a chat-only model cannot provide. Reasoning settings, output format, and context limit must also fit. EvalRouter checks compatibility again before a run starts.

Check [the catalog](/catalog) or run `evalrouter benchmarks list` and `evalrouter models list`. If imports are enabled, [import your data](/catalog/import) after reading the [formats and limits](/developers/docs/byob). Validation checks the data and settings. A small sample run checks the chosen model.

## Credits and execution

Runs need workspace credit. Each run starts under a spending cap: the `--max-cost` you set, or your available balance when you set none (see [credits and billing](/developers/docs/quotes-budgets)). New accounts receive a one-time $5 welcome credit in their workspace. A model connection may also incur separate provider charges.

Results separate wrong answers from system errors and unfinished work. A terminal timeout does not stop the server. Keep the run ID so you can check status without starting another run.

## Current self-service limits

Private imports accept JSON Lines, CSV, and Parquet with a built-in grader. They cannot run uploaded code, custom graders, or arbitrary evaluation repositories. [Public catalog additions](/developers/docs/bring-your-own-benchmark#request-an-addition) need separate review.

## Workload imports and Tune

Hosted source connections, reviewed workload graders, and Tune are enabled separately from catalog evaluations. A visible interface or SDK method does not establish deployment availability. The API refuses disabled operations. Production activation requires an exact-source qualification bundle and independent approval. See [workload imports](/developers/docs/workload-imports) and [Tune](/developers/docs/tune).