Fundamentals: Bounds

GesamtDB lets you restrict query processing overhead using constraints.

You can bound the following metrics:

• max_seconds: maximum query runtime
• max_calls: maximum number of LLM calls
• max_tokens: maximum number of processed LLM tokens
• max_error: maximum tolerated model error

Constraints can help users stay within plan limits.

What happens when a threshold is reached

If a configured threshold is reached, query execution stops early.

GesamtDB still returns results from the current execution state. Those results can be incomplete.

For LLM evaluations that are no longer completed, GesamtDB returns SQL NULL values in the corresponding result positions.