Richard Feldman afeb3d4fd9 Make eval more resilient to bad input from LLM (#29703) ...

I saw a slice panic (for begin > end) in a debug build of the eval. This
should just be a failed assertion, not a panic that takes out the whole
eval run!

Release Notes:

- N/A

2025-04-30 18:13:45 -04:00

..

examples

Make eval more resilient to bad input from LLM (#29703)

2025-04-30 18:13:45 -04:00

assertions.rs

eval: Fine-grained assertions (#29246)

2025-04-22 23:58:58 -03:00

eval.rs

Make the default repetitions be 8, and concurrency 4 (#29576)

2025-04-30 15:21:19 -04:00

example.rs

Code block evals (#29619)

2025-04-29 18:52:09 -04:00

explorer.html

eval: Add HTML overview for evaluation runs (#29413)

2025-04-25 17:49:05 +03:00

explorer.rs

eval: Add HTML overview for evaluation runs (#29413)

2025-04-25 17:49:05 +03:00

ids.rs

Add new action to run agent eval (#29158)

2025-04-21 21:30:21 -07:00

instance.rs

Fix eval judging missing final response (#29638)

2025-04-29 23:02:46 -04:00

judge_diff_prompt.hbs

eval: Fine-grained assertions (#29246)

2025-04-22 23:58:58 -03:00

judge_thread_prompt.hbs

eval: Fine-grained assertions (#29246)

2025-04-22 23:58:58 -03:00

tool_metrics.rs

eval: Fine-grained assertions (#29246)

2025-04-22 23:58:58 -03:00