Eval Case
One repeatable test of an agent, lifted from a /wrong-answer report: the prompt that produced a bad answer, the node the answer had to read, the value it must not invent and the value it should state. Run N times against the agent; scored on the answer's own ThreadMessage record — did it look, did it invent, did it get it right. Stored under Feedback/_Evals/{agentId}/{case}, written as System. Compiled live from Source/.
- Configuration: config => config.WithContentType<EvalCaseContent>().LiftOnActivation().StampConfirmationOnActivation().AddDefaultLayoutAreas().AddLayout(layout => layout.AddEvalCaseLayoutAreas().WithView("Tests", EvalCaseTestsArea.Tests).WithDefaultArea("Eval"))
- Include global types: yes
- Cell surface: no
- Owns partition: no
- Keeps history: yes
- Sources: namespace:Source scope:subtree, shared=@Feedback/Feedback/Source/FeedbackContent, shared=@Feedback/Feedback/Source/WrongAnswerReport
- Stamped fields: confirmedBy
- Compilation status: 3
- Last compile started at: 2026-10-03T17:15:07.0439139+00:00
- Last compile succeeded at: 2026-11-01T11:56:29.2891368+00:00
- Last compiled version: 193
- Latest release path: Feedback/EvalCase/Release/20261003171507-IZJcI2xF
- Requested release at: 2026-11-01T11:56:29.4057534+00:00
- Requested release force: no
- Last release request handled at: 2026-11-01T11:56:29.4057534+00:00
- Latest assembly collection: local
- Latest assembly path: Feedback_EvalCase/v193-c003e001-c0b3f699fc8f.dll
- Latest assembly mvid: bca594b95a4c4ac087712796346d2640
- Compiled sources › Feedback/ eval case/ source/ eval runner: 639274377210187650
- Compiled sources › Feedback/ eval case/ source/ eval scoring: 639262674338011760
- Compiled sources › Feedback/ eval case/ test/ eval case tests: 639266456952977290
- Compiled sources › Feedback/ eval case/ source/ eval case content: 639274377209707450
- Compiled sources › Feedback/ eval case/ source/ eval case lifting: 639266456953522570
- Compiled sources › Feedback/ eval case/ test/ eval case tests area: 639266456952521870
- Compiled sources › Feedback/ feedback/ source/ feedback content: 639291309874418130
- Compiled sources › Feedback/ feedback/ source/ wrong answer report: 639266456952054610
- Compiled sources › Feedback/ eval case/ source/ eval case layout areas: 639275129760675950
- Compiled sources › Feedback/ eval case/ source/ eval case confirmation: 639275129761150030
- Current source versions › Feedback/ eval case/ source/ eval runner: 639274377210187650
- Current source versions › Feedback/ eval case/ source/ eval scoring: 639262674338011760
- Current source versions › Feedback/ eval case/ test/ eval case tests: 639266456952977290
- Current source versions › Feedback/ eval case/ source/ eval case content: 639274377209707450
- Current source versions › Feedback/ eval case/ source/ eval case lifting: 639266456953522570
- Current source versions › Feedback/ eval case/ test/ eval case tests area: 639266456952521870
- Current source versions › Feedback/ feedback/ source/ feedback content: 639291309874418130
- Current source versions › Feedback/ feedback/ source/ wrong answer report: 639266456952054610
- Current source versions › Feedback/ eval case/ source/ eval case layout areas: 639275129760675950
- Current source versions › Feedback/ eval case/ source/ eval case confirmation: 639275129761150030
- Adopted source fingerprint: ed54340b6a557e41
- Adopted source paths: Feedback/EvalCase/Source/EvalCaseConfirmation, Feedback/EvalCase/Source/EvalCaseContent, Feedback/EvalCase/Source/EvalCaseLayoutAreas, Feedback/EvalCase/Source/EvalCaseLifting, Feedback/EvalCase/Source/EvalRunner, Feedback/EvalCase/Source/EvalScoring, Feedback/EvalCase/Test/EvalCaseTests, Feedback/EvalCase/Test/EvalCaseTestsArea, Feedback/Feedback/Source/FeedbackContent, Feedback/Feedback/Source/WrongAnswerReport
- Current source fingerprint: ed54340b6a557e41
- Build provenance: 1
- Adopted module version: 1.10.9
- Current module version: 1.11
- Built module version: 1.10.9
- Built module version mvid: bca594b95a4c4ac087712796346d2640
- Compiled framework version: c003e001
- Compiled platform version: 3.1.12258
- Compiled modules hash: ad166cf6db0e091a24bc6507accdc0765c72f02176bc1a7d5a3185f6892ff1d9
- Compiled dependencies › !input: i158a3ecdc1eb338e4f36723daebda6a3
- Compiled dependencies › !toolchain: compat:c003e001
- Compiled dependencies › Mesh weaver. aI: min:3.1.0.0
- Compiled dependencies › Mesh weaver. data: compat:c003e001
- Compiled dependencies › Mesh weaver. graph: compat:c003e001
- Compiled dependencies › Mesh weaver. layout: compat:c003e001
- Compiled dependencies › Mesh weaver. mesh. contract: compat:c003e001
- Compiled dependencies › Mesh weaver. messaging. contract: compat:c003e001
- Compiled dependencies › Mesh weaver. messaging. hub: compat:c003e001
- Compiled dependencies › Mesh weaver. utils: compat:c003e001