forked from mlfoundations/evalchemy
-
Notifications
You must be signed in to change notification settings - Fork 6
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Decide whether NUPA should score response formatting strictly
agent-generatedAutomated failure trackingAutomated failure trackingStatus: Open.#190 In marin-community/evalchemy;[eval] Exclude unresolved endpoint failures from benchmark scores
agent-generatedAutomated failure trackingAutomated failure trackingStatus: Open.#82 In marin-community/evalchemy;Distributed multi-seed / multi-eval: served path runs serially on ONE endpoint; no seed-sharding fan-out
enhancementNew feature or requestNew feature or requestStatus: Open.#35 In marin-community/evalchemy;