Skip to content

chore(deps): bump github.com/plexusone/structured-evaluation from 0.14.0 to 0.15.0 - #177

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/go_modules/github.com/plexusone/structured-evaluation-0.15.0
Open

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/go_modules/github.com/plexusone/structured-evaluation-0.15.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Nov 2, 2026 •

Copy link
Copy Markdown
Contributor

Bumps github.com/plexusone/structured-evaluation from 0.14.0 to 0.15.0.

Release notes

Sourced from github.com/plexusone/structured-evaluation's releases.

v0.15.0

Release Notes: v0.15.0

Full Changelog: plexusone/structured-evaluation@v0.14.0...v0.15.0

Changelog

Sourced from github.com/plexusone/structured-evaluation's changelog.

[v0.15.0] - 2026-10-29

Highlights

  • JudgeMetadata covers all three kinds of judge: Code-as-a-Judge, LLM-as-a-Judge, and Human-as-a-Judge, where it used to describe only LLMs. A new Method field, reusing the EvaluationMethod vocabulary already used on Category and Criterion, says which one produced an evaluation
  • Backward compatible: an empty Method means semantic (JudgeMetadata's only meaning before v0.15.0), so existing judge JSON parses and validates unchanged

Added

  • JudgeMetadata.Method (EvaluationMethod), plus CheckID/CheckVersion for deterministic judges and ReviewerID/ReviewerName for human judges, alongside the existing LLM fields (b6c281b)
  • NewDeterministicJudgeMetadata(checkID) and NewHumanJudgeMetadata(reviewerID) constructors next to NewJudgeMetadata(model), which now sets Method to semantic; WithCheckVersion and WithReviewerName builder methods (b6c281b)
  • JudgeMetadata.Validate() []string: checks that a judge carries the field its Method requires (Model, CheckID, or ReviewerID) and rejects unknown methods (b6c281b)
  • ValidEvaluationMethodValues(); EvaluationMethod added to schema.EnumDefinitions and schema/enums.json. The JSON Schema evaluation (Category/Criterion) and method (JudgeMetadata) fields are now constrained to deterministic/semantic/human where evaluation used to be an unconstrained string (b6c281b)
  • @plexusone/structured-evaluation@0.15.0: Zod schemas and TS types regenerated for the judge method fields and the evaluation enum (a8fcdf8)

Changed

  • JudgeMetadata.Model is now omitempty, because deterministic and human judges have no model (b6c281b)

Fixed

  • cmd/genschema writes schema files through os.Root, confining them to the output directory (resolves gosec G703 findings) (8f02cab)

Dependencies

  • 1 dependency update

Documentation

  • README and pairwise docs show the LLM, deterministic, and human judge constructors; the pairwise human-preference example no longer uses a nonexistent Provider field (0de36f7)

Tests

  • Judge constructors, per-method Validate errors, v0.14.0-shaped judge JSON, and deterministic judge round-trip with model omitted (f5195f2)
Commits
  • 344b816 docs: add v0.15.0 changelog entry and release notes
  • 5beded2 chore(deps): update pb33f/ordered-map to v2.3.2
  • a8fcdf8 chore(ts): regenerate Zod schemas for judge method fields
  • 0de36f7 docs: document deterministic and human judge metadata
  • 8f02cab fix(genschema): confine schema writes to the output directory
  • f5195f2 test(rubric): cover judge methods, validation, and legacy judge JSON
  • b6c281b feat(rubric): support deterministic and human judges in JudgeMetadata
  • 9db70da docs: document npm publishing and require ts/Zod release in lockstep
  • See full diff in compare view

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file go Pull requests that update go code labels Nov 2, 2026
@coderabbitai

coderabbitai Bot commented Nov 2, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: 54b10474-9eed-413f-a868-a3dac891ad32

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

Bumps [github.com/plexusone/structured-evaluation](https://github.com/plexusone/structured-evaluation) from 0.14.0 to 0.15.0.
- [Release notes](https://github.com/plexusone/structured-evaluation/releases)
- [Changelog](https://github.com/plexusone/structured-evaluation/blob/main/CHANGELOG.md)
- [Commits](plexusone/structured-evaluation@v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: github.com/plexusone/structured-evaluation
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/go_modules/github.com/plexusone/structured-evaluation-0.15.0 branch from 88c663c to cb4146e Compare November 2, 2026 11:29

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file go Pull requests that update go code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants