Skip to content

feat(scoring): export the deep-eval and category-score functions from the package root - #74

Open
joelepper-netlify wants to merge 1 commit into
mainfrom
feat/export-scoring-internals
Open

joelepper-netlify wants to merge 1 commit into
mainfrom
feat/export-scoring-internals

Conversation

@joelepper-netlify

@joelepper-netlify joelepper-netlify commented Oct 26, 2026 •

Copy link
Copy Markdown

When using AXIS as part of an orchestrated evaluation system we found that it's useful to be able to import some of the internals. THis PR adds those exports.

Exports runDeepEval, computeHeuristicSpeed, parseCategoryEvalResponse, computeCategoryScore, aggregateDimension and parseJsonFromText, with the DeepEvalOptions and CalibrationParams types, from the package root. Callers that run per-category scoring with their own judge adapter can then import them without reaching into dist/.

Additive only: no behavior change, no rename, and no exports map, so existing deep imports keep working. A new test imports each export from the root. The README Programmatic API section describes them.

🤖 Generated with Claude Code

… the package root

runDeepEval, computeHeuristicSpeed, parseCategoryEvalResponse,
computeCategoryScore, aggregateDimension and parseJsonFromText, with the
DeepEvalOptions and CalibrationParams types, are now exported from the
package root. The change is additive: no behavior change, no rename, and no
exports map, so existing deep imports keep working.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@netlify

netlify Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

✅ Deploy Preview for axisproject ready!

Name Link
🔨 Latest commit e0c57f1
🔍 Latest deploy log https://app.netlify.com/projects/axisproject/deploys/6adfe4f18a3d782c41f77be3
😎 Deploy Preview https://deploy-preview-74--axisproject.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
🤖 Make changes Run an agent on this branch

To edit notification comments on pull requests, go to your Netlify project configuration.

@netlify

netlify Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

✅ Deploy Preview for axis-docs ready!

Name Link
🔨 Latest commit e0c57f1
🔍 Latest deploy log https://app.netlify.com/projects/axis-docs/deploys/6adfe4f1e07c569b33d453a7
😎 Deploy Preview https://deploy-preview-74--axis-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
🤖 Make changes Run an agent on this branch

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai

coderabbitai Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review.

Recent review info
Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Team
  • Run ID: 1a3d5dc5-9ff0-40a5-8708-be4ff9473a75
Commits

Reviewing files that changed from the base of the PR and between 79e7907 and e0c57f1.

Files selected for processing: 3
  • README.md
  • src/index.ts
  • test/unit/scoring/root-exports.test.ts
Linked repositories identified

CodeRabbit considers these linked repositories for cross-repo context during reviews:

Included review availability: This review used your included allowance. 0 included reviews remain after this review. Your included PR review attempts over the past 7 days set your current allowance at 1 review per hour.

📝 Summary

Summary by CodeRabbit

  • New Features
    • The package now provides package-root access to deep evaluation, category scoring, JSON parsing, and related configuration types.
    • Documentation explains judge selection, zero-weight category handling, and default scoring for skipped categories. Existing deep imports remain supported.

The package entry point now exports DeepEval functions and options, category-scoring functions and calibration parameters, and the JSON parser. A unit test checks that six exported functions match their direct imports. The README documents the package-root exports and related scoring options.

Priority: Not assessed

Estimated code review effort: 2 (Simple) | ~10 minutes

Change: Feature

Merge Risk: Minimal · up to e0c57

The additive package-root exports and documentation are ready to merge.

Pre-merge checks: Passed 5
Check name Status Explanation
Title check Passed The title names the main change: the deep-eval and category-score functions are now exported from the package root. It also uses the conventional feat(scoring) prefix. The 86-character length is long …
Docstring Coverage Passed No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 2 files. (1 skipped: 1 …
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Description check Passed The pull request description clearly describes the root-level exports, exported types, additive API change, compatibility with existing deep imports, test coverage, and README update. These details ma…
Full details: Title check

Explanation

The title names the main change: the deep-eval and category-score functions are now exported from the package root. It also uses the conventional feat(scoring) prefix. The 86-character length is long but still readable, and no vague terms are used.

Full details: Docstring Coverage

Explanation

No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 2 files. (1 skipped: 1 unsupported.)

Full details: Description check

Explanation

The pull request description clearly describes the root-level exports, exported types, additive API change, compatibility with existing deep imports, test coverage, and README update. These details match the changeset.

Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Warning

Linked repositories: Some configured repositories could not be included in this review. Cross-repository analysis may be incomplete. Please check linked-repository access and settings.

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant