All pull requests

Pull requests

• Bump black from 25.12.0 to 26.10.1

  dependenciespython:uv
  #316·dependabot[bot] opened Oct 25, 2026Bot·

  ·

• Bump pillow from 12.1.0 to 13.0.0

  dependenciespython:uv
  #315·dependabot[bot] opened Oct 25, 2026Bot·

  ·

• feat(converters): add SimpleAudit converter

  #312·SushantGautam opened Oct 14, 2026·

  ·
  1

• Declare the aiXamine cybersecurity-knowledge collection

  #310·fatihdeniz opened Oct 13, 2026Contributor·

  ·

• Flat rebuild: mark superseded captures in the index

  #307·j-chim opened Sep 28, 2026Contributor·

  ·

• Adapters: read generation config and source data from the published run records

  #306·j-chim opened Sep 28, 2026Contributor·

  ·

• Isolate CI secrets from dependency installation

  #305·Erotemic opened Sep 28, 2026Collaborator·

  ·

• [Feature] Warn when instance sample_ids contain a scrubber placeholder

  #298·marliechorgan opened Sep 24, 2026·4 tasks done·

  ·

• [Feature] Add the MTEB adapter

  #297·nahatav opened Sep 23, 2026·

  ·
  3

• [Feature] Last Translation Benchmark (LTBv1) converter

  #295·eliyahabba opened Sep 13, 2026Contributor·

  ·
  1

• Reach a frozen source through the cron, rather than around it

  #294·borgr opened Sep 10, 2026Collaborator·

  ·

• Address the archive's pre-namespace rows at the namespace they live at

  #293·borgr opened Sep 10, 2026Collaborator·

  ·

• Retry a Hub server error instead of ending the adapter's run

  #292·borgr opened Sep 10, 2026Collaborator·

  ·

• Address the hal datastore path by the model id it publishes

  #289·borgr opened Sep 5, 2026Collaborator·

  ·

• Declare a metric's scale only where something backs the claim

  #287·borgr opened Sep 5, 2026Collaborator·5 of 7 tasks·

  ·
  1

• Add a wrapper that points the lm_eval converter at a public repo of harness JSON

  #286·borgr opened Sep 2, 2026Collaborator·

  ·

• Stop publishing a pre-v0.4 lm-eval standard error as if it were a score

  #285·borgr opened Sep 2, 2026Collaborator·

  ·

• Add the LM-Harmony adapter, keeping its two evaluation protocols unjoinable

  #284·borgr opened Sep 2, 2026Collaborator·

  ·

• docs: harden datastore PR review workflow

  #241·nelaturuharsha opened Aug 9, 2026Collaborator·19 of 20 tasks·

  ·
  9

• Draft: lighteval converter (for #189)

  #235·Mandark-droid opened Aug 7, 2026·

  ·
  21

• feat: add sayf-eval results-record converter

  #220·Aymen311 opened Aug 5, 2026·

  ·
  31

• feat: add generalized Kaggle Community Benchmarks adapter

  #191·mrshu opened Jun 21, 2026Contributor·

  ·
  15

• Transparent Compression

  #133·Erotemic opened May 8, 2026Collaborator·

  ·
  14