Skip to content

added olmo adapter test#1330

Open
Rishik00 wants to merge 2 commits into
TransformerLensOrg:devfrom
Rishik00:olmo-adapter-test-dev
Open

added olmo adapter test#1330
Rishik00 wants to merge 2 commits into
TransformerLensOrg:devfrom
Rishik00:olmo-adapter-test-dev

Conversation

@Rishik00
Copy link
Copy Markdown

Description

Adds unit coverage for the OLMo architecture adapter.

Changes

  • Tests OLMo config defaults, component mapping, and HF module paths.
  • Verifies Q/K/V/O weight conversions use the right head counts for GQA.
  • Adds attention coverage for OLMo attention forward execution and Q/K/V/Z hook shapes.
  • Tests prepare_model() clamp patching and setup_component_testing() rotary/eager-attention wiring.
  • Checks factory registration for OlmoForCausalLM.

To run the test: uv run pytest tests\unit\model_bridge\supported_architectures\test_olmo_adapter.py
All tests have passed.

Relevant to Issue #1302 @jlarson4

Comment thread tests/unit/model_bridge/supported_architectures/test_olmo_adapter.py Outdated
@jlarson4
Copy link
Copy Markdown
Collaborator

Just one small artifact that slipped into your PR. Also, don't forget to run make check-format & resolve any issues to make sure your code passes CI!

@Rishik00
Copy link
Copy Markdown
Author

Rishik00 commented May 26, 2026

The CI passes cleanly. Will get the round tests added in a few hours.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants