Skip to content

feat: add openinfer provider with model mappings - #6

Open
onkarbpatil wants to merge 2 commits into
openmodelsrun:mainfrom
onkarbpatil:add-provider/openinfer
Open

feat: add openinfer provider with model mappings#6
onkarbpatil wants to merge 2 commits into
openmodelsrun:mainfrom
onkarbpatil:add-provider/openinfer

Conversation

@onkarbpatil

@onkarbpatil onkarbpatil commented Aug 19, 2026

Copy link
Copy Markdown

Summary

Adds OpenInfer (openinfer.io) as an inference provider, with mappings for the two models it currently serves. Both models are new to the registry, so their canonical model entries are included.

Disclosure: I work at OpenInfer, so provider details (model catalog, rate limits) come from first-hand knowledge of the service.

Files added

  • providers/openinfer.yaml — OpenAI-compatible API at https://api.openinfer.ai/v1, bearer auth, global routing across distributed CPU/GPU/NPU compute
  • models/qwen3-5-9b.yaml — Qwen 3.5 9B (Alibaba, Apache 2.0, 262K context, multimodal)
  • models/llama-3-2-1b.yaml — Llama 3.2 1B Instruct (Meta, 128K context)
  • mappings/openinfer/qwen3-5-9b.yaml — served as @oi/Qwen3.5-9B
  • mappings/openinfer/llama-3-2-1b.yaml — served as @oi/Llama-3.2-1B-Instruct

Pricing note

OpenInfer Cloud is free through August 31, 2026 (see openinfer.io/cloud), so mappings list $0.00 input/output. We will submit an update with post-promo rates when the free period ends.

Validation

python validate_registry.py passes — 403 files validated.

🤖 Generated with Claude Code

Adds OpenInfer (platform.openinfer.io) as an inference provider with
mappings for Qwen 3.5 9B and Llama 3.2 1B Instruct, including new
registry model entries for both.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@onkarbpatil

Copy link
Copy Markdown
Author

Hi, I ahve added this PR to integrate OpenInfer's OICloud as an infernece provider service. I have the API key generated, but wasn't sure where to add or how to share. Please help with that.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@onkarbpatil

Copy link
Copy Markdown
Author

Hi, @madeburo, could we get an update on merging this PR?

@madeburo

madeburo commented Sep 1, 2026

Copy link
Copy Markdown
Member

Hi @onkarbpatil
Thanks for the contribution the registry structure looks good and local validation passes.

Before we can merge, please address the following:

  1. The mappings currently list $0.00 pricing based on the free preview ending August 31, 2026. Since that date has passed, please confirm that the promotion was extended or update both mappings with the current post-preview pricing and an official public source.

  2. Our provider requirements specify a publicly accessible API rather than an invite-only/private preview. The OpenInfer Cloud page currently shows “free preview” and “Request Access.” Please clarify the current access model and provide a public signup or documentation link.

  3. Please provide public references for the model IDs, 60 RPM / 100K TPM limits, and provider-supported context windows. If OpenInfer supports a smaller context than the canonical models, please set context_window_override accordingly.

Please do not share the API key in this PR or commit it to the repository. API credentials can be handled separately through a private channel or repository secrets when telemetry integration is configured.
Once these points are updated, we’ll be happy to review the PR again. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants