CodeTranslation: Update API client for chat completions and add proxy support#117
Open
tintisimone wants to merge 1 commit into
Open
Conversation
tintisimone
added a commit
to tintisimone/stinti.Enterprise-Inference
that referenced
this pull request
Jul 7, 2026
Split application-level CodeTranslation changes into PR opea-project#117 to reduce review burden and keep this PR focused on XPU/BMG infrastructure changes. Co-Authored-By: Claude Sonnet 4.5 (1M context) <noreply@anthropic.com>
tintisimone
added a commit
to tintisimone/stinti.Enterprise-Inference
that referenced
this pull request
Jul 8, 2026
Add vLLM-based inference support for Intel Arc Battlemage (BMG) discrete GPUs to the single-node deployment: Helm values for the BMG vLLM serving container, XPU-aware model selection, Intel GPU device-plugin wiring, and setup documentation. Incorporates review feedback: run the vLLM container as non-root, use xpu*-style naming instead of bmg-specific names, replace hardcoded inventory/config values with placeholders, and de-duplicate the kubernetes SDK install tasks. The CodeTranslation changes were split into a separate PR (opea-project#117) to keep this one focused on XPU/BMG. Signed-off-by: tintisimone <simone.tinti@intel.com>
… support - Migrate from completions API to chat.completions API for better compatibility - Update api_client.py to use system/user message format instead of raw prompts - Add proxy build args to docker-compose.yaml for both backend and frontend - Remove restart policy from frontend service for consistency - Update docstring to reference generic "instruct model" instead of CodeLlama-34b Co-Authored-By: Claude Sonnet 4.5 (1M context) <noreply@anthropic.com> Signed-off-by: Simone Tinti <tintisimone@users.noreply.github.com>
tintisimone
force-pushed
the
feature/code-translation-api-updates
branch
from
July 8, 2026 09:17
5d5c09b to
3900b0b
Compare
Author
|
This PR contains the CodeTranslation changes that were split out of #114 to keep that PR focused on the XPU/BMG infrastructure. Summary of changes (2 files):
The commit is DCO-signed and the check is green. I don't have permission to formally request reviewers on this repo — @AhmedSeemalK @vhpintel @amberjain1, could one of you (or a maintainer) take a look / assign reviewers when you have a chance? Thanks! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Update CodeTranslation sample solution to use modern chat completions API and add proxy support for enterprise environments.
Changes:
completionsAPI tochat.completionsAPI for better compatibility with modern LLM inference servicesdocker-compose.yamlfor both backend and frontend servicesrestart: unless-stoppedpolicy from frontend service for consistencyWhy:
completionsAPI is being phased out in favor ofchat.completionsacross most LLM providersTesting:
Related:
Split from #114 to separate application-level changes from XPU infrastructure changes, per reviewer feedback.
🤖 Generated with Claude Code