Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 8 additions & 1 deletion .github/workflows/cmake-linux.yml
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,14 @@ jobs:
if: startsWith(matrix.os, 'debian-') || startsWith(matrix.os, 'ubuntu-')
run: |
cat /etc/os-release
sudo dpkg -i .github/cache/dependencies-apt/*.deb
# The .deb set is cached under the runner label only, so a build job can land on a
# different runner image than the prepare-apt job that downloaded it. When the two images
# ship different versions of a preinstalled library, dpkg's versioned dependencies fail
# (seen with libevent-core 1build3 vs libevent-dev 1ubuntu0.1). Let apt pull whatever the
# cached debs are missing instead of failing the build.
sudo dpkg -i .github/cache/dependencies-apt/*.deb || true
sudo apt-get update -qq
sudo apt-get install -yq -f

- name: Prepare container(onnxruntime)
shell: bash
Expand Down
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# ONNX Runtime Server

[![ONNX Runtime](https://img.shields.io/github/v/release/microsoft/onnxruntime?filter=v1.29.0&label=ONNX%20Runtime)](https://github.com/microsoft/onnxruntime)
[![ONNX Runtime](https://img.shields.io/github/v/release/microsoft/onnxruntime?filter=v1.29.1&label=ONNX%20Runtime)](https://github.com/microsoft/onnxruntime)
[![CMake on Linux](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-linux.yml/badge.svg)](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-linux.yml)
[![CMake on MacOS](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-macos.yml/badge.svg)](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-macos.yml)
[![CMake on Windows](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-windows.yml/badge.svg)](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-windows.yml)
Expand Down Expand Up @@ -191,17 +191,17 @@ server neither adds to it nor changes its default.

- Docker hub: [kibaes/onnxruntime-server](https://hub.docker.com/r/kibaes/onnxruntime-server)
- [
`1.29.0-linux-cuda13`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda13.dockerfile)
`1.29.1-linux-cuda13`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda13.dockerfile)
amd64(CUDA 13.x, cuDNN 9.x)
- [
`1.29.0-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile)
`1.29.1-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile)
amd64(CUDA 12.x, cuDNN 9.x)
- [
`1.29.0-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile)
`1.29.1-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile)
amd64, arm64

```shell
DOCKER_IMAGE=kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12 or 1.29.0-linux-cpu
DOCKER_IMAGE=kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12 or 1.29.1-linux-cpu

docker pull ${DOCKER_IMAGE}

Expand Down
2 changes: 1 addition & 1 deletion deploy/build-docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

## x64 with CUDA

- [ONNX Runtime Binary](https://github.com/microsoft/onnxruntime/releases) v1.29.0(latest) supports CUDA 12/13, cuDNN 9.
- [ONNX Runtime Binary](https://github.com/microsoft/onnxruntime/releases) v1.29.1(latest) supports CUDA 12/13, cuDNN 9.
- Two CUDA variants are available:
- `linux-cuda13`: Built on `nvidia/cuda:13.1.1-cudnn-devel-ubuntu24.04`, runtime based on `nvidia/cuda:13.1.1-cudnn-runtime-ubuntu24.04`
- `linux-cuda12`: Built on `nvidia/cuda:12.9.1-cudnn-devel-ubuntu24.04`, runtime based on `nvidia/cuda:12.9.1-cudnn-runtime-ubuntu24.04`
Expand Down
2 changes: 1 addition & 1 deletion deploy/build-docker/VERSION
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
export VERSION=1.29.0
export VERSION=1.29.1
export IMAGE_PREFIX=kibaes/onnxruntime-server
4 changes: 2 additions & 2 deletions deploy/build-docker/docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ services:
onnxruntime_server_simple:
# After the docker container is up, you can use the REST API (http://localhost:8080).
# API documentation will be available at http://localhost:8080/api-docs.
image: kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12
image: kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12
ports:
- "8080:80" # for http backend
volumes:
Expand All @@ -29,7 +29,7 @@ services:
onnxruntime_server_advanced:
# After the docker container is up, you can use the REST API (http://localhost, https://localhost).
# API documentation will be available at http://localhost/api-docs.
image: kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12
image: kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12
ports:
- "80:80" # for http backend
- "443:443" # for https backend
Expand Down
12 changes: 6 additions & 6 deletions docs/docker.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,9 @@

# Supported tags and respective Dockerfile links

- [`1.29.0-linux-cuda13`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda13.dockerfile) amd64(CUDA 13.x, cuDNN 9.x)
- [`1.29.0-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile) amd64(CUDA 12.x, cuDNN 9.x)
- [`1.29.0-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile) amd64, arm64
- [`1.29.1-linux-cuda13`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda13.dockerfile) amd64(CUDA 13.x, cuDNN 9.x)
- [`1.29.1-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile) amd64(CUDA 12.x, cuDNN 9.x)
- [`1.29.1-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile) amd64, arm64

# How to use this image

Expand Down Expand Up @@ -37,7 +37,7 @@
- API documentation will be available at http://localhost/api-docs.

```shell
DOCKER_IMAGE=kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12 or 1.29.0-linux-cpu
DOCKER_IMAGE=kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12 or 1.29.1-linux-cpu

docker pull ${DOCKER_IMAGE}

Expand Down Expand Up @@ -78,7 +78,7 @@ services:
onnxruntime_server_simple:
# After the docker container is up, you can use the REST API (http://localhost:8080).
# API documentation will be available at http://localhost:8080/api-docs.
image: kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12
image: kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12
ports:
- "8080:80" # for http backend
volumes:
Expand Down Expand Up @@ -110,7 +110,7 @@ services:
onnxruntime_server_advanced:
# After the docker container is up, you can use the REST API (http://localhost, https://localhost).
# API documentation wl be available at http://localhost/api-docs.
image: kibaes/onnxruntime-server:1.29.0-linux-cuda13 # or 1.29.0-linux-cuda12
image: kibaes/onnxruntime-server:1.29.1-linux-cuda13 # or 1.29.1-linux-cuda12
ports:
- "80:80" # for http backend
- "443:443" # for https backend
Expand Down
2 changes: 1 addition & 1 deletion docs/swagger/openapi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ openapi: 3.0.3
info:
title: ONNX Runtime Server
description: |-
version: 1.29.0
version: 1.29.1
externalDocs:
description: ONNX Runtime Server
url: https://github.com/kibae/onnxruntime-server
Expand Down
2 changes: 1 addition & 1 deletion src/test/test_lib_version.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@
#include "./test_common.hpp"

TEST(test_lib_version, LibVersion) {
EXPECT_EQ(onnxruntime_server::onnx::version(), "1.29.0");
EXPECT_EQ(onnxruntime_server::onnx::version(), "1.29.1");
}
Loading