Python 3.12 wheel

[neosr-project]

Hi. It looks like onnxsim from PyPI does not install when using python 3.12. Is there any plans to support >3.11?

[ogencoglu]

+1

[umarbutler]

+1

[umarbutler]

I would recommend checking out OnnxSlim. I was able to install it on Python 3.12 without any issues.

[Puiching-Memory]

I successfully installed onnxsim==0.4.36 in python3.12.7
pip install onnxsim==0.4.36

[ryanli]

This is probably an issue with older cmake version:

      CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
        CMake 3.22 or higher is required.  You are running version 3.18.4

It does install for me with a newer cmake.

[kevalmorabia97]

+1 to having pre-built wheels instead of having to build from source which requires cmake

[xiaoniaogangsi]

I'm running on Python 3.13.2, and after I updated my cmake to the newest 3.31.6, I installed onnxsim-0.4.36 successfully.
I solved problem using this method, @ryanli thank you!

This is probably an issue with older cmake version:

      CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
        CMake 3.22 or higher is required.  You are running version 3.18.4

It does install for me with a newer cmake.

[fxmarty-amd]

onnxsim with python 3.12 seems to require cmake<4.0.

cc @daquexian will you release a wheel for python 3.12?

[iongion]

On python 3.12 and ubuntu 24.04 - This did it for me CMAKE_ARGS="-DCMAKE_POLICY_VERSION_MINIMUM=3.5" pip install --use-pep517 onnxsim

[polarathene]

Not exactly what everyone will want, but if you're comfortable with using containers you can build this:

FROM fedora:42
# NOTE: Python 3.13 with CMake 3.31.6
RUN dnf install -yq pipx python3-devel cmake clang && dnf clean all
RUN pipx install onnxsim --preinstall onnxruntime

WORKDIR /models
ENTRYPOINT ["/root/.local/bin/onnxsim"]

# Took about 5 minutes to build for me (1.15GB image size):
docker build --tag localhost/onnxsim .

# Run the container with local models directory containing `original.onnx`,
# After processing you'll find a `simplified.onnx` file there too
docker run --rm -it --volume ./models:/models/:Z localhost/onnxsim original.onnx simplified.onnx

The Python used there is 3.13, but it's also worked well for Python 3.12. Bit different if installing from the git repo I think, but for most users that just want a CLI tool to process the model this approach works well.

---

Reducing image size from 1.15GB => 50MB

If the 1.15GB image size is a concern, you can switch to a multi-stage image. Build and run commands are the same but image size can be as low as ~50MB.

Fedora (152MB)

# syntax=docker/dockerfile:1

FROM fedora:42 as builder
RUN dnf install -yq pipx python-devel cmake clang && dnf clean all
# Install `onnx-simplifier`:
RUN pipx install onnxsim --preinstall onnxruntime
# Package into a single executable via PyInstaller (43MB):
WORKDIR /opt/pyinstaller
RUN <<HEREDOC
  pipx inject onnxsim pyinstaller
  source /root/.local/share/pipx/venvs/onnxsim/bin/activate
  pyinstaller --onefile /root/.local/bin/onnxsim
HEREDOC

# Create a minimal Fedora base image:
# (109MB, or 187MB if adding `python` - but that is redundant when using PyInstaller)
FROM builder AS root-fs
RUN dnf --installroot /root-fs --use-host-config --setopt=install_weak_deps=0 install -yq \
  libstdc++ zlib

# Runtime image (152MB):
FROM scratch
COPY --link --from=root-fs /root-fs /
COPY --link --from=builder /opt/pyinstaller/dist/onnxsim /usr/local/bin/onnxsim
WORKDIR /models
ENTRYPOINT ["onnxsim"]

Ubuntu (51MB)

# syntax=docker/dockerfile:1

FROM fedora:42 AS builder
# This example shows how to target a specific version of Python:
# (important if needing to match the version for a runtime python image)
RUN dnf install -yq python3.12-devel cmake clang which && dnf clean all
# Install `onnx-simplifier`, then package into a single executable via PyInstaller (43MB):
WORKDIR /opt/pyinstaller
RUN <<HEREDOC
  python3.12 -m venv env
  source env/bin/activate
  python -m pip install onnxsim onnxruntime pyinstaller
  pyinstaller --onefile $(which onnxsim)
HEREDOC

# Custom chisel image until an official one is released:
FROM alpine AS chisel
ARG CHISEL_VERSION=1.1.0
ARG TARGETARCH
# NOTE: `--no-same-owner` used as `chisel` release has ownership of `1001:128`
RUN <<HEREDOC
  CHISEL_RELEASE="https://github.com/canonical/chisel/releases/download/v${CHISEL_VERSION}/chisel_v${CHISEL_VERSION}_linux_${TARGETARCH}.tar.gz"
  wget -qO - "${CHISEL_RELEASE}" | tar -xz --no-same-owner -C /usr/local/bin chisel
HEREDOC

# Use Canonical's Chisel tool to create a minimal Ubuntu base image (8MB /root-fs):
FROM chisel AS root-fs
WORKDIR /root-fs
RUN chisel cut --release ubuntu-24.04 --root /root-fs base-files_base libc6_libs libstdc++6_libs zlib1g_libs

# Runtime image (51MB):
FROM scratch
COPY --link --from=root-fs /root-fs /
COPY --link --from=builder /opt/pyinstaller/dist/onnxsim /usr/local/bin/onnxsim
WORKDIR /models
ENTRYPOINT ["onnxsim"]

Base image selection notes:

• ubuntu/python:3.12-24.04 lacked libstdc++, while bundling Python via PyInstaller was incompatible with gcr.io/distroless/cc-debian12 which lacked libz.
• Chisel lacks an official image atm, so it's a bit more verbose of a stage to prepare the minimal base image. Chisel is much more granular / optimal for base images, while Fedora is very simple/straight-forward with some added base weight as the drawback.

PyInstaller for reduced size

There might be some better alternatives to PyInstaller, but it was a fairly simple way to bring the size down. Inspecting the output of PyInstaller --onedir, it's effectively all shared libs and CPython, any waste from Python's venv site-packages is gone (tests, docs, etc), 70MB alone is .pyc + .pyi files.

PyInstaller does bundle both libstdc++ and libz libraries, so those technically aren't required if you don't use --onefile, but use --onedir instead.

• However you'd then need to run with an ENV like LD_LIBRARY_PATH=/opt/dist/onnxsim/_internal and run the executable at /opt/dist/onnxsim/onxxsim, this also skips compression which raises the on-disk size from 43MB to 109MB (101MB for _internal/ + 8MB for the onnxsim binary). The overhead at runtime from decompression is minimal (1s vs 2s).
• Doing so only enables reducing the Chisel image base size from 8MB down to 5MB. Seemed better to keep it simple with --onefile.

The only other concern for portability there might be glibc from the builder image potentially being too new for a different runtime base image like Chisel at some point. If that happens just build on an older Fedora release instead.

[tsukumijima]

Unfortunately, the project has been left untouched for just over a year. At present, there are no pre-built wheels for Python 3.12 or 3.13, so installing it—especially inside Docker—requires a build toolchain and a fair bit of compile time. (related: #353 , #359)
Pre-built wheels for Linux aarch64 have never been provided, either. (related: #328)

Because I was tired of waiting for a full compile each time I installed the dependencies, I published a fork called onnxsim-prebuilt on PyPI (https://pypi.org/project/onnxsim-prebuilt/).
GitHub: https://github.com/tsukumijima/onnx-simplifier-prebuilt

Although it began as a personal solution, I’ve uploaded wheels for Python 3.10, 3.11, 3.12, and 3.13 covering Windows x64, macOS universal2, and Linux x86_64 / aarch64.
Specifically, after incorporating the suggestions in #359, we fixed more CI errors, added a Linux aarch64 build, and improved the tests to pass on all versions except macOS x64.

Until the upstream project is updated, you might find this package useful.
Aside from updating the CI scripts and bumping the onnx-optimizer and onnxruntime dependencies, it is identical to the original repository.

[FengJungle]

+1, I need it……