Issues

• TRITON_ONNXRUNTIME_LIB_PATHS skips installing ONNX Runtime's own .so files into the final backend directory

  triton-inference-server/onnxruntime_backend#364 · Filter by author VictorBauler opened on Sep 15, 2026

• Building ONNX backend worked, but needs cuda 11-8 libs

  triton-inference-server/onnxruntime_backend#321 · Filter by author protonicage opened on Oct 9, 2025

• OpenVINO CPU Execution Accelerator Fails with "Device with 'NPU' name is not registered" Error

  triton-inference-server/onnxruntime_backend#300 · Filter by author alib1513 opened on Mar 20, 2025
  1

• Limited GPU Memory Utilization in ColBERT Deployment

  triton-inference-server/onnxruntime_backend#293 · Filter by author nauyan opened on Jan 17, 2025

• Parallel warmup when using multiple GPUs

  triton-inference-server/onnxruntime_backend#292 · Filter by author asaff1 opened on Jan 12, 2025

• Built-in support for (custom?) decryption of model weights

  triton-inference-server/onnxruntime_backend#279 · Filter by author vadimkantorov opened on Oct 28, 2024
  1

• Deploy TTS model with Triton and onnx backend, failed:Protobuf parsing failed

  triton-inference-server/onnxruntime_backend#272 · Filter by author AnasAlmana opened on Sep 25, 2024

• [Question] Multiple model inputs and GPU allocations

  triton-inference-server/onnxruntime_backend#269 · Filter by author copy-on-meow opened on Aug 29, 2024

• load_model fail cause gpu memory leak

  triton-inference-server/onnxruntime_backend#268 · Filter by author zjd1988 opened on Aug 27, 2024

• How do I get all possible input and output names?

  triton-inference-server/onnxruntime_backend#267 · Filter by author zhmiao opened on Aug 22, 2024

• Triton ONNX runtime backend slower than onnxruntime python client on CPU

  triton-inference-server/onnxruntime_backend#265 · Filter by author Mitix-EPI opened on Aug 19, 2024
  7

• OpenVINO EP doesn't respect threading parameters

  triton-inference-server/onnxruntime_backend#260 · Filter by author mbahri opened on Jul 6, 2024
  1

• UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: X does not support 'onnxruntime' TRITONBACKEND API version X

  triton-inference-server/onnxruntime_backend#259 · Filter by author pultarmi opened on Jun 28, 2024

• Is onnxruntime-genai supported?

  triton-inference-server/onnxruntime_backend#251 · Filter by author jackylu0124 opened on May 4, 2024
  1

• Failed to allocated memory for requested buffer of size X

  triton-inference-server/onnxruntime_backend#249 · Filter by author aaditya-srivathsan opened on Mar 21, 2024
  1

• Facing errors when installing onnxruntime backend for triton

  triton-inference-server/onnxruntime_backend#247 · Filter by author Aniket-20 opened on Mar 15, 2024

• CPU Throttling when Deploying Triton with ONNX Backend on Kubernetes

  triton-inference-server/onnxruntime_backend#245 · Filter by author langong347 opened on Mar 1, 2024
  6

• Enable "trt_build_heuristics_enable" optimization for onnxruntime-TensorRT

  triton-inference-server/onnxruntime_backend#241 · Filter by author tobaiMS opened on Feb 23, 2024
  2

• Will onxxruntime backend support INT8 on cpu ?

  triton-inference-server/onnxruntime_backend#240 · Filter by author bharadwajymg opened on Feb 20, 2024
  1

• Request for Supporting minShapes/optShapes/maxShapes for TensorRT

  triton-inference-server/onnxruntime_backend#232 · Filter by author teith opened on Jan 15, 2024
  1

• Question: Does ONNX-RT silently fallbacks to CPU?

  triton-inference-server/onnxruntime_backend#228 · Filter by author Thytu opened on Dec 20, 2023
  1

• Model failed to create because of output dimensions

  triton-inference-server/onnxruntime_backend#220 · Filter by author nyanmn opened on Nov 27, 2023

• Support arbitrary options for execution providers

  triton-inference-server/onnxruntime_backend#217 · Filter by author gedoensmax opened on Nov 16, 2023

• Error while Loading YOLOv8 Model with EfficientNMS_TRT Plugin in TRITON

  triton-inference-server/onnxruntime_backend#210 · Filter by author whitewalker11 opened on Aug 30, 2023
  2

• how to use onnxruntime profiling in triton

  triton-inference-server/onnxruntime_backend#207 · Filter by author cyh-ustc opened on Jul 25, 2023