ONNX Runtime GenAI: Local LLM Runtimes for Engine-agnostic Active (<30d)

Overview

Microsoft's ONNX generative runtime; good fit for Windows/ONNX pipelines.

Facts

Category

Local LLM Runtimes

Works with

Engine-agnostic

Pricing

Open source: Free and open source.

Licence

MIT

Last commit

2026-10-15 (3 days before snapshot)

Archived

no

GitHub stars

1,137

Official site

https://github.com/microsoft/onnxruntime-genai

Source repository

github.com/microsoft/onnxruntime-genai

Data snapshot

2026-10-18

Alternatives

• Ollama Active (<30d)
• llama.cpp Active (<30d)
• BitNet Recent (<6mo)
• llamafile Active (<30d)

Get GameDex Weekly

Placeholder form: not connected to any service yet.