sqliteai/waste
★ 2,384 stars
★ 2,064 at coverage → ★ 2,384 (+320)
C
Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
★ 2,384 stars
★ 2,064 at coverage → ★ 2,384 (+320)
Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.