b9767
b9767
View on GitHubView PackagePublished: Jun 23, 2026

Release Notes

ggml-webgpu: improve MTP inference by using mat-vec path for small batches (#24811)

  • ggml-webgpu: improve small batches decoding

  • Add barrier to the NUM_COLS loop in mul-mat-vec

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: