b9410
b9410
View on GitHubView PackagePublished: May 29, 2026

Release Notes

llama: use f16 mask for FA to save VRAM (#23764)

  • llama: use f16 mask for FA

  • review: add llama_cast + formatting

  • simplify

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: