b9722
b9722
View on GitHubView PackagePublished: Jun 19, 2026

Release Notes

server: fix non-bound n_discard value (ctx shifting) (#24786)

  • server: fix non-bound n_discard value

  • Update tools/server/server-context.cpp

Co-authored-by: Georgi Gerganov [email protected]


Co-authored-by: Georgi Gerganov [email protected]

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: