b9406
b9406
View on GitHubView PackagePublished: May 29, 2026

Release Notes

llama: add llm_graph_input_mtp (#23643)

  • llama: add llm_graph_input_mtp

  • rename input_mtp -> input_token_embd

  • add TODO about mtmd embedding

  • cont : clean-up


Co-authored-by: Georgi Gerganov [email protected]

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: