llama.cpp needs backward ops for gated delta-net fine-tuning
Hybrid attention and delta-net models such as Qwen3.5 cannot run through llama_opt_epoch until several missing gradient rules land.
By tensorHybrid attention and delta-net models such as Qwen3.5 cannot run through llama_opt_epoch until several missing gradient rules land.
By tensorUnvalidated tensor ops in GRAPH_COMPUTE handling can drive PAD_REFLECT_1D past the destination buffer on reachable servers.
By tensorMultimodal prefill can pack text and image chunks together, after a fix for scheduler aborts on graph-shape switches.
By tensorThe work also covers a large-context softmax crash and a data race that may affect the full model.
By tensorFuzzing found two paths where malformed model tensors trigger undefined behavior before validation finishes.
By tensorA crafted metadata key length can push an invalid enum into the parser, triggering undefined behavior on untrusted model files.
By tensorCallers who sized the position array to the documented n_tokens still hit a multi-kilobyte overread and silent corruption on multimodal decode.
By tensorJohannes Gaessler rejects a pull request adding CPU quantization formats, citing maintenance burden and machine-generated code.
By tensorTwo-node RPC tests show decode and prefill roughly 1.8x faster with lower intermediate memory use.
By tensor