llama.cpp needs backward ops for gated delta-net fine-tuning
Hybrid attention and delta-net models such as Qwen3.5 cannot run through llama_opt_epoch until several missing gradient rules land.
By tensorHybrid attention and delta-net models such as Qwen3.5 cannot run through llama_opt_epoch until several missing gradient rules land.
By tensorA broad patch set enables boolean control over retained logits and exposes last hidden states for the model family.
By tensorAlignment math can overflow so a crafted model file bypasses size checks and understates its true footprint.
By tensorA proposed torch.autograd.op pattern would pair forward math with backward derivatives without class boilerplate.
By tensorComplex dtypes can now go through the compiler via a real-valued decomposition path that must be opted in explicitly.
By tensorOn Apple Silicon, scaled_dot_product_attention with is_causal=True can silently ignore the causal mask for float16 and bfloat16.
By tensor