0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/platforms/cpu
Raphael Nahoum 2b604ebfc6
zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054)
Replaces the `zml$flash_attn` custom call with Metal DSL kernels over
contiguous K/V:

- `fa_vec` + `fa_vec_reduce` for bf16 decode, at most 256 threads per
threadgroup.
- `fa_tiled` for prefill and f16.
- Batched queries work (the old path panicked). Other dtypes and head
dims fall back to sdpa.

Bumps the plugins to
[202611101651.363.1.d46c7471c419](2026111016.363.1.d46c7471c419)
History 2026-11-10 18:51:08 +01:00
..
BUILD.bazel platforms: bump plugins to 202609181631.57.1.f601577e1ab1 (#837) 2026-09-18 20:00:56 +02:00
cpu.bzl zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
cpu.zig bazel: rework zig_options to be config_settting compatible 2026-09-24 22:21:44 +02:00
packages.lock.json platforms: switch LLVM libunwind packages from 23 to 22 (#907) 2026-10-07 19:13:33 +02:00
packages.yaml platforms: switch LLVM libunwind packages from 23 to 22 (#907) 2026-10-07 19:13:33 +02:00