0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/platforms
Raphael Nahoum 2b604ebfc6
zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054)
Replaces the `zml$flash_attn` custom call with Metal DSL kernels over
contiguous K/V:

- `fa_vec` + `fa_vec_reduce` for bf16 decode, at most 256 threads per
threadgroup.
- `fa_tiled` for prefill and f16.
- Batched queries work (the old path panicked). Other dtypes and head
dims fall back to sdpa.

Bumps the plugins to
[202611101651.363.1.d46c7471c419](2026111016.363.1.d46c7471c419)
History 2026-11-10 18:51:08 +01:00
..
cpu zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
cuda zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
furiosa zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
metal zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
neuron ci: add supported platforms with bumped and audited deps (#967) 2026-10-20 14:06:49 +02:00
oneapi platforms/oneapi: bump to IGC 2.41.15 (#996) 2026-10-29 11:15:39 +01:00
rocm zml/kernels/flash_attention/metal: port the kernels to the Metal DSL (#1054) 2026-11-10 18:51:08 +01:00
tpu dsl: unify the kernel DSLs (#991) 2026-10-27 17:53:31 +01:00
BUILD.bazel zml/platform: Add furiosa platform (#871) 2026-10-09 12:21:16 +02:00
packages.bzl platforms/cuda: add arm64 support (#493) 2026-04-22 12:37:48 +02:00
platforms.zig zig 0.17 (second attempt) (#923) 2026-10-13 17:11:38 +02:00