mirror of
https://github.com/zml/zml.git
synced 2026-11-16 19:11:09 +00:00
- Select TCL for plain E4M3FN block-128 experts with matching BF16 or F32 scales. Preserve rejection of unsupported quantization. - Quantize activations per block and apply checkpoint scales during native projections. Keep BF16 materialization and F32 down and routing accumulation. - Reuse local expert routing and AllReduce for expert parallelism. Choose expert-stationary for small FP8 token counts and use the existing activation-stationary and blockwise recipes for larger counts. - Share FP8 and BF16 dispatch preparation while retaining the token padding and BF16 SiLU rounding workarounds. |
History
|
|
|---|---|---|
| .. | ||
| cpu | ||
| cuda | ||
| furiosa | ||
| metal | ||
| neuron | ||
| oneapi | ||
| rocm | ||
| tpu | ||
| BUILD.bazel | ||
| packages.bzl | ||
| platforms.zig | ||