0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/examples/llm/models
Raphael Nahoum 46bd32de2f zml/tokenizer: grow the decoder output to fit any token
IREE writes a token's text whole or not at all, so `feedOne` asserted
whenever the caller's buffer was smaller than the token, e.g. Laguna's
415-byte whitespace tokens in a 128-byte buffer. The decoder now owns
its output buffer and grows it the way `decode` already did, so
`feedOne` and `finalize` no longer take a buffer.
History 2026-11-09 10:56:20 +01:00
..
lfm2 zml/tokenizer: grow the decoder output to fit any token 2026-11-09 10:56:20 +01:00
llama zml/tokenizer: grow the decoder output to fit any token 2026-11-09 10:56:20 +01:00
qwen3_5 zml/tokenizer: grow the decoder output to fit any token 2026-11-09 10:56:20 +01:00
qwen3_5_moe zml/tokenizer: grow the decoder output to fit any token 2026-11-09 10:56:20 +01:00
common.zig zml/platform: Add furiosa platform (#871) 2026-10-09 12:21:16 +02:00
lfm2.zig examples/llm: Simplifications (#430) 2026-03-24 18:16:25 +01:00
lfm2_tests.zig zml: re-structure attention kernels (#926) 2026-10-12 20:31:17 +02:00
llama.zig examples/llm: Simplifications (#430) 2026-03-24 18:16:25 +01:00
llama_tests.zig zml/Tensor: explicit sharding in Tensor code (#868) 2026-10-06 15:37:22 +02:00
qwen3_5.zig examples/llm: Simplifications (#430) 2026-03-24 18:16:25 +01:00
qwen3_5_moe.zig zml/moe : Moe backend triton zig, qwen3_5_moe model (#529) 2026-05-15 11:06:02 +02:00