0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/examples/llm/models/llama
Raphael Nahoum 46bd32de2f zml/tokenizer: grow the decoder output to fit any token
IREE writes a token's text whole or not at all, so `feedOne` asserted
whenever the caller's buffer was smaller than the token, e.g. Laguna's
415-byte whitespace tokens in a 128-byte buffer. The decoder now owns
its output buffer and grows it the way `decode` already did, so
`feedOne` and `finalize` no longer take a buffer.
History 2026-11-09 10:56:20 +01:00
..
inference.zig examples/llm: sample only the last prompt token (#965) 2026-10-21 11:47:42 +02:00
model.zig zml/attention: declare manual partitioning in the shared API instead of kernels (#1016) 2026-11-05 13:00:00 +01:00
session.zig zml/tokenizer: grow the decoder output to fit any token 2026-11-09 10:56:20 +01:00