0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

22 commits

Author SHA1 Message Date
Corentin Godeau
b17ca41783 zml/buffer.zig: added Buffer.fromBytes 2025-02-03 10:17:00 +00:00
Corentin Godeau
166c454377 Merge remote-tracking branch 'origin/gw/tinyllama' into temp 2025-02-01 12:28:12 +00:00
Corentin Godeau
d9f2fa8d19 zml/tensor.zig: add maximum as scatter operation 2025-01-28 11:09:01 +00:00
Guillaume Wenzek
db78d1706d reuse cc_binary because native_binary break runfiles 2025-01-28 11:57:09 +01:00
Guillaume Wenzek
568406937c make tokenizer/main.zig into a proper test utility 2025-01-28 11:35:07 +01:00
Guillaume Wenzek
3d3c0b1c2f fix casing of functions 2025-01-28 10:43:38 +01:00
Guillaume Wenzek
3d269a3a89 use native_binary instead of cc_binary 2025-01-28 10:41:22 +01:00
Guillaume Wenzek
067f9ec563 use official tinyllama files 2025-01-28 10:41:21 +01:00
Guillaume Wenzek
2673174df2 zml: restore homemade tokenizer 2025-01-28 10:41:02 +01:00
Guillaume Wenzek
744b10bfea move flags to stdx
fixup! move flags to stdx
2025-01-28 10:40:40 +01:00
Steeve Morin
f4eb7594b4 zml/module: disable CUDA libnvptx for older plugin 2025-01-26 12:16:32 +00:00
Steeve Morin
6e3879546b zml/hostbuffer: is buffer is ready, mark it ready 2025-01-26 12:16:04 +00:00
Steeve Morin
39a64d1041 zml/buffer: await constant buffer creation 2025-01-26 12:15:35 +00:00
Steeve Morin
b3fdf197fe zml: add asynchronous HostBuffer event 2025-01-24 21:15:50 +01:00
Steeve Morin
1141fa7f9d zml,mnist: fix async buffers handling 2025-01-24 21:11:03 +01:00
Rene Schallner
9a683a87b2 zml(buffer): fix const bug in toHostAlloc 2025-01-24 21:10:40 +01:00
Steeve Morin
85698b515e zml/exe: don't await for shard after execution 2025-01-24 21:10:36 +01:00
Steeve Morin
2612952a44 zml: add Buffer.Shard type 2025-01-24 21:10:25 +01:00
Steeve Morin
9517504d02 zml/aio: await weights transfers 2025-01-24 21:09:50 +01:00
Rene Schallner
9ca43972d8 llama: fix async toHost usage when fetching token from device. 2025-01-24 21:09:43 +01:00
Steeve Morin
8a5b73e70b zml/aio: wait for buffer readiness in loadBuffers 2025-01-24 21:09:40 +01:00
Steeve Morin
7980fb51ff zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-24 21:09:12 +01:00
25 changed files with 2114 additions and 889 deletions