0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

15 commits

Author SHA1 Message Date
Corentin Godeau
2d1a99d4c3 zml/exe.zig: added a way tu dupe the exe 2025-02-11 13:03:36 +00:00
Steeve Morin
f974516cbc pjrt: add PJRT_Memory bindings 2025-02-05 17:36:08 +01:00
Steeve Morin
b955775444 async: switch Mutex lock syntax 2025-02-05 17:36:08 +01:00
Steeve Morin
9f931db65d zml/module: disable CUDA libnvptx for older plugin 2025-02-05 17:36:08 +01:00
Steeve Morin
137eb86657 zml/hostbuffer: is buffer is ready, mark it ready 2025-02-05 17:36:08 +01:00
Steeve Morin
d679c7fed1 zml/buffer: await constant buffer creation 2025-02-05 17:36:08 +01:00
Steeve Morin
260e3e10e3 zml: add asynchronous HostBuffer event 2025-02-05 17:36:08 +01:00
Steeve Morin
1cef4fce04 zml,mnist: fix async buffers handling 2025-02-05 17:36:08 +01:00
Rene Schallner
3d9b2aab64 zml(buffer): fix const bug in toHostAlloc 2025-02-05 17:36:08 +01:00
Steeve Morin
b20c3d07e2 zml/exe: don't await for shard after execution 2025-02-05 17:36:08 +01:00
Steeve Morin
864632fde3 zml: add Buffer.Shard type 2025-02-05 17:36:08 +01:00
Steeve Morin
bf273aa32f zml/aio: await weights transfers 2025-02-05 17:36:08 +01:00
Rene Schallner
fa65c5b6e7 llama: fix async toHost usage when fetching token from device. 2025-02-05 17:36:08 +01:00
Steeve Morin
f6b08dd4cb zml/aio: wait for buffer readiness in loadBuffers 2025-02-05 17:36:08 +01:00
Steeve Morin
ac89abcf67 zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-02-05 17:36:08 +01:00
9 changed files with 121 additions and 65 deletions