Corentin Godeau
b17ca41783
zml/buffer.zig: added Buffer.fromBytes
2025-02-03 10:17:00 +00:00
Corentin Godeau
166c454377
Merge remote-tracking branch 'origin/gw/tinyllama' into temp
2025-02-01 12:28:12 +00:00
Corentin Godeau
d9f2fa8d19
zml/tensor.zig: add maximum as scatter operation
2025-01-28 11:09:01 +00:00
Guillaume Wenzek
db78d1706d
reuse cc_binary because native_binary break runfiles
2025-01-28 11:57:09 +01:00
Guillaume Wenzek
568406937c
make tokenizer/main.zig into a proper test utility
2025-01-28 11:35:07 +01:00
Guillaume Wenzek
3d3c0b1c2f
fix casing of functions
2025-01-28 10:43:38 +01:00
Guillaume Wenzek
3d269a3a89
use native_binary instead of cc_binary
2025-01-28 10:41:22 +01:00
Guillaume Wenzek
067f9ec563
use official tinyllama files
2025-01-28 10:41:21 +01:00
Guillaume Wenzek
2673174df2
zml: restore homemade tokenizer
2025-01-28 10:41:02 +01:00
Guillaume Wenzek
744b10bfea
move flags to stdx
...
fixup! move flags to stdx
2025-01-28 10:40:40 +01:00
Steeve Morin
f4eb7594b4
zml/module: disable CUDA libnvptx for older plugin
2025-01-26 12:16:32 +00:00
Steeve Morin
6e3879546b
zml/hostbuffer: is buffer is ready, mark it ready
2025-01-26 12:16:04 +00:00
Steeve Morin
39a64d1041
zml/buffer: await constant buffer creation
2025-01-26 12:15:35 +00:00
Steeve Morin
b3fdf197fe
zml: add asynchronous HostBuffer event
2025-01-24 21:15:50 +01:00
Steeve Morin
1141fa7f9d
zml,mnist: fix async buffers handling
2025-01-24 21:11:03 +01:00
Rene Schallner
9a683a87b2
zml(buffer): fix const bug in toHostAlloc
2025-01-24 21:10:40 +01:00
Steeve Morin
85698b515e
zml/exe: don't await for shard after execution
2025-01-24 21:10:36 +01:00
Steeve Morin
2612952a44
zml: add Buffer.Shard type
2025-01-24 21:10:25 +01:00
Steeve Morin
9517504d02
zml/aio: await weights transfers
2025-01-24 21:09:50 +01:00
Rene Schallner
9ca43972d8
llama: fix async toHost usage when fetching token from device.
2025-01-24 21:09:43 +01:00
Steeve Morin
8a5b73e70b
zml/aio: wait for buffer readiness in loadBuffers
2025-01-24 21:09:40 +01:00
Steeve Morin
7980fb51ff
zml: make buffers and execute asynchronous
...
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-24 21:09:12 +01:00