0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

22 commits

Author SHA1 Message Date
Corentin Godeau
b17ca41783 zml/buffer.zig: added Buffer.fromBytes 2025-02-03 10:17:00 +00:00
Corentin Godeau
166c454377 Merge remote-tracking branch 'origin/gw/tinyllama' into temp 2025-02-01 12:28:12 +00:00
Corentin Godeau
d9f2fa8d19 zml/tensor.zig: add maximum as scatter operation 2025-01-28 11:09:01 +00:00
Guillaume Wenzek
db78d1706d reuse cc_binary because native_binary break runfiles 2025-01-28 11:57:09 +01:00
Guillaume Wenzek
568406937c make tokenizer/main.zig into a proper test utility 2025-01-28 11:35:07 +01:00
Guillaume Wenzek
3d3c0b1c2f fix casing of functions 2025-01-28 10:43:38 +01:00
Guillaume Wenzek
3d269a3a89 use native_binary instead of cc_binary 2025-01-28 10:41:22 +01:00
Guillaume Wenzek
067f9ec563 use official tinyllama files 2025-01-28 10:41:21 +01:00
Guillaume Wenzek
2673174df2 zml: restore homemade tokenizer 2025-01-28 10:41:02 +01:00
Guillaume Wenzek
744b10bfea move flags to stdx
fixup! move flags to stdx
2025-01-28 10:40:40 +01:00
Steeve Morin
f4eb7594b4 zml/module: disable CUDA libnvptx for older plugin 2025-01-26 12:16:32 +00:00
Steeve Morin
6e3879546b zml/hostbuffer: is buffer is ready, mark it ready 2025-01-26 12:16:04 +00:00
Steeve Morin
39a64d1041 zml/buffer: await constant buffer creation 2025-01-26 12:15:35 +00:00
Steeve Morin
b3fdf197fe zml: add asynchronous HostBuffer event 2025-01-24 21:15:50 +01:00
Steeve Morin
1141fa7f9d zml,mnist: fix async buffers handling 2025-01-24 21:11:03 +01:00
Rene Schallner
9a683a87b2 zml(buffer): fix const bug in toHostAlloc 2025-01-24 21:10:40 +01:00
Steeve Morin
85698b515e zml/exe: don't await for shard after execution 2025-01-24 21:10:36 +01:00
Steeve Morin
2612952a44 zml: add Buffer.Shard type 2025-01-24 21:10:25 +01:00
Steeve Morin
9517504d02 zml/aio: await weights transfers 2025-01-24 21:09:50 +01:00
Rene Schallner
9ca43972d8 llama: fix async toHost usage when fetching token from device. 2025-01-24 21:09:43 +01:00
Steeve Morin
8a5b73e70b zml/aio: wait for buffer readiness in loadBuffers 2025-01-24 21:09:40 +01:00
Steeve Morin
7980fb51ff zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-24 21:09:12 +01:00
1062 changed files with 43378 additions and 231631 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

11
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

3720
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Some files were not shown because too many files have changed in this diff Show more