0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

41 commits

Author SHA1 Message Date
Steeve Morin
5279c779de workspace: MODULE.bazel.lock 2025-01-24 13:54:09 +01:00
Steeve Morin
97120cf6a0 async: implement async await logFn that uses a Mutex 2025-01-24 11:23:19 +01:00
Steeve Morin
d9b43517b1 zml,mnist: fix async buffers handling 2025-01-23 20:43:25 +01:00
Rene Schallner
9b2d1132b8 llama: fix docker targets (cmdline) 2025-01-23 20:43:25 +01:00
Rene Schallner
69c7887262 llama: --create-opts --> --create-options 2025-01-23 20:43:25 +01:00
Steeve Morin
f6e43a1730 workspace: add rules_rust toolchain setup
Needed for cross compiling
2025-01-23 20:43:23 +01:00
Rene Schallner
7d260cdfca llama: re-introduce --create-opts 2025-01-23 20:43:10 +01:00
Rene Schallner
3f0899fe59 llama: cleanup dead code 2025-01-23 20:43:10 +01:00
Rene Schallner
a700ed11af llama: switch container example to 3.2-1B (smaller) 2025-01-23 20:43:10 +01:00
Rene Schallner
6f8506b739 llama: backport Llama3.2 fixes 2025-01-23 20:43:10 +01:00
Rene Schallner
2dd7ac1cea llama WIP prune models 2025-01-23 20:43:10 +01:00
Rene Schallner
2e8f17ddb4 llama(testing): fixed code to current zml APIs 2025-01-23 20:43:10 +01:00
Rene Schallner
aca142b087 zml(buffer): fix const bug in toHostAlloc 2025-01-23 20:43:10 +01:00
Steeve Morin
ed1132b940 zml/exe: don't await for shard after execution 2025-01-23 20:43:10 +01:00
Steeve Morin
84c12784fd zml: add Buffer.Shard type 2025-01-23 20:43:10 +01:00
Steeve Morin
011e34f540 zml/aio: await weights transfers 2025-01-23 20:43:10 +01:00
Steeve Morin
71872bef65 async: suspend resetcondition until set 2025-01-23 20:43:10 +01:00
Corentin Godeau
54e7034d0b zml/tokenizer: improve Rust code and avoid double free 2025-01-23 20:43:10 +01:00
Rene Schallner
138988adc2 llama: fix async toHost usage when fetching token from device. 2025-01-23 20:43:10 +01:00
Steeve Morin
79b0eea11a zml/aio: wait for buffer readiness in loadBuffers 2025-01-23 20:43:10 +01:00
Steeve Morin
35bb70d612 runtimes/tpu: set libtpu SONAME to libpjrt_tpu.so 2025-01-23 20:43:10 +01:00
Rene Schallner
ad344d02a8 llama: 3.1-70B, reintroduce speed, tracer 2025-01-23 20:43:10 +01:00
Steeve Morin
033cab18a5 async,zml: fix asynchronous pjrt.Execute and Condition.broadcast 2025-01-23 20:43:10 +01:00
Rene Schallner
5773fc88db llama: WIP: switch to clap cmdline flags, config.json support, etc. 2025-01-23 20:43:10 +01:00
Steeve Morin
ceae49da44 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
b475ec0199 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
5771973da1 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
842787343a WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
38442777b0 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
1ebbf1d358 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
ff1b4379d2 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
53a8df0805 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
d78debc384 WIP 2025-01-23 20:43:10 +01:00
Steeve Morin
0e3d5e3162 WIP 2025-01-23 20:43:07 +01:00
Steeve Morin
911d279f80 WIP 2025-01-23 20:42:54 +01:00
Steeve Morin
5e5ec5e93b WIP 2025-01-23 20:42:30 +01:00
Steeve Morin
b8e54e15d2 WIP 2025-01-23 20:42:30 +01:00
Steeve Morin
c65ea2a9ea zml/tokenizer: add huggingface tokenizers binding 2025-01-23 20:42:28 +01:00
Steeve Morin
cf6132bab2 WIP 2025-01-23 20:42:11 +01:00
Steeve Morin
ba4c672b63 WIP 2025-01-23 20:40:38 +01:00
Steeve Morin
1ea6b38bbd zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-23 20:40:38 +01:00
1066 changed files with 44327 additions and 232147 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

11
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

3722
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Some files were not shown because too many files have changed in this diff Show more