0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

47 commits

Author SHA1 Message Date
Rene Schallner
9a24cabcab
docs: updated to new llama models 2025-01-22 14:39:06 +01:00
Rene Schallner
4a1d9f6c76
zml(tests): awaitt() buffers in tests 2025-01-22 14:14:11 +01:00
Rene Schallner
9ee92dc0a1
zml(Buffer): fix shards usage 2025-01-22 13:44:21 +01:00
Rene Schallner
bc064813a9
zml(tokenizer): removed tinyllama, gguf, sentencepiece tokenizers 2025-01-22 13:24:55 +01:00
Rene Schallner
06843c9fec
zml(tokenizer): cleanup unnecessary file 2025-01-22 10:54:51 +01:00
Rene Schallner
18076017c6
llama: cleanup 2025-01-22 10:54:41 +01:00
Rene Schallner
a6b4d4cfd7
zml: remove autofixes 2025-01-21 17:05:25 +01:00
Steeve Morin
1546f201b2 workspace: MODULE.bazel.lock 2025-01-21 15:24:04 +01:00
Steeve Morin
261955f3ca zml,mnist: fix async buffers handling 2025-01-21 15:24:04 +01:00
Rene Schallner
ed0eef5fd7
llama: fix docker targets (cmdline) 2025-01-21 15:10:57 +01:00
Rene Schallner
a133143280 llama: --create-opts --> --create-options 2025-01-21 14:39:56 +01:00
Steeve Morin
d2370218be workspace: add rules_rust toolchain setup
Needed for cross compiling
2025-01-21 14:39:56 +01:00
Rene Schallner
bd6e89a7e6 llama: re-introduce --create-opts 2025-01-21 14:39:56 +01:00
Rene Schallner
c1d2aee0f6 llama: cleanup dead code 2025-01-21 14:39:56 +01:00
Rene Schallner
3bdc257d73 llama: switch container example to 3.2-1B (smaller) 2025-01-21 14:39:56 +01:00
Rene Schallner
35c564afa8 llama: backport Llama3.2 fixes 2025-01-21 14:39:56 +01:00
Rene Schallner
be820adcc9 llama WIP prune models 2025-01-21 14:39:56 +01:00
Rene Schallner
747f1ac291 llama(testing): fixed code to current zml APIs 2025-01-21 14:39:56 +01:00
Rene Schallner
31b38ae996 zml(buffer): fix const bug in toHostAlloc 2025-01-21 14:39:56 +01:00
Steeve Morin
441f08e855 zml/exe: don't await for shard after execution 2025-01-21 14:39:56 +01:00
Steeve Morin
18d80bd724 zml: add Buffer.Shard type 2025-01-21 14:39:56 +01:00
Steeve Morin
8317fafd6f zml/aio: await weights transfers 2025-01-21 14:39:56 +01:00
Steeve Morin
62f5388be9 async: suspend resetcondition until set 2025-01-21 14:39:56 +01:00
Corentin Godeau
d83e4b5827 zml/tokenizer: improve Rust code and avoid double free 2025-01-21 14:39:56 +01:00
Rene Schallner
6dbca91098
llama: fix async toHost usage when fetching token from device. 2025-01-20 19:49:20 +01:00
Steeve Morin
f11d84b95f zml/aio: wait for buffer readiness in loadBuffers 2025-01-20 19:12:39 +01:00
Steeve Morin
f72b20ac0c runtimes/tpu: set libtpu SONAME to libpjrt_tpu.so 2025-01-20 19:10:22 +01:00
Rene Schallner
62ced00dfb
llama: 3.1-70B, reintroduce speed, tracer 2025-01-20 19:06:10 +01:00
Steeve Morin
ac7041b487 async,zml: fix asynchronous pjrt.Execute and Condition.broadcast 2025-01-20 17:41:38 +01:00
Rene Schallner
7c31967f5e
llama: WIP: switch to clap cmdline flags, config.json support, etc. 2025-01-20 16:16:43 +01:00
Steeve Morin
7b52e4430a WIP 2025-01-20 15:03:44 +01:00
Steeve Morin
050f028703 WIP 2025-01-20 15:00:02 +01:00
Steeve Morin
976f9465ea WIP 2025-01-20 14:58:37 +01:00
Steeve Morin
c3e26d80c2 WIP 2025-01-20 14:58:37 +01:00
Steeve Morin
906a02e768 WIP 2025-01-20 14:58:35 +01:00
Steeve Morin
484202ed72 WIP 2025-01-20 14:58:18 +01:00
Steeve Morin
33f95033b6 WIP 2025-01-20 14:58:18 +01:00
Steeve Morin
5110f2bded WIP 2025-01-20 14:58:15 +01:00
Steeve Morin
6f60e72fbd WIP 2025-01-20 14:57:09 +01:00
Steeve Morin
c0df6926ea WIP 2025-01-20 14:57:09 +01:00
Steeve Morin
fb4a50adc1 WIP 2025-01-20 14:57:07 +01:00
Steeve Morin
24a3746982 WIP 2025-01-20 14:56:24 +01:00
Steeve Morin
3141dba50f WIP 2025-01-20 14:56:24 +01:00
Steeve Morin
1d05756cb2 zml/tokenizer: add huggingface tokenizers binding 2025-01-20 14:56:24 +01:00
Steeve Morin
debccf507c WIP 2025-01-20 14:56:24 +01:00
Steeve Morin
ab499e0739 WIP 2025-01-20 14:49:02 +01:00
Steeve Morin
662ed247b3 zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-20 14:49:02 +01:00
1042 changed files with 43856 additions and 232183 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

11
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

4552
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Some files were not shown because too many files have changed in this diff Show more