0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

24 commits

Author SHA1 Message Date
Hugo Mano
80063808ec squash 2025-05-26 12:33:31 +00:00
Steeve Morin
4c6851b545 zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-04-30 11:00:57 +00:00
Hugo Mano
0e8ccfca1f updates 2025-04-30 10:59:26 +00:00
Guillaume Wenzek
3173af4e31 Buffer.asPinnedHostBuffer 2025-04-24 13:57:56 +02:00
Guillaume Wenzek
6d2484a377 chooseItems should assert type 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
b459fa0c0d better error messages for shape parsing 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
74f7977632 more precise f32 -> bf16 conversion 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
2484028fdd Revert "Buffer.fromHostWithPadding"
This reverts commit 0e7bd71bdca516fa797ffd287db528827b4cdf0a.
2025-04-24 10:06:06 +02:00
Guillaume Wenzek
c724741283 Buffer.fromHostWithPadding 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
975f24d8c0 memcpyAsync 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
4e49d6a1b7 SIMD copyTags 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
5cc95c2a5e make it work using cuda memcpy blocking 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
74434b9947 explicit cudaCopy for hostBufferCallback 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
870cbcf326 stdx.fmt: format slices
this is an improved version from what was implemented in "prettyPrinter"
but I had to dig a bit into the fmt internal to achieve it.

Signed-off-by: Guillaume Wenzek <wzk@zml.ai>
2025-04-24 10:06:05 +02:00
Guillaume Wenzek
7c953416c8 zml: accelerate HostBuffer.choose 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
aa6cca9ea1 async.Queue
fixup! async.Queue
2025-04-24 10:06:04 +02:00
Guillaume Wenzek
7cead132a6 mprotect output hostbuffers 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
31919e590c HostBuffer.choose 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
ab2d3db688 pass tags to the callback 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
8fb6f98326 rename ffi types 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
ef44232a1b HostBuffer.mutItems 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
f8b2cd7592 buffered tensor print 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
a059e6db8f promote rmsNorm to zml.nn 2025-04-24 10:06:03 +02:00
Guillaume Wenzek
39ef2d22fb add llama3 style of Rope 2025-04-24 10:06:03 +02:00
1155 changed files with 41453 additions and 230199 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

11
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

3771
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Some files were not shown because too many files have changed in this diff Show more