0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

24 commits

Author SHA1 Message Date
Hugo Mano
80063808ec squash 2025-05-26 12:33:31 +00:00
Steeve Morin
4c6851b545 zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-04-30 11:00:57 +00:00
Hugo Mano
0e8ccfca1f updates 2025-04-30 10:59:26 +00:00
Guillaume Wenzek
3173af4e31 Buffer.asPinnedHostBuffer 2025-04-24 13:57:56 +02:00
Guillaume Wenzek
6d2484a377 chooseItems should assert type 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
b459fa0c0d better error messages for shape parsing 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
74f7977632 more precise f32 -> bf16 conversion 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
2484028fdd Revert "Buffer.fromHostWithPadding"
This reverts commit 0e7bd71bdca516fa797ffd287db528827b4cdf0a.
2025-04-24 10:06:06 +02:00
Guillaume Wenzek
c724741283 Buffer.fromHostWithPadding 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
975f24d8c0 memcpyAsync 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
4e49d6a1b7 SIMD copyTags 2025-04-24 10:06:06 +02:00
Guillaume Wenzek
5cc95c2a5e make it work using cuda memcpy blocking 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
74434b9947 explicit cudaCopy for hostBufferCallback 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
870cbcf326 stdx.fmt: format slices
this is an improved version from what was implemented in "prettyPrinter"
but I had to dig a bit into the fmt internal to achieve it.

Signed-off-by: Guillaume Wenzek <wzk@zml.ai>
2025-04-24 10:06:05 +02:00
Guillaume Wenzek
7c953416c8 zml: accelerate HostBuffer.choose 2025-04-24 10:06:05 +02:00
Guillaume Wenzek
aa6cca9ea1 async.Queue
fixup! async.Queue
2025-04-24 10:06:04 +02:00
Guillaume Wenzek
7cead132a6 mprotect output hostbuffers 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
31919e590c HostBuffer.choose 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
ab2d3db688 pass tags to the callback 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
8fb6f98326 rename ffi types 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
ef44232a1b HostBuffer.mutItems 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
f8b2cd7592 buffered tensor print 2025-04-24 10:06:04 +02:00
Guillaume Wenzek
a059e6db8f promote rmsNorm to zml.nn 2025-04-24 10:06:03 +02:00
Guillaume Wenzek
39ef2d22fb add llama3 style of Rope 2025-04-24 10:06:03 +02:00
49 changed files with 2785 additions and 491 deletions