0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

28 commits

Author SHA1 Message Date
Corentin Godeau
f79fb574ae zml/ops.zig: Added zml.ops.case operation
This can be used to select which branch will be run at runtime.

It wraps the `stablehlo.case` operation.
2025-02-11 16:51:30 +00:00
Corentin Godeau
a336507857 pjrt+zml: rework profiler imports
Also expose TraceContainer as it can be useful.
2025-02-05 15:24:27 +00:00
Corentin Godeau
c06ba80e7c zml/buffer.zig: added Buffer.fromBytes 2025-02-05 13:31:03 +00:00
Guillaume Wenzek
b9dd101f88 Merge branch 'gw/fix_llama' into gw/dev2
# Conflicts:
#	examples/llama/main.zig
#	zml/aio.zig
#	zml/pjrtx.zig
2025-02-04 17:21:08 +01:00
Guillaume Wenzek
d2aa8c8398 aio.awaitAll 2025-02-04 17:17:05 +01:00
Guillaume Wenzek
44874b3b7a --xla_dump_hlo_as_proto 2025-02-04 16:45:46 +01:00
Corentin Godeau
576130b750 awaitAll 2025-02-04 16:40:36 +01:00
Guillaume Wenzek
7baf092501 examples/llama: read the token generated in prefill 2025-02-04 16:40:36 +01:00
Guillaume Wenzek
6db444bf9a fix partialSoftmax 2025-02-04 15:06:41 +01:00
Guillaume Wenzek
1c9ec996ee fixup! bazel: use prebuilt protoc binaries (#178) 2025-02-04 15:06:37 +01:00
Guillaume Wenzek
90903b7816 fix fromArray 2025-02-04 09:45:16 +01:00
Guillaume Wenzek
87b5722261 zml.buffer.awaitAll 2025-02-03 14:24:35 +01:00
Guillaume Wenzek
bc514c191d revert zml: exe should collect events 2025-01-30 18:14:34 +01:00
Guillaume Wenzek
6050d4f032 zml: remove api from Shard 2025-01-29 10:28:55 +01:00
Guillaume Wenzek
01c54e0e72 zml: exe should collect events 2025-01-29 10:28:49 +01:00
Corentin Godeau
d9f2fa8d19 zml/tensor.zig: add maximum as scatter operation 2025-01-28 11:09:01 +00:00
Steeve Morin
f4eb7594b4 zml/module: disable CUDA libnvptx for older plugin 2025-01-26 12:16:32 +00:00
Steeve Morin
6e3879546b zml/hostbuffer: is buffer is ready, mark it ready 2025-01-26 12:16:04 +00:00
Steeve Morin
39a64d1041 zml/buffer: await constant buffer creation 2025-01-26 12:15:35 +00:00
Steeve Morin
b3fdf197fe zml: add asynchronous HostBuffer event 2025-01-24 21:15:50 +01:00
Steeve Morin
1141fa7f9d zml,mnist: fix async buffers handling 2025-01-24 21:11:03 +01:00
Rene Schallner
9a683a87b2 zml(buffer): fix const bug in toHostAlloc 2025-01-24 21:10:40 +01:00
Steeve Morin
85698b515e zml/exe: don't await for shard after execution 2025-01-24 21:10:36 +01:00
Steeve Morin
2612952a44 zml: add Buffer.Shard type 2025-01-24 21:10:25 +01:00
Steeve Morin
9517504d02 zml/aio: await weights transfers 2025-01-24 21:09:50 +01:00
Rene Schallner
9ca43972d8 llama: fix async toHost usage when fetching token from device. 2025-01-24 21:09:43 +01:00
Steeve Morin
8a5b73e70b zml/aio: wait for buffer readiness in loadBuffers 2025-01-24 21:09:40 +01:00
Steeve Morin
7980fb51ff zml: make buffers and execute asynchronous
This change makes buffer and execution completely asynchronous. This
enable easy pipelining of multiple operations. It doesn't map well to
`async` because the PJRT API is already asynchronous, so might as well
use it as is.
2025-01-24 21:09:12 +01:00
18 changed files with 420 additions and 179 deletions