0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-18 18:57:29 +00:00
Commit graph

1,078 commits

Author SHA1 Message Date
Steeve Morin
a89c1a16b2 zml: introduce mem subpackage
This implement various host pinned allocators as well as
static and dynamic buffer pools
2026-01-27 22:53:04 +00:00
Steeve Morin
b48c122756 workspace: import cc_* rules from rules_cc
This becomes mandatory starting bazel 9

Also fixed in patchelf=0.18.0.bcr.1
2026-01-27 22:49:06 +00:00
Corentin Godeau
d56e5ce673 zml/testing: Re-introduced testLayer convenience
This function helps when porting models from torch.
2026-01-21 17:11:09 +01:00
Corentin Godeau
f89f4d1cac zml/io: quickfix for loadBuffersFromId
This fix should be properly addressed in the future.
2026-01-21 17:10:44 +01:00
Corentin Godeau
e04091b5af zml: Removed ConstSlice
constness is now handled at runtime via a union in `zml.Slice`
2026-01-21 11:00:19 +01:00
Corentin Godeau
16f8770602 zml: fix test_runner 2026-01-21 11:00:02 +01:00
Steeve Morin
0b25fbc6f5 platforms/cuda/flashattn: proper bazel dep chain
this won't depend on flashattn is cuda is disabled
2026-01-20 19:05:06 +00:00
Steeve Morin
ed709599f6 cuda/flashattn: package bindings in cuda platform 2026-01-20 18:55:21 +00:00
Steeve Morin
d26386d206 platforms: fix cuda, rocm and neuron sandboxes 2026-01-19 22:16:47 +01:00
Steeve Morin
0aff9cf4dc examples/llama: plug std.Progress to the compilation pipeline 2026-01-19 18:42:05 +01:00
Steeve Morin
1b644887b7 bazel,platforms: centralize runfiles loading
runfiles are process-wide in space and time.
so it makes sense to keep them around

because they are bound to the process, we use the smp_allocator and
except the memory to be kept around during the lifetime of the process.
2026-01-19 18:14:06 +01:00
Steeve Morin
21a7c5fec8 platforms: pass allocator to load 2026-01-19 17:41:57 +01:00
Steeve Morin
9e2c09066b runtimes: rename to platforms 2026-01-19 17:41:38 +01:00
Steeve Morin
ba57994cac runtimes: remove layers targets
it is now handled in the runtimes themselves
2026-01-19 16:22:34 +01:00
Hugo Mano
dc2e876b21 Fix llama stack corruption and remove Buffer.fromIoBufferize 2026-01-19 14:27:23 +00:00
Steeve Morin
32ca342f2c examples/llama: remove S3 vfs init 2026-01-16 21:32:39 +01:00
Corentin Godeau
27cf49cbe4 zml: added missing @alignCast
It was removed for a test and wasn't added back
2026-01-16 18:15:07 +01:00
Corentin Godeau
7bbce6c3d0
Attention Backend on ZML V2 (#373) 2026-01-16 10:59:12 +01:00
Corentin Godeau
2ea598a90f pjrt: missing fixes 2026-01-15 18:24:34 +00:00
Corentin Godeau
de41199c68 examples/llama: fix buffer size allocation 2026-01-15 18:24:34 +00:00
Hugo Mano
015ed2245f zml/io/vfs: add s3 vfs 2026-01-15 16:12:43 +00:00
Hugo Mano
3c96903568 Refactor llama and VFS to new CLI and IO APIs 2026-01-15 15:19:10 +01:00
Steeve Morin
7a798bb057 zml/io/vfs: use indices to address backends, switch to
StringArrayHashMapUnmanaged
2026-01-14 19:19:09 +01:00
Steeve Morin
6ee968e033 WIP 2026-01-14 18:08:56 +01:00
Hugo Mano
42633d133d use model name as progress 2026-01-14 18:04:56 +01:00
Hugo Mano
25a5ee10f6 rework zml.io.* 2026-01-14 18:04:55 +01:00
Steeve Morin
3112f1138a stdx: add utf32 helpers 2026-01-14 18:00:22 +01:00
Steeve Morin
b03b6299fc pjrt: remove get prefixes when not matching with PJRT 2026-01-11 22:23:25 +01:00
Steeve Morin
b0f35d4815 pjrt: remove dep to stdx 2026-01-11 22:13:57 +01:00
Steeve Morin
dc4f6e2f00 zml: remove zml.init and deinit 2026-01-11 21:24:57 +01:00
Steeve Morin
faee73c5ee zml: explicit TF_CPP_LOG_LEVEL 2026-01-11 17:19:30 +01:00
Steeve Morin
989f5aef25 workspace: bump bazel=8.5.0 2026-01-11 17:14:37 +01:00
Steeve Morin
431dcd7a1c pjrt: guard against out of bounds access
when calling into an API, make sure that the method is inside the
struct_size, else we would read into undefined memory
2026-01-11 16:07:33 +01:00
Steeve Morin
a05fa3299e pjrt: rework extensions support through tagged union 2026-01-11 16:07:33 +01:00
Steeve Morin
8c8f233f6a third_party/xla: bump to head 2026-01-11 16:07:33 +01:00
Steeve Morin
c1c97d8dec pjrt: more cosmetics 2026-01-11 16:07:33 +01:00
Steeve Morin
89aa189d8d pjrt: add addressableMemory from pjrtx
it should be part of the binding
2026-01-11 16:07:33 +01:00
Steeve Morin
470359f39a pjrt: memorystats structs in structs 2026-01-11 16:07:33 +01:00
Steeve Morin
9eae5baaf4 pjrt: meta 2026-01-11 16:07:33 +01:00
Steeve Morin
55488f676d PJRT: meta 2026-01-11 16:07:33 +01:00
Steeve Morin
132c7cf390 pjrt:WIP 2026-01-11 16:07:33 +01:00
Steeve Morin
75903732c1 pjrt: do not deinit Event after await
PJRT_Buffer_ReadyEvent semantics say it allocates a new object
everytime, of which the caller is the owner.
2026-01-11 16:07:33 +01:00
Steeve Morin
ab62c536e2 runtimes/neuron: wip 2026-01-11 16:07:33 +01:00
Steeve Morin
008390f305 runtimes/neuron: bump neuron dependencies 2026-01-11 16:07:33 +01:00
Steeve Morin
a39fece38c WIP BUFFEREDWRITER 2026-01-09 10:45:00 +01:00
Steeve Morin
fe2d33eca1 zml: force unwrap on compute_capability attribute on rocm
this should absolutely fail if this doesn't exist
2026-01-08 09:31:44 +00:00
Steeve Morin
2b0a8e653c zml: on cuda, re-enable triton gemm by default
NVIDIA doesn't recommend disabling it anymore
2026-01-08 09:13:24 +00:00
Steeve Morin
33775378b9 zml: disable command buffer on rocm
This avoids weird crashes, AMD recommended disabling it for now.
2026-01-08 09:13:24 +00:00
Steeve Morin
e20e224833 zml: on rocm, only enable triton gemm when using CDNA 2026-01-08 09:13:24 +00:00
Steeve Morin
d42e4f99ad pjrt: add DeviceDescription.attributes
and attribute helper for getting only one
2026-01-08 09:13:24 +00:00