0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
Commit graph

490 commits

Author SHA1 Message Date
Steeve Morin
0695720918 pjrt: add from DynLib 2026-02-12 21:00:05 +01:00
Steeve Morin
eb05f39fb3 WIP 2026-02-12 20:59:20 +01:00
louis
161ff5defc llama per layers 2026-02-04 19:30:17 +01:00
Corentin Godeau
30c25d9294 wip 2026-02-04 09:47:41 +01:00
Corentin Kerisit
fb3778e619 wip 2026-02-03 20:05:27 +01:00
Steeve Morin
862b654668 platforms: add metal 2026-02-03 17:09:21 +01:00
Steeve Morin
0f460fb636 zml: expose Memory, pass Platform as *const, add zml.io.load 2026-02-03 10:59:39 +00:00
Steeve Morin
f76f02984e zml: add io.BufferedDeviceWriter, io.DirectDeviceWriter and
io.ProgressWriter
2026-01-28 18:13:17 +00:00
Steeve Morin
7832fd26ac stdx: rework stdx.Io.LimitedGroup to use atomics and conditions 2026-01-28 18:12:15 +00:00
Steeve Morin
7f936ba7b3 zml: create and pass Platform via const pointer
Platform is destined to hold more things, since it's effectively an
object
that is instanciated once per program. Make it a pointer and pass it via
const pointers around.
2026-01-28 18:11:35 +00:00
Steeve Morin
a8154fb5de zml: upgrade meta.TupleRange to Zig 0.16 2026-01-28 18:07:06 +00:00
Steeve Morin
24137cdc11 pjrt: sugarize Event.onReady
Dont't expose callconv stuff, just pass a comptimed function
2026-01-27 23:20:17 +00:00
Steeve Morin
a89c1a16b2 zml: introduce mem subpackage
This implement various host pinned allocators as well as
static and dynamic buffer pools
2026-01-27 22:53:04 +00:00
Steeve Morin
b48c122756 workspace: import cc_* rules from rules_cc
This becomes mandatory starting bazel 9

Also fixed in patchelf=0.18.0.bcr.1
2026-01-27 22:49:06 +00:00
Corentin Godeau
d56e5ce673 zml/testing: Re-introduced testLayer convenience
This function helps when porting models from torch.
2026-01-21 17:11:09 +01:00
Corentin Godeau
f89f4d1cac zml/io: quickfix for loadBuffersFromId
This fix should be properly addressed in the future.
2026-01-21 17:10:44 +01:00
Corentin Godeau
e04091b5af zml: Removed ConstSlice
constness is now handled at runtime via a union in `zml.Slice`
2026-01-21 11:00:19 +01:00
Corentin Godeau
16f8770602 zml: fix test_runner 2026-01-21 11:00:02 +01:00
Steeve Morin
0b25fbc6f5 platforms/cuda/flashattn: proper bazel dep chain
this won't depend on flashattn is cuda is disabled
2026-01-20 19:05:06 +00:00
Steeve Morin
ed709599f6 cuda/flashattn: package bindings in cuda platform 2026-01-20 18:55:21 +00:00
Steeve Morin
d26386d206 platforms: fix cuda, rocm and neuron sandboxes 2026-01-19 22:16:47 +01:00
Steeve Morin
0aff9cf4dc examples/llama: plug std.Progress to the compilation pipeline 2026-01-19 18:42:05 +01:00
Steeve Morin
1b644887b7 bazel,platforms: centralize runfiles loading
runfiles are process-wide in space and time.
so it makes sense to keep them around

because they are bound to the process, we use the smp_allocator and
except the memory to be kept around during the lifetime of the process.
2026-01-19 18:14:06 +01:00
Steeve Morin
21a7c5fec8 platforms: pass allocator to load 2026-01-19 17:41:57 +01:00
Steeve Morin
9e2c09066b runtimes: rename to platforms 2026-01-19 17:41:38 +01:00
Steeve Morin
ba57994cac runtimes: remove layers targets
it is now handled in the runtimes themselves
2026-01-19 16:22:34 +01:00
Hugo Mano
dc2e876b21 Fix llama stack corruption and remove Buffer.fromIoBufferize 2026-01-19 14:27:23 +00:00
Steeve Morin
32ca342f2c examples/llama: remove S3 vfs init 2026-01-16 21:32:39 +01:00
Corentin Godeau
27cf49cbe4 zml: added missing @alignCast
It was removed for a test and wasn't added back
2026-01-16 18:15:07 +01:00
Corentin Godeau
7bbce6c3d0
Attention Backend on ZML V2 (#373) 2026-01-16 10:59:12 +01:00
Corentin Godeau
2ea598a90f pjrt: missing fixes 2026-01-15 18:24:34 +00:00
Corentin Godeau
de41199c68 examples/llama: fix buffer size allocation 2026-01-15 18:24:34 +00:00
Hugo Mano
015ed2245f zml/io/vfs: add s3 vfs 2026-01-15 16:12:43 +00:00
Hugo Mano
3c96903568 Refactor llama and VFS to new CLI and IO APIs 2026-01-15 15:19:10 +01:00
Steeve Morin
7a798bb057 zml/io/vfs: use indices to address backends, switch to
StringArrayHashMapUnmanaged
2026-01-14 19:19:09 +01:00
Steeve Morin
6ee968e033 WIP 2026-01-14 18:08:56 +01:00
Hugo Mano
42633d133d use model name as progress 2026-01-14 18:04:56 +01:00
Hugo Mano
25a5ee10f6 rework zml.io.* 2026-01-14 18:04:55 +01:00
Steeve Morin
3112f1138a stdx: add utf32 helpers 2026-01-14 18:00:22 +01:00
Steeve Morin
b03b6299fc pjrt: remove get prefixes when not matching with PJRT 2026-01-11 22:23:25 +01:00
Steeve Morin
b0f35d4815 pjrt: remove dep to stdx 2026-01-11 22:13:57 +01:00
Steeve Morin
dc4f6e2f00 zml: remove zml.init and deinit 2026-01-11 21:24:57 +01:00
Steeve Morin
faee73c5ee zml: explicit TF_CPP_LOG_LEVEL 2026-01-11 17:19:30 +01:00
Steeve Morin
989f5aef25 workspace: bump bazel=8.5.0 2026-01-11 17:14:37 +01:00
Steeve Morin
431dcd7a1c pjrt: guard against out of bounds access
when calling into an API, make sure that the method is inside the
struct_size, else we would read into undefined memory
2026-01-11 16:07:33 +01:00
Steeve Morin
a05fa3299e pjrt: rework extensions support through tagged union 2026-01-11 16:07:33 +01:00
Steeve Morin
8c8f233f6a third_party/xla: bump to head 2026-01-11 16:07:33 +01:00
Steeve Morin
c1c97d8dec pjrt: more cosmetics 2026-01-11 16:07:33 +01:00
Steeve Morin
89aa189d8d pjrt: add addressableMemory from pjrtx
it should be part of the binding
2026-01-11 16:07:33 +01:00
Steeve Morin
470359f39a pjrt: memorystats structs in structs 2026-01-11 16:07:33 +01:00