Steeve Morin
a89c1a16b2
zml: introduce mem subpackage
...
This implement various host pinned allocators as well as
static and dynamic buffer pools
2026-01-27 22:53:04 +00:00
Steeve Morin
b48c122756
workspace: import cc_* rules from rules_cc
...
This becomes mandatory starting bazel 9
Also fixed in patchelf=0.18.0.bcr.1
2026-01-27 22:49:06 +00:00
Corentin Godeau
d56e5ce673
zml/testing: Re-introduced testLayer convenience
...
This function helps when porting models from torch.
2026-01-21 17:11:09 +01:00
Corentin Godeau
f89f4d1cac
zml/io: quickfix for loadBuffersFromId
...
This fix should be properly addressed in the future.
2026-01-21 17:10:44 +01:00
Corentin Godeau
e04091b5af
zml: Removed ConstSlice
...
constness is now handled at runtime via a union in `zml.Slice`
2026-01-21 11:00:19 +01:00
Corentin Godeau
16f8770602
zml: fix test_runner
2026-01-21 11:00:02 +01:00
Steeve Morin
0b25fbc6f5
platforms/cuda/flashattn: proper bazel dep chain
...
this won't depend on flashattn is cuda is disabled
2026-01-20 19:05:06 +00:00
Steeve Morin
ed709599f6
cuda/flashattn: package bindings in cuda platform
2026-01-20 18:55:21 +00:00
Steeve Morin
d26386d206
platforms: fix cuda, rocm and neuron sandboxes
2026-01-19 22:16:47 +01:00
Steeve Morin
0aff9cf4dc
examples/llama: plug std.Progress to the compilation pipeline
2026-01-19 18:42:05 +01:00
Steeve Morin
1b644887b7
bazel,platforms: centralize runfiles loading
...
runfiles are process-wide in space and time.
so it makes sense to keep them around
because they are bound to the process, we use the smp_allocator and
except the memory to be kept around during the lifetime of the process.
2026-01-19 18:14:06 +01:00
Steeve Morin
21a7c5fec8
platforms: pass allocator to load
2026-01-19 17:41:57 +01:00
Steeve Morin
9e2c09066b
runtimes: rename to platforms
2026-01-19 17:41:38 +01:00
Steeve Morin
ba57994cac
runtimes: remove layers targets
...
it is now handled in the runtimes themselves
2026-01-19 16:22:34 +01:00
Hugo Mano
dc2e876b21
Fix llama stack corruption and remove Buffer.fromIoBufferize
2026-01-19 14:27:23 +00:00
Steeve Morin
32ca342f2c
examples/llama: remove S3 vfs init
2026-01-16 21:32:39 +01:00
Corentin Godeau
27cf49cbe4
zml: added missing @alignCast
...
It was removed for a test and wasn't added back
2026-01-16 18:15:07 +01:00
Corentin Godeau
7bbce6c3d0
Attention Backend on ZML V2 ( #373 )
2026-01-16 10:59:12 +01:00
Corentin Godeau
2ea598a90f
pjrt: missing fixes
2026-01-15 18:24:34 +00:00
Corentin Godeau
de41199c68
examples/llama: fix buffer size allocation
2026-01-15 18:24:34 +00:00
Hugo Mano
015ed2245f
zml/io/vfs: add s3 vfs
2026-01-15 16:12:43 +00:00
Hugo Mano
3c96903568
Refactor llama and VFS to new CLI and IO APIs
2026-01-15 15:19:10 +01:00
Steeve Morin
7a798bb057
zml/io/vfs: use indices to address backends, switch to
...
StringArrayHashMapUnmanaged
2026-01-14 19:19:09 +01:00
Steeve Morin
6ee968e033
WIP
2026-01-14 18:08:56 +01:00
Hugo Mano
42633d133d
use model name as progress
2026-01-14 18:04:56 +01:00
Hugo Mano
25a5ee10f6
rework zml.io.*
2026-01-14 18:04:55 +01:00
Steeve Morin
3112f1138a
stdx: add utf32 helpers
2026-01-14 18:00:22 +01:00
Steeve Morin
b03b6299fc
pjrt: remove get prefixes when not matching with PJRT
2026-01-11 22:23:25 +01:00
Steeve Morin
b0f35d4815
pjrt: remove dep to stdx
2026-01-11 22:13:57 +01:00
Steeve Morin
dc4f6e2f00
zml: remove zml.init and deinit
2026-01-11 21:24:57 +01:00
Steeve Morin
faee73c5ee
zml: explicit TF_CPP_LOG_LEVEL
2026-01-11 17:19:30 +01:00
Steeve Morin
989f5aef25
workspace: bump bazel=8.5.0
2026-01-11 17:14:37 +01:00
Steeve Morin
431dcd7a1c
pjrt: guard against out of bounds access
...
when calling into an API, make sure that the method is inside the
struct_size, else we would read into undefined memory
2026-01-11 16:07:33 +01:00
Steeve Morin
a05fa3299e
pjrt: rework extensions support through tagged union
2026-01-11 16:07:33 +01:00
Steeve Morin
8c8f233f6a
third_party/xla: bump to head
2026-01-11 16:07:33 +01:00
Steeve Morin
c1c97d8dec
pjrt: more cosmetics
2026-01-11 16:07:33 +01:00
Steeve Morin
89aa189d8d
pjrt: add addressableMemory from pjrtx
...
it should be part of the binding
2026-01-11 16:07:33 +01:00
Steeve Morin
470359f39a
pjrt: memorystats structs in structs
2026-01-11 16:07:33 +01:00
Steeve Morin
9eae5baaf4
pjrt: meta
2026-01-11 16:07:33 +01:00
Steeve Morin
55488f676d
PJRT: meta
2026-01-11 16:07:33 +01:00
Steeve Morin
132c7cf390
pjrt:WIP
2026-01-11 16:07:33 +01:00
Steeve Morin
75903732c1
pjrt: do not deinit Event after await
...
PJRT_Buffer_ReadyEvent semantics say it allocates a new object
everytime, of which the caller is the owner.
2026-01-11 16:07:33 +01:00
Steeve Morin
ab62c536e2
runtimes/neuron: wip
2026-01-11 16:07:33 +01:00
Steeve Morin
008390f305
runtimes/neuron: bump neuron dependencies
2026-01-11 16:07:33 +01:00
Steeve Morin
a39fece38c
WIP BUFFEREDWRITER
2026-01-09 10:45:00 +01:00
Steeve Morin
fe2d33eca1
zml: force unwrap on compute_capability attribute on rocm
...
this should absolutely fail if this doesn't exist
2026-01-08 09:31:44 +00:00
Steeve Morin
2b0a8e653c
zml: on cuda, re-enable triton gemm by default
...
NVIDIA doesn't recommend disabling it anymore
2026-01-08 09:13:24 +00:00
Steeve Morin
33775378b9
zml: disable command buffer on rocm
...
This avoids weird crashes, AMD recommended disabling it for now.
2026-01-08 09:13:24 +00:00
Steeve Morin
e20e224833
zml: on rocm, only enable triton gemm when using CDNA
2026-01-08 09:13:24 +00:00
Steeve Morin
d42e4f99ad
pjrt: add DeviceDescription.attributes
...
and attribute helper for getting only one
2026-01-08 09:13:24 +00:00