Steeve Morin
0695720918
pjrt: add from DynLib
2026-02-12 21:00:05 +01:00
Steeve Morin
eb05f39fb3
WIP
2026-02-12 20:59:20 +01:00
louis
161ff5defc
llama per layers
2026-02-04 19:30:17 +01:00
Corentin Godeau
30c25d9294
wip
2026-02-04 09:47:41 +01:00
Corentin Kerisit
fb3778e619
wip
2026-02-03 20:05:27 +01:00
Steeve Morin
862b654668
platforms: add metal
2026-02-03 17:09:21 +01:00
Steeve Morin
0f460fb636
zml: expose Memory, pass Platform as *const, add zml.io.load
2026-02-03 10:59:39 +00:00
Steeve Morin
f76f02984e
zml: add io.BufferedDeviceWriter, io.DirectDeviceWriter and
...
io.ProgressWriter
2026-01-28 18:13:17 +00:00
Steeve Morin
7832fd26ac
stdx: rework stdx.Io.LimitedGroup to use atomics and conditions
2026-01-28 18:12:15 +00:00
Steeve Morin
7f936ba7b3
zml: create and pass Platform via const pointer
...
Platform is destined to hold more things, since it's effectively an
object
that is instanciated once per program. Make it a pointer and pass it via
const pointers around.
2026-01-28 18:11:35 +00:00
Steeve Morin
a8154fb5de
zml: upgrade meta.TupleRange to Zig 0.16
2026-01-28 18:07:06 +00:00
Steeve Morin
24137cdc11
pjrt: sugarize Event.onReady
...
Dont't expose callconv stuff, just pass a comptimed function
2026-01-27 23:20:17 +00:00
Steeve Morin
a89c1a16b2
zml: introduce mem subpackage
...
This implement various host pinned allocators as well as
static and dynamic buffer pools
2026-01-27 22:53:04 +00:00
Steeve Morin
b48c122756
workspace: import cc_* rules from rules_cc
...
This becomes mandatory starting bazel 9
Also fixed in patchelf=0.18.0.bcr.1
2026-01-27 22:49:06 +00:00
Corentin Godeau
d56e5ce673
zml/testing: Re-introduced testLayer convenience
...
This function helps when porting models from torch.
2026-01-21 17:11:09 +01:00
Corentin Godeau
f89f4d1cac
zml/io: quickfix for loadBuffersFromId
...
This fix should be properly addressed in the future.
2026-01-21 17:10:44 +01:00
Corentin Godeau
e04091b5af
zml: Removed ConstSlice
...
constness is now handled at runtime via a union in `zml.Slice`
2026-01-21 11:00:19 +01:00
Corentin Godeau
16f8770602
zml: fix test_runner
2026-01-21 11:00:02 +01:00
Steeve Morin
0b25fbc6f5
platforms/cuda/flashattn: proper bazel dep chain
...
this won't depend on flashattn is cuda is disabled
2026-01-20 19:05:06 +00:00
Steeve Morin
ed709599f6
cuda/flashattn: package bindings in cuda platform
2026-01-20 18:55:21 +00:00
Steeve Morin
d26386d206
platforms: fix cuda, rocm and neuron sandboxes
2026-01-19 22:16:47 +01:00
Steeve Morin
0aff9cf4dc
examples/llama: plug std.Progress to the compilation pipeline
2026-01-19 18:42:05 +01:00
Steeve Morin
1b644887b7
bazel,platforms: centralize runfiles loading
...
runfiles are process-wide in space and time.
so it makes sense to keep them around
because they are bound to the process, we use the smp_allocator and
except the memory to be kept around during the lifetime of the process.
2026-01-19 18:14:06 +01:00
Steeve Morin
21a7c5fec8
platforms: pass allocator to load
2026-01-19 17:41:57 +01:00
Steeve Morin
9e2c09066b
runtimes: rename to platforms
2026-01-19 17:41:38 +01:00
Steeve Morin
ba57994cac
runtimes: remove layers targets
...
it is now handled in the runtimes themselves
2026-01-19 16:22:34 +01:00
Hugo Mano
dc2e876b21
Fix llama stack corruption and remove Buffer.fromIoBufferize
2026-01-19 14:27:23 +00:00
Steeve Morin
32ca342f2c
examples/llama: remove S3 vfs init
2026-01-16 21:32:39 +01:00
Corentin Godeau
27cf49cbe4
zml: added missing @alignCast
...
It was removed for a test and wasn't added back
2026-01-16 18:15:07 +01:00
Corentin Godeau
7bbce6c3d0
Attention Backend on ZML V2 ( #373 )
2026-01-16 10:59:12 +01:00
Corentin Godeau
2ea598a90f
pjrt: missing fixes
2026-01-15 18:24:34 +00:00
Corentin Godeau
de41199c68
examples/llama: fix buffer size allocation
2026-01-15 18:24:34 +00:00
Hugo Mano
015ed2245f
zml/io/vfs: add s3 vfs
2026-01-15 16:12:43 +00:00
Hugo Mano
3c96903568
Refactor llama and VFS to new CLI and IO APIs
2026-01-15 15:19:10 +01:00
Steeve Morin
7a798bb057
zml/io/vfs: use indices to address backends, switch to
...
StringArrayHashMapUnmanaged
2026-01-14 19:19:09 +01:00
Steeve Morin
6ee968e033
WIP
2026-01-14 18:08:56 +01:00
Hugo Mano
42633d133d
use model name as progress
2026-01-14 18:04:56 +01:00
Hugo Mano
25a5ee10f6
rework zml.io.*
2026-01-14 18:04:55 +01:00
Steeve Morin
3112f1138a
stdx: add utf32 helpers
2026-01-14 18:00:22 +01:00
Steeve Morin
b03b6299fc
pjrt: remove get prefixes when not matching with PJRT
2026-01-11 22:23:25 +01:00
Steeve Morin
b0f35d4815
pjrt: remove dep to stdx
2026-01-11 22:13:57 +01:00
Steeve Morin
dc4f6e2f00
zml: remove zml.init and deinit
2026-01-11 21:24:57 +01:00
Steeve Morin
faee73c5ee
zml: explicit TF_CPP_LOG_LEVEL
2026-01-11 17:19:30 +01:00
Steeve Morin
989f5aef25
workspace: bump bazel=8.5.0
2026-01-11 17:14:37 +01:00
Steeve Morin
431dcd7a1c
pjrt: guard against out of bounds access
...
when calling into an API, make sure that the method is inside the
struct_size, else we would read into undefined memory
2026-01-11 16:07:33 +01:00
Steeve Morin
a05fa3299e
pjrt: rework extensions support through tagged union
2026-01-11 16:07:33 +01:00
Steeve Morin
8c8f233f6a
third_party/xla: bump to head
2026-01-11 16:07:33 +01:00
Steeve Morin
c1c97d8dec
pjrt: more cosmetics
2026-01-11 16:07:33 +01:00
Steeve Morin
89aa189d8d
pjrt: add addressableMemory from pjrtx
...
it should be part of the binding
2026-01-11 16:07:33 +01:00
Steeve Morin
470359f39a
pjrt: memorystats structs in structs
2026-01-11 16:07:33 +01:00