0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

67 commits

Author SHA1 Message Date
Guillaume Wenzek
8e7f8799d8 fix sinks 2025-09-04 16:54:56 +02:00
Guillaume Wenzek
e54c28ed81 handle printing strided HostBuffer 2025-09-04 16:21:51 +02:00
Guillaume Wenzek
c6fa067583 fix moe 2025-09-04 11:35:27 +02:00
Guillaume Wenzek
ac771828b5 mixtral -> Mixtral 2025-09-04 11:34:35 +02:00
Guillaume Wenzek
faa87aa0d3 refactor moe code 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
96d7add5ec move bitcast to inference code 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
2e0cc3f4da add mixtral to zls 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
ebcd411365 more std.format workaround 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
82fe2cd9cb mixtral test 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
0bec0cfb08 mixtra.Mixtral -> Mixtral.zig 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
f044545640 update to 0.15 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
036fb8981b BlockScaledLinear, attention sinks
fixup! BlockScaledLinear, attention sinks

fixup! BlockScaledLinear, attention sinks
2025-09-04 11:34:33 +02:00
Guillaume Wenzek
9c71941e54 fix mlir mixed precisions 2025-09-04 11:34:33 +02:00
Guillaume Wenzek
305d6729ad expose more PJRT types 2025-09-04 11:34:33 +02:00
Guillaume Wenzek
7923c40b73 attempt at generating mxfp4 code in stablehlo
fusion doesn't work as expected, even when enabling triton
2025-09-04 11:34:33 +02:00
Guillaume Wenzek
295fef0c10 mixtral -> gpt_oss 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
06304d641d add Yarn rope variant 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
6650422ce9 update build.bazel 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
fbc8763f4f modernize code 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
789bb5c4ec Update gather docs 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
6804b571fb update write_first_model.md 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
ab73e1c516 remove ununsed Tensor._reserveIdRange 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
f6279991cc BaseExe: use groupedAlloc 2025-09-04 11:34:30 +02:00
Guillaume Wenzek
7b5f8e887d refactor examples/simple_layer 2025-09-04 11:34:07 +02:00
Guillaume Wenzek
3a2f7d5fa1 mixtureOfExperts: improve the routing schema to avoid droping top-1 experts 2025-09-04 11:34:06 +02:00
Guillaume Wenzek
4e6a0fc65c Moe: wip batched strategy 2025-09-04 11:33:48 +02:00
Guillaume Wenzek
0d02e0e37e add moe tests 2025-09-04 11:33:48 +02:00
Guillaume Wenzek
97af400513 fix mixtral weight loading 2025-09-04 11:33:47 +02:00
Guillaume Wenzek
3de51d55ac binaryOp does some broadcasting 2025-09-04 11:33:47 +02:00
Guillaume Wenzek
1204928cf8 topK should rename the axis by default 2025-09-04 11:33:45 +02:00
Guillaume Wenzek
0adfd2ead6 mixtral: use transferData for MoE layers 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
60c15b92ca sort imports 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
564dba43aa move bufferTypeFromDtype to pjrtx.zig 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
7f762bc394 use buffer.uninitialized 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
3760650532 load sharded experts 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
268b6abf77 add CPU device count create option 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
de3e428b47 zml.aio.BufferStore: loadBufferById 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
887f0001b5 WIP: mixtral custom loading logic 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
e40805d78c move _unique_id to the BufferStore
# Conflicts:
#	zml/aio/torch.zig
#	zml/aio/torch/file.zig
2025-09-04 11:33:23 +02:00
Guillaume Wenzek
7cdbd02e4c moe: fix scatter calls 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
77e1bf0108 fixup MoE 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
9fbf45d9c9 WIP: mixtureOfExperts 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
189aad7cb5 examples/mixtral 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
ae6905dd7a rewrite gatherValues 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
6268644b06 flatten -> torch.flatten; flattenAll -> flatten
fixup! flatten -> torch.flatten; flattenAll -> flatten
2025-09-04 11:33:22 +02:00
Guillaume Wenzek
0be25b946c remove async from zml/tokenizer 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
d90e3c9c63 drop sdpaMemEfficient 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
8deb98cfd3 fix floatCast 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
2fa09e1d5f deinit create buffers 2025-09-04 11:30:56 +02:00
Guillaume Wenzek
8d1a6836ac drop platform.registerCallback 2025-09-04 11:12:13 +02:00
Guillaume Wenzek
58f4a90f78 remove item 2025-09-04 10:56:09 +02:00
Guillaume Wenzek
87ecbab2f4 improve hostbuffer printing 2025-09-04 10:48:45 +02:00
Guillaume Wenzek
01f84799a1 cleanup commented code 2025-09-04 10:31:39 +02:00
Guillaume Wenzek
4a23125cb7 remove cuda code from context 2025-09-04 10:19:56 +02:00
Guillaume Wenzek
49bc087f9f CustomCall -> Callback 2025-09-04 10:17:56 +02:00
Guillaume Wenzek
e7df761176 disable command_buffer_compatible for print
only work for toy examples, on complex graph this lead to memory corruption
2025-09-04 09:09:42 +02:00
Guillaume Wenzek
a76635df8f workaround zig build error 2025-09-04 09:08:55 +02:00
Guillaume Wenzek
ff1847df3d rewrite examples/custom_call 2025-09-03 21:49:08 +02:00
Guillaume Wenzek
1d930d9f0b cleanup customCall impl
# Conflicts:
#	zml/custom_call.zig
#	zml/tensor.zig
#	zml/zml.zig
2025-09-03 21:48:40 +02:00
Guillaume Wenzek
a639241261 HandlerTraits
fixup! fix mlir mixed precisions

# Conflicts:
#	pjrt/ffi.zig
#	pjrt/pjrt.zig

# Conflicts:
#	zml/context.zig
2025-09-03 21:44:51 +02:00
Guillaume Wenzek
523b3cf913 remove dead code 2025-09-03 21:33:32 +02:00
Guillaume Wenzek
9b96da659b avoid ZML specific stuff in pjrt bindings 2025-09-03 21:30:04 +02:00
Guillaume Wenzek
b7cd493e56 update to 0.15.0 2025-09-03 21:29:33 +02:00
Guillaume Wenzek
4cf8e55612 refactor imports 2025-09-03 21:23:21 +02:00
Guillaume Wenzek
5c2dc6c377 handle memories on CPU 2025-09-03 21:20:14 +02:00
Hugo Mano
3e49bfee28 async exe 2025-09-03 15:41:14 +00:00
Hugo Mano
ffbb293331 zml: custom call v2 2025-09-03 15:41:14 +00:00
50 changed files with 3951 additions and 1605 deletions