0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

67 commits

Author SHA1 Message Date
Guillaume Wenzek
8e7f8799d8 fix sinks 2025-09-04 16:54:56 +02:00
Guillaume Wenzek
e54c28ed81 handle printing strided HostBuffer 2025-09-04 16:21:51 +02:00
Guillaume Wenzek
c6fa067583 fix moe 2025-09-04 11:35:27 +02:00
Guillaume Wenzek
ac771828b5 mixtral -> Mixtral 2025-09-04 11:34:35 +02:00
Guillaume Wenzek
faa87aa0d3 refactor moe code 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
96d7add5ec move bitcast to inference code 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
2e0cc3f4da add mixtral to zls 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
ebcd411365 more std.format workaround 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
82fe2cd9cb mixtral test 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
0bec0cfb08 mixtra.Mixtral -> Mixtral.zig 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
f044545640 update to 0.15 2025-09-04 11:34:34 +02:00
Guillaume Wenzek
036fb8981b BlockScaledLinear, attention sinks
fixup! BlockScaledLinear, attention sinks

fixup! BlockScaledLinear, attention sinks
2025-09-04 11:34:33 +02:00
Guillaume Wenzek
9c71941e54 fix mlir mixed precisions 2025-09-04 11:34:33 +02:00
Guillaume Wenzek
305d6729ad expose more PJRT types 2025-09-04 11:34:33 +02:00
Guillaume Wenzek
7923c40b73 attempt at generating mxfp4 code in stablehlo
fusion doesn't work as expected, even when enabling triton
2025-09-04 11:34:33 +02:00
Guillaume Wenzek
295fef0c10 mixtral -> gpt_oss 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
06304d641d add Yarn rope variant 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
6650422ce9 update build.bazel 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
fbc8763f4f modernize code 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
789bb5c4ec Update gather docs 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
6804b571fb update write_first_model.md 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
ab73e1c516 remove ununsed Tensor._reserveIdRange 2025-09-04 11:34:32 +02:00
Guillaume Wenzek
f6279991cc BaseExe: use groupedAlloc 2025-09-04 11:34:30 +02:00
Guillaume Wenzek
7b5f8e887d refactor examples/simple_layer 2025-09-04 11:34:07 +02:00
Guillaume Wenzek
3a2f7d5fa1 mixtureOfExperts: improve the routing schema to avoid droping top-1 experts 2025-09-04 11:34:06 +02:00
Guillaume Wenzek
4e6a0fc65c Moe: wip batched strategy 2025-09-04 11:33:48 +02:00
Guillaume Wenzek
0d02e0e37e add moe tests 2025-09-04 11:33:48 +02:00
Guillaume Wenzek
97af400513 fix mixtral weight loading 2025-09-04 11:33:47 +02:00
Guillaume Wenzek
3de51d55ac binaryOp does some broadcasting 2025-09-04 11:33:47 +02:00
Guillaume Wenzek
1204928cf8 topK should rename the axis by default 2025-09-04 11:33:45 +02:00
Guillaume Wenzek
0adfd2ead6 mixtral: use transferData for MoE layers 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
60c15b92ca sort imports 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
564dba43aa move bufferTypeFromDtype to pjrtx.zig 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
7f762bc394 use buffer.uninitialized 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
3760650532 load sharded experts 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
268b6abf77 add CPU device count create option 2025-09-04 11:33:24 +02:00
Guillaume Wenzek
de3e428b47 zml.aio.BufferStore: loadBufferById 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
887f0001b5 WIP: mixtral custom loading logic 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
e40805d78c move _unique_id to the BufferStore
# Conflicts:
#	zml/aio/torch.zig
#	zml/aio/torch/file.zig
2025-09-04 11:33:23 +02:00
Guillaume Wenzek
7cdbd02e4c moe: fix scatter calls 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
77e1bf0108 fixup MoE 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
9fbf45d9c9 WIP: mixtureOfExperts 2025-09-04 11:33:23 +02:00
Guillaume Wenzek
189aad7cb5 examples/mixtral 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
ae6905dd7a rewrite gatherValues 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
6268644b06 flatten -> torch.flatten; flattenAll -> flatten
fixup! flatten -> torch.flatten; flattenAll -> flatten
2025-09-04 11:33:22 +02:00
Guillaume Wenzek
0be25b946c remove async from zml/tokenizer 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
d90e3c9c63 drop sdpaMemEfficient 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
8deb98cfd3 fix floatCast 2025-09-04 11:33:22 +02:00
Guillaume Wenzek
2fa09e1d5f deinit create buffers 2025-09-04 11:30:56 +02:00
Guillaume Wenzek
8d1a6836ac drop platform.registerCallback 2025-09-04 11:12:13 +02:00
Guillaume Wenzek
58f4a90f78 remove item 2025-09-04 10:56:09 +02:00
Guillaume Wenzek
87ecbab2f4 improve hostbuffer printing 2025-09-04 10:48:45 +02:00
Guillaume Wenzek
01f84799a1 cleanup commented code 2025-09-04 10:31:39 +02:00
Guillaume Wenzek
4a23125cb7 remove cuda code from context 2025-09-04 10:19:56 +02:00
Guillaume Wenzek
49bc087f9f CustomCall -> Callback 2025-09-04 10:17:56 +02:00
Guillaume Wenzek
e7df761176 disable command_buffer_compatible for print
only work for toy examples, on complex graph this lead to memory corruption
2025-09-04 09:09:42 +02:00
Guillaume Wenzek
a76635df8f workaround zig build error 2025-09-04 09:08:55 +02:00
Guillaume Wenzek
ff1847df3d rewrite examples/custom_call 2025-09-03 21:49:08 +02:00
Guillaume Wenzek
1d930d9f0b cleanup customCall impl
# Conflicts:
#	zml/custom_call.zig
#	zml/tensor.zig
#	zml/zml.zig
2025-09-03 21:48:40 +02:00
Guillaume Wenzek
a639241261 HandlerTraits
fixup! fix mlir mixed precisions

# Conflicts:
#	pjrt/ffi.zig
#	pjrt/pjrt.zig

# Conflicts:
#	zml/context.zig
2025-09-03 21:44:51 +02:00
Guillaume Wenzek
523b3cf913 remove dead code 2025-09-03 21:33:32 +02:00
Guillaume Wenzek
9b96da659b avoid ZML specific stuff in pjrt bindings 2025-09-03 21:30:04 +02:00
Guillaume Wenzek
b7cd493e56 update to 0.15.0 2025-09-03 21:29:33 +02:00
Guillaume Wenzek
4cf8e55612 refactor imports 2025-09-03 21:23:21 +02:00
Guillaume Wenzek
5c2dc6c377 handle memories on CPU 2025-09-03 21:20:14 +02:00
Hugo Mano
3e49bfee28 async exe 2025-09-03 15:41:14 +00:00
Hugo Mano
ffbb293331 zml: custom call v2 2025-09-03 15:41:14 +00:00
1160 changed files with 45792 additions and 226942 deletions

11
.gitignore vendored

3840
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Binary file not shown.

Before

Width:  |  Height:  |  Size: 421 B

Some files were not shown because too many files have changed in this diff Show more