0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

27 commits

Author SHA1 Message Date
Corentin Godeau
11e6b2a859 zml/nn: remove useless convert 2026-02-16 09:06:06 +00:00
Corentin Godeau
ea676abb59 zml/nn: added default value for rope_theta + linear scaling 2026-02-16 09:05:48 +00:00
Corentin Godeau
db99a312c9 zml/attention: added options for paged_attention 2026-02-16 09:05:21 +00:00
Corentin Godeau
6391e90039 zml/testing: formatting fix 2026-02-12 14:54:56 +00:00
Corentin Godeau
74832f343b zml/nn: added common rope_theta parameter to rope variants 2026-02-12 14:54:11 +00:00
Corentin Godeau
3c3a6f5b1b zml/attention: update to latest zml/v2 changes 2026-02-12 14:50:17 +00:00
Corentin Godeau
d3f7f132c8 zml/tensor: fix formatting in dot 2026-02-12 14:47:17 +00:00
Benjamin Rabier
6488547335 zml/io: Fix race condition for last flipflop transfer 2026-02-12 13:18:23 +00:00
Corentin Godeau
4505fc3703 zml: added some convenience to paged_attention 2026-02-12 11:16:56 +00:00
Corentin Godeau
833ef78715 zml: added ops.scaledDot()
It implements a scaled dot product
2026-02-12 11:16:56 +00:00
Corentin Godeau
8b453c7139 zml/testing: Made testlayer take a runtime name 2026-02-12 11:16:55 +00:00
Corentin Godeau
19a07b87fb zml/nn: Improved Yarn logic 2026-02-12 11:16:23 +00:00
Corentin Godeau
e668996fea zml/attention: Re-introduced allocationSize 2026-02-12 11:16:23 +00:00
Corentin Godeau
a3fe30791a zml/io: added TensorStore.hasKey() to check key existence
It's a bit hacky since it does an array traversal to see if there is a
match.
2026-02-12 11:15:51 +00:00
Corentin Godeau
26d223ca52 zml/nn: Use higher precision for rmsNorm 2026-02-12 11:15:38 +00:00
Corentin Godeau
955cd89af1 zml/nn: removed commented code 2026-02-12 11:15:38 +00:00
Corentin Godeau
a4cee2db07 zml/attention: fix wrong causal option 2026-02-12 11:15:38 +00:00
Corentin Godeau
fbc7965ce8 third_party/flashattn: bump libflashattn.so 2026-02-12 11:15:38 +00:00
Corentin Godeau
ac4a0e8060 small fixes 2026-02-12 11:15:38 +00:00
Corentin Godeau
8ab0d04b28 flashattn lib override 2026-02-12 11:15:38 +00:00
Corentin Godeau
bd2bfdde9a zml: added simple tracer support back 2026-02-12 11:15:38 +00:00
Corentin Godeau
b1f12e194a Added paged attention FA3 2026-02-12 11:15:38 +00:00
Corentin Godeau
aaf139dfe4 wip: argument baking 2026-02-12 11:15:38 +00:00
Corentin Godeau
722ad5254b wip it works 2026-02-12 11:15:37 +00:00
Corentin Godeau
f5b95c3c13 zml: added some paged attention bindings 2026-02-12 11:15:24 +00:00
Corentin Godeau
b0c0527d49 third_party/zls: fix so that we can use it outside of zml 2026-02-12 11:14:52 +00:00
Corentin Godeau
0e0570fa51 workspace: fix to allow use of ZML in monorepo 2026-02-12 11:14:52 +00:00
1093 changed files with 33490 additions and 214467 deletions

11
.gitignore vendored

3797
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Binary file not shown.

Before

Width:  |  Height:  |  Size: 421 B

Binary file not shown.

Before

Width:  |  Height:  |  Size: 2.1 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 106 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.9 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.7 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.8 KiB

Some files were not shown because too many files have changed in this diff Show more