0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

27 commits

Author SHA1 Message Date
Corentin Godeau
11e6b2a859 zml/nn: remove useless convert 2026-02-16 09:06:06 +00:00
Corentin Godeau
ea676abb59 zml/nn: added default value for rope_theta + linear scaling 2026-02-16 09:05:48 +00:00
Corentin Godeau
db99a312c9 zml/attention: added options for paged_attention 2026-02-16 09:05:21 +00:00
Corentin Godeau
6391e90039 zml/testing: formatting fix 2026-02-12 14:54:56 +00:00
Corentin Godeau
74832f343b zml/nn: added common rope_theta parameter to rope variants 2026-02-12 14:54:11 +00:00
Corentin Godeau
3c3a6f5b1b zml/attention: update to latest zml/v2 changes 2026-02-12 14:50:17 +00:00
Corentin Godeau
d3f7f132c8 zml/tensor: fix formatting in dot 2026-02-12 14:47:17 +00:00
Benjamin Rabier
6488547335 zml/io: Fix race condition for last flipflop transfer 2026-02-12 13:18:23 +00:00
Corentin Godeau
4505fc3703 zml: added some convenience to paged_attention 2026-02-12 11:16:56 +00:00
Corentin Godeau
833ef78715 zml: added ops.scaledDot()
It implements a scaled dot product
2026-02-12 11:16:56 +00:00
Corentin Godeau
8b453c7139 zml/testing: Made testlayer take a runtime name 2026-02-12 11:16:55 +00:00
Corentin Godeau
19a07b87fb zml/nn: Improved Yarn logic 2026-02-12 11:16:23 +00:00
Corentin Godeau
e668996fea zml/attention: Re-introduced allocationSize 2026-02-12 11:16:23 +00:00
Corentin Godeau
a3fe30791a zml/io: added TensorStore.hasKey() to check key existence
It's a bit hacky since it does an array traversal to see if there is a
match.
2026-02-12 11:15:51 +00:00
Corentin Godeau
26d223ca52 zml/nn: Use higher precision for rmsNorm 2026-02-12 11:15:38 +00:00
Corentin Godeau
955cd89af1 zml/nn: removed commented code 2026-02-12 11:15:38 +00:00
Corentin Godeau
a4cee2db07 zml/attention: fix wrong causal option 2026-02-12 11:15:38 +00:00
Corentin Godeau
fbc7965ce8 third_party/flashattn: bump libflashattn.so 2026-02-12 11:15:38 +00:00
Corentin Godeau
ac4a0e8060 small fixes 2026-02-12 11:15:38 +00:00
Corentin Godeau
8ab0d04b28 flashattn lib override 2026-02-12 11:15:38 +00:00
Corentin Godeau
bd2bfdde9a zml: added simple tracer support back 2026-02-12 11:15:38 +00:00
Corentin Godeau
b1f12e194a Added paged attention FA3 2026-02-12 11:15:38 +00:00
Corentin Godeau
aaf139dfe4 wip: argument baking 2026-02-12 11:15:38 +00:00
Corentin Godeau
722ad5254b wip it works 2026-02-12 11:15:37 +00:00
Corentin Godeau
f5b95c3c13 zml: added some paged attention bindings 2026-02-12 11:15:24 +00:00
Corentin Godeau
b0c0527d49 third_party/zls: fix so that we can use it outside of zml 2026-02-12 11:14:52 +00:00
Corentin Godeau
0e0570fa51 workspace: fix to allow use of ZML in monorepo 2026-02-12 11:14:52 +00:00
21 changed files with 1390 additions and 78 deletions